Build testing using Autotest

What is Autotest and why use it?

Autotest is a framework for fully automated testing. It is designed primarily to test the Linux kernel, though it is useful for many other purposes such as qualifying new hardware, virtualization testing and other general user space program testing under linux platforms. If you want to know more about Autotest itself see the Autotest wiki

Because of the increasing need to automate our build tests the Yocto QA team decided to use Autotest. Currently there are 12 test cases that we run using Autotest.

Before using them and/or writing new tests you must read some Autotest documentation to understand how some things work:

https://github.com/autotest/autotest/wiki/ClientQuickStart

https://github.com/autotest/autotest/wiki/ControlRequirements

https://github.com/autotest/autotest/wiki/ControlHowto

https://github.com/autotest/autotest/wiki/AutotestApi

https://github.com/autotest/autotest/wiki/ResultsSpecification

How to run the tests using the standalone autotest client on your machine

Running a test is simple:

#clone the autotest repo $ git clone https://github.com/autotest/autotest $ cd autotest/client/ #get our tests $ git clone -b stefans/tests git://git.yoctoproject.org/poky-contrib tmp/site_tests # to see tha available tests run $ ./autotest list # bitbake core-image-minimal $ ./autotest --verbose run heater/control.minimal # e.g: bitbake core-image-minimal with x32 tune $ ./autotest --verbose run heater/control.281x-minx32