QA: Difference between revisions
From Yocto Project
Jump to navigationJump to search
| Line 34: | Line 34: | ||
The [[AutoBuilder]] is Yoctoproject's tool for non-manual test execution, it performs the following functions: | The [[AutoBuilder]] is Yoctoproject's tool for non-manual test execution, it performs the following functions: | ||
* A | * A scheduled nightly build and test execution that includes: | ||
** That each image created executes the corresponding set of [[image tests|image/run-time tests]] | ** That each image created executes the corresponding set of [[image tests|image/run-time tests]] | ||
** Specific Autobuilder tasks for running [[oe-selftest|build-time testing]] | ** Specific Autobuilder tasks for running [[oe-selftest|build-time testing]] | ||
* | * A service for on demand testing requests. (Partially working, feature in progress at request [https://bugzilla.yoctoproject.org/show_bug.cgi?id=9080 #9880]) | ||
===Adding Automated Tests=== | ===Adding Automated Tests=== | ||
Revision as of 19:13, 2 November 2016
Current Release QA Trackers
- Bugs that need to be implemented by QA Team
- Bugs that need to be verified by QA Team
- Features to verify
- Features to implement
- Old Bugs
Current Release QA Test Plans
- QA Master Test Plan
- Yocto Project 2.2_Release Test Plan
- 2.2 QA Status
- Performance Charts
- Toaster testing plan
- Extensible SDK Test Plan (eSDK)
- Distro Testing Plan
- BSP Test Plan
Current Release QA Test Cases
Test Execution
Autobuilder
The AutoBuilder is Yoctoproject's tool for non-manual test execution, it performs the following functions:
- A scheduled nightly build and test execution that includes:
- That each image created executes the corresponding set of image/run-time tests
- Specific Autobuilder tasks for running build-time testing
- A service for on demand testing requests. (Partially working, feature in progress at request #9880)
Adding Automated Tests
Tests for a given component can be automated in the AutoBuilder. With that purpose, follow the Adding Automated Tests to the Autobuilder Guide.
A list of tests that are automated can be seen here.
Reporting
- Bug reporting and Information levels
- Testopia, the test manager
- The Test Reporting Tool
- error report web
Performance testing
QA Resources
Archive
You can find the previous QA work by release in the Yocto Project QA Archive.
Other Relevant Data
- Yocto Bug Trend
- Compliance Test Result
- ADT Testing
- Regression Test
- Performance Test
- Distro Test
- Distribution Support
- QA BKM sharing
- LAVA server vs Yocto HW automation testing
- Note: The LAVA framework usage stopped in favor of testing in the AutoBuilder in early 2016.
List of Automated Tests
- Distribution Support
- add ptest wiki
- add piglit test wiki
- add kernel test wiki
- LSB
- LSB Result
- LTP
- LTP result
- POSIX
- Posix result
- POSIX-results
- POSIX History Results
- Automated package upgrade testing
