QA: Difference between revisions

From Yocto Project
Jump to navigationJump to search
No edit summary
(25 intermediate revisions by 2 users not shown)
Line 1: Line 1:
See the http://yoctoproject.org/projects/testing-qa-and-autobuilder page on the website for more information on this project.
==Current Release QA Trackers==


= QA Docs =
*Bugs that need to be implemented by QA Team
* Test plans
**[[2.2 qa assigned bugs]]
** [[Yocto 2.1 Overall Test Plan]]
** [[Toaster testing plan]]
** [[SDK Testing Plan]]
** [[Distro Testing Plan]]
** [[BSP Test Plan]]
** [[QA_Master_Test_Plan]]


* Test Cases
*Bugs that need to be verified by QA Team
** [[Yocto 2.1 Test Cases]]
**[[2.2 qa owned_bugs]]


*Features to verify
**[[2.2 qa_owned features to verify]]


* Test Cycle
*Features to implement
** [[Testing Cycle]]
**[[2.2 qa owned features]]


 
*Old Bugs
* QA Automation
**[[AutoBuilder]]
**[[Distribution Support‎]]
**[[Oe-selftest]]
**[[Image tests]]
**[[Runtime]]
*** add ptest wiki
*** add piglit test wiki
*** add kernel test wiki
***[[LSB]]
***[[LSB Result]]
***[[LTP]]
***[[LTP result]]
***[[POSIX]]
***[[Posix result]]
***[[POSIX-results]]
***[[POSIX History Results]]
***[[LAVA server vs Yocto HW automation testing]]
**[[Automated package upgrade testing]]
 
*QA Tracking pages
**[[2.1 QA Owned Features]]
**[[2.1 qa owned bugs]]
**[[2.1 qa owned features to verify]]
**[[Old resolved bugs and features]]
**[[Old resolved bugs and features]]


*Reporting
==Current Release QA Test Plans==
**[[Bug reporting and Information levels]]
* [[QA Master Test Plan]]
**[[Testopia]]
* [[Yocto Project 2.2_Release Test Plan]]
**[http://errors.yoctoproject.org/Errors/ error report web]
* [[2.2 QA Status]]
 
* [[Toaster testing plan]]
*1.9 QA Tracking
* [[Extensible SDK Test Plan (eSDK)]]
** [[1.9 qa owned features]]
* [[Distro Testing Plan]]
** [[1.9 qa owned BUGS]]
* [[BSP Test Plan]]
 
*1.8 QA Tracking pages
** [[1.8 QA Status]]
** [[1.8 qa run history]]
** [[1.8 qa queries]]
** [[1.8 qa owned features]]
** [[1.8 qa owned bugs by OWNER]]
** [[1.8 qa owned bugs by PRODUCT]]
 
*Performance testing
***[[Performance Test]]
 
*QA Resources
***[[Rpm's Repository Setup for QA]]


= QA Old Test plans =
==Current Release QA Test Cases==
* Yocto 0.9
* [[Yocto 2.2 Test Cases]]
** Yocto 0.9 [[Overall Test Plan]]
** Yocto 0.9 [[Milestone Test Report]]


* Yocto 1.0
==Test Automation==
**[[Yocto 1.0 Overall Test Plan]]
===Autobuilder===
**[[Yocto 1.0.2 Test Report]]


* Yocto 1.1
The [[AutoBuilder]] is the automated build and test framework used by Yocto Project QA.
**[[Yocto 1.1 Overall Test Plan]]
**[[Yocto 1.1 Test Execution Plan]]
**[[Yocto 1.1 Weekly Test Report]]
**[[Yocto 1.1 Milestone Test Report]]
**[[Yocto 1.1.1 Test Report]]


* Yocto 1.2
===Adding Automated Tests===
**[[Yocto 1.2 Overall Test Plan]]
**[[Yocto 1.2 Test Execution Plan]]
**[[Yocto 1.2 Weekly Test Report]]
**[[Yocto 1.2 Milestone Test Report]]


* Yocto 1.3
Tests for a given component can be automated in the AutoBuilder. With that purpose, follow the [[AutoBuilder/Adding Automated Tests|Adding Automated Tests]] to the Autobuilder Guide.
**[[Yocto 1.3 Overall Test Plan]]
**[[Yocto 1.3 Test Execution Plan]]
**[[Yocto 1.3 Weekly Test Report]]
**[[Yocto 1.3 Milestone Test Report]]


* Yocto 1.4
A list of tests that are automated [[QA#List_of_Automated_Tests|can be seen here]].
**[[Yocto 1.4 Overall Test Plan]]
**[[Yocto 1.4 Milestone Test Report]]


* Yocto 1.5
==Reporting==
**[[Yocto 1.5 Overall Test Plan]]
*[[Bug reporting and Information levels]]
**[https://wiki.yoctoproject.org/wiki/1.5_qa_run_history Yocto 1.5 Weekly, Full Pass and Milestone Test Report]
*[[Testopia]], the test manager
**[[1.5 QA Status]]
*[[QA/Test_Reporting_Tool|The Test Reporting Tool]]
*[http://errors.yoctoproject.org/Errors/ error report web]


* Yocto 1.6
==Performance testing==
**[[Yocto 1.6 Overall Test Plan]]
[[Performance Test]]
**[https://wiki.yoctoproject.org/wiki/1.6_qa_run_history Yocto 1.6 Weekly, Full Pass and Milestone Test Report]
**[[1.6 QA Status]] - live status report for the current weekly build
**[[1.6 qa owned bugs]]


*Yocto 1.7
==QA Resources==
**[[1.7 QA Status]]
*[[Rpm's Repository Setup for QA]]
**[[1.7 qa owned bugs]]
*[[Testopia]]
**[[1.7 qa run history]]
*[[Testing Cycle]]
**[[1.7 meta-intel qa run history]]
*[[qa-tools|qa-tools Git Repository]]


* Yocto 1.8
= Archive =
**[[1.8 QA Status]]
**[[1.8 qa run history]]
**[[1.8 qa queries]]
**[[1.8 qa owned features]]
**[[1.8 qa owned bugs by OWNER]]
**[[1.8 qa owned bugs by PRODUCT]]


You can find the previous QA work by release in the [[QA/Archive|Yocto Project QA Archive]].


= Other Relevant Data=
* [[Yocto Bug Trend]]
* [[Yocto Bug Trend]]
* Compliance Test Result
* Compliance Test Result
Line 136: Line 70:
* [[Distribution Support]]
* [[Distribution Support]]
* [[QA BKM sharing]]
* [[QA BKM sharing]]
* [[Testopia]]
* [[LAVA server vs Yocto HW automation testing]]
 
** Note: The LAVA framework usage stopped in favor of testing in the AutoBuilder in early 2016.
 


==List of Automated Tests==
*[[Distribution Support‎]]
* add ptest wiki
* add piglit test wiki
* add kernel test wiki
*[[LSB]]
*[[LSB Result]]
*[[LTP]]
*[[LTP result]]
*[[POSIX]]
*[[Posix result]]
*[[POSIX-results]]
*[[POSIX History Results]]
*[[Automated package upgrade testing]]


[[Category:QA]]
[[Category:QA]]
{{DISPLAYTITLE:Yoctoproject QA Main Page}}

Revision as of 22:37, 19 July 2016

Current Release QA Trackers

Current Release QA Test Plans

Current Release QA Test Cases

Test Automation

Autobuilder

The AutoBuilder is the automated build and test framework used by Yocto Project QA.

Adding Automated Tests

Tests for a given component can be automated in the AutoBuilder. With that purpose, follow the Adding Automated Tests to the Autobuilder Guide.

A list of tests that are automated can be seen here.

Reporting

Performance testing

Performance Test

QA Resources

Archive

You can find the previous QA work by release in the Yocto Project QA Archive.

Other Relevant Data

List of Automated Tests