Yocto 1.2 Overall Test Plan - Revision history

Jiajun at 14:42, 21 May 2012

2012-05-21T14:42:26Z

← Older revision		Revision as of 14:42, 21 May 2012
Line 1:		Line 1:
	Yocto 1.1 Overall Test Plan reversion history		Yocto 1.2 Overall Test Plan reversion history

	{\|border="1"		{\|border="1"

Jiajun: /* What will not Be Tested in Yocto v1.2 */

2012-02-03T05:29:18Z

What will not Be Tested in Yocto v1.2

← Older revision		Revision as of 05:29, 3 February 2012
Line 22:		Line 22:
	=== What will not Be Tested in Yocto v1.2 ===		=== What will not Be Tested in Yocto v1.2 ===
	Following feature categories won't be tested by QA team in Yocto v1.2:		Following feature categories won't be tested by QA team in Yocto v1.2:
	* Eclipse plugin: QA will not cover ADT plugin and ADT tools testing. -- (ADT team will cover them)
	* Documentation: QA will not validate the correctness of each documentation.		* Documentation: QA will not validate the correctness of each documentation.
	* License file: license files and legal process is owned by Distro team.		* License file: license files and legal process is owned by Distro team.

Jiajun: /* ADT Test(Covered in Weekly Test) */

2011-12-27T01:47:32Z

ADT Test(Covered in Weekly Test)

← Older revision		Revision as of 01:47, 27 December 2011
Line 251:		Line 251:

	==== ADT Test(Covered in Weekly Test) ====		==== ADT Test(Covered in Weekly Test) ====
	* ~~Toolchain test~~, ~~including compiler~~, ~~libraries~~, ~~etc.~~		* Cross-toolchain install&compiling Test
			** ADT installer
			** toolchain tarball
			** yocto build tree
			* Eclipse plugin
			** C/C++ project create/cross-compile/remote-debug/deploy
			** User-Space Tools
			** Bitbake Project Create
			** HOB
			* Distribution Support
			** 32/64 bit, QEMU/BSP support
			** Ubuntu, Fedora, Opensuse

	==== Stress Test(Covered in Fullpass Test) ====		==== Stress Test(Covered in Fullpass Test) ====

Jiajun: /* Components to Be Tested */

2011-12-27T01:43:30Z

Components to Be Tested

← Older revision		Revision as of 01:43, 27 December 2011
Line 17:		Line 17:
	* Core build system: It includes basic core build test and other build feature test. Performance and different distribuitions support will be tested also.		* Core build system: It includes basic core build test and other build feature test. Performance and different distribuitions support will be tested also.
	* Hob2: It includes functional tests for both frontend and backend of hob2.		* Hob2: It includes functional tests for both frontend and backend of hob2.
	* Yocto ADT: ~~ADT testing only covers~~ toolchain ~~test~~.		* Yocto ADT: It includes cross-toolchain, Eclipse plugin tests.
	* Power/Performance: QA will check the CPU power behavior by software level tool, such as '''powertop'''. Real Power consumption with idle is collected.		* Power/Performance: QA will check the CPU power behavior by software level tool, such as '''powertop'''. Real Power consumption with idle is collected.

Jiajun: /* Test Strategy and Approach */

2011-12-13T03:53:43Z

Test Strategy and Approach

← Older revision		Revision as of 03:53, 13 December 2011
Line 89:		Line 89:
	\| '''Chief River'''\|\|yes\|\|  \|\|   \|\|  \|\|yes\|\|yes\|\|yes		\| '''Chief River'''\|\|yes\|\|  \|\|   \|\|  \|\|yes\|\|yes\|\|yes
	\|-		\|-
	\| '''HuronRiver'''\|\|yes\|\|  \|\|  \|\|  \|\| \|\|yes\|\|~~yes~~		\| '''HuronRiver'''\|\|yes\|\|  \|\|  \|\|  \|\| \|\|yes\|\|
	\|-		\|-
	\| '''Jasperforest'''\|\|yes\|\|  \|\| \|\|yes**\|\|  \|\|  \|\|		\| '''Jasperforest'''\|\|yes\|\|  \|\| \|\|yes**\|\|  \|\|  \|\|

Yzhao: /* Test Strategy and Approach */

2011-12-12T05:29:43Z

Test Strategy and Approach

← Older revision		Revision as of 05:29, 12 December 2011
Line 105:		Line 105:
	\| '''Pandaboard'''\|\|yes\|\|   \|\|   \|\|  \|\|  \|\|   \|\| yes		\| '''Pandaboard'''\|\|yes\|\|   \|\|   \|\|  \|\|  \|\|   \|\| yes
	\|-		\|-
	\|
	\|}		\|}

Line 125:		Line 124:
	\|-		\|-
	\| '''Other build features''' \|\| yes \|\| n/a \|\| n/a		\| '''Other build features''' \|\| yes \|\| n/a \|\| n/a
	\|-		\|-
	\|
	\|}		\|}

Yzhao: /* Test Platform matrix */

2011-12-12T05:27:12Z

Test Platform matrix

← Older revision		Revision as of 05:27, 12 December 2011
Line 42:		Line 42:
	\|-		\|-
	! Sato image		! Sato image
	\| yes \|\| yes \|\| yes \|\| yes \|\| yes \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|		\| yes \|\| yes \|\| yes \|\| yes \|\| yes \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|   \|\|
	\|-		\|-
	! Sato-SDK image		! Sato-SDK image

Jiajun: /* Test Strategy and Approach */

2011-12-07T14:31:24Z

Test Strategy and Approach

← Older revision		Revision as of 14:31, 7 December 2011
Line 89:		Line 89:
	\| '''Chief River'''\|\|yes\|\|  \|\|   \|\|  \|\|yes\|\|yes\|\|yes		\| '''Chief River'''\|\|yes\|\|  \|\|   \|\|  \|\|yes\|\|yes\|\|yes
	\|-		\|-
	\| '''HuronRiver'''\|\|yes\|\|  \|\|  \|\|  \|\|~~yes~~\|\|yes\|\|yes		\| '''HuronRiver'''\|\|yes\|\|  \|\|  \|\|  \|\| \|\|yes\|\|yes
	\|-		\|-
	\| '''Jasperforest'''\|\|yes\|\|  \|\| \|\|yes**\|\|  \|\|  \|\|		\| '''Jasperforest'''\|\|yes\|\|  \|\| \|\|yes**\|\|  \|\|  \|\|

Jiajun at 16:47, 1 December 2011

2011-12-01T16:47:26Z

← Older revision		Revision as of 16:47, 1 December 2011
Line 5:		Line 5:
	\|-		\|-
	\| 0.3 \|\| Jiajun Xu \|\| Initial Version		\| 0.3 \|\| Jiajun Xu \|\| Initial Version
			\|-
			\| 0.4 \|\| Jiajun Xu \|\| Updated with comments from Song Liu and Yi Zhao
	\|}		\|}

Jiajun: /* Test Levels */

2011-12-01T16:38:46Z

Test Levels

← Older revision		Revision as of 16:38, 1 December 2011
Line 137:		Line 137:

	'''Test Frequency''': Sanity test will be run on autobuilder system against daily build image.		'''Test Frequency''': Sanity test will be run on autobuilder system against daily build image.

	'''Test Scope''': Sanity test only check very basic functionality in QEMU and its execution time is less than 10 minutes.		'''Test Scope''': Sanity test only check very basic functionality in QEMU and its execution time is less than 10 minutes.

Line 143:		Line 144:

	'''Test Frequency''': Regression test will be run on PRC autobuilder system against daily build image.		'''Test Frequency''': Regression test will be run on PRC autobuilder system against daily build image.

	'''Test Scope''': Regression Test covers more cases than Sanity Test. It includes functionality check in QEMU and the basic check for yocto build features.		'''Test Scope''': Regression Test covers more cases than Sanity Test. It includes functionality check in QEMU and the basic check for yocto build features.

Line 149:		Line 151:

	'''Test Frequency''': Weekly Test is against weekly image and occurred each Thursday if image is ready on autobuilder system. It will cost 3 days for one round weekly test.		'''Test Frequency''': Weekly Test is against weekly image and occurred each Thursday if image is ready on autobuilder system. It will cost 3 days for one round weekly test.

	'''Test Scope''': Weekly Test covers more cases than Regression Test. It includes more manual cases for QEMU and yocto build features.		'''Test Scope''': Weekly Test covers more cases than Regression Test. It includes more manual cases for QEMU and yocto build features.

Line 160:		Line 163:

	'''Test Frequency''': Fullpass test will be performed against each RC build for milestone. It will cost a whole week for one round fullpass test.		'''Test Frequency''': Fullpass test will be performed against each RC build for milestone. It will cost a whole week for one round fullpass test.

	'''Test Scope''': Fullpass Test covers more cases than Weekly Test. It includes stress test, power test, as well as compliance test.		'''Test Scope''': Fullpass Test covers more cases than Weekly Test. It includes stress test, power test, as well as compliance test.