Yocto 1.5 Overall Test Plan - Revision history

Alexandru.c.georgescu: /* Test Cycle */

2013-07-02T13:03:54Z

Test Cycle

2013-07-02T12:59:05Z

Target System

← Older revision		Revision as of 12:59, 2 July 2013
Line 46:		Line 46:
	!Target machine		!Target machine
	\|		\|
	! System Testing \|\| [[#Compliance Testing]] \|\| [[#Stress Testing]] \|\| [[#System Performance]] \|\| [[#~~Developer Tools~~]]		! System Testing \|\| [[#Compliance Testing]] \|\| [[#Stress Testing]] \|\| [[#System Performance]] \|\| [[#Application Development Toolkit]]
	\|-		\|-
	\| rowspan="6" \| [[#QEMU Machine]]		\| rowspan="6" \| [[#QEMU Machine]]

2013-07-02T12:57:36Z

Test Cycle

2013-07-02T12:26:26Z

Reversion history

← Older revision		Revision as of 12:26, 2 July 2013
Line 1:		Line 1:
	= Reversion history =		= Reversion history =
	{\|class="wikitable"		{\|class="wikitable"
	\| Version \|\| Modifier \|\| Comments		! Version \|\| Modifier \|\| Comments
	\|-		\|-
	\| 1.0 \|\| Alexandru Georgescu \|\| Initial Version		\| 1.0 \|\| Alexandru Georgescu \|\| Initial Version

2013-07-02T12:14:22Z

Target System

← Older revision		Revision as of 12:14, 2 July 2013
Line 43:		Line 43:

	{\|class="wikitable" style="text-align: center;"		{\|class="wikitable" style="text-align: center;"
	\| ~~Type~~		\| Machine type
	!Target machine		!Target machine
	\|		\|
	! ~~Image~~ Testing \|\| [[#Compliance Testing]] \|\| [[#Stress Testing]] \|\| [[#System Performance]] \|\| [[#Developer Tools]]		! System Testing \|\| [[#Compliance Testing]] \|\| [[#Stress Testing]] \|\| [[#System Performance]] \|\| [[#Developer Tools]]
	\|-		\|-
	\| rowspan="6" \| [[#QEMU ~~Image~~]]		\| rowspan="6" \| [[#QEMU Machine]]
	\|-		\|-
	! qemuarm		! qemuarm
Line 65:		Line 65:
	\| \|\| yes \|\| \|\| \|\| yes \|\| yes		\| \|\| yes \|\| \|\| \|\| yes \|\| yes
	\|-		\|-
	\| rowspan="5" \| [[#BSP ~~Image~~]]		\| rowspan="5" \| [[#BSP Machine]]
	\|-		\|-
	! atom-pc		! atom-pc
Line 81:		Line 81:


	=== QEMU ~~Image~~ ===		=== QEMU Machine ===
	Covering all core, QEMU, machine definitions:		Covering all core, QEMU, machine definitions:
	* qemuarm		* qemuarm
Line 89:		Line 89:
	* qemux86-64		* qemux86-64

	=== BSP ~~Image~~ ===		=== BSP Machine ===
	Covering BSPs included in the {{ns:4}}:		Covering BSPs included in the {{ns:4}}:
	* atom-pc		* atom-pc

2013-07-02T12:03:35Z

Target System

@@ Line 41: / Line 41: @@
 == Target System ==
 Area focused on a target operating system or an application that comes with it, as the output of a build process. In this area the ''run-time'' tests are executed.
 === QEMU Image ===

2013-07-02T09:42:56Z

Test Cycle

← Older revision		Revision as of 09:42, 2 July 2013
Line 152:		Line 152:
	! [[#Sanity Test]] \|\| [[#Weekly Test]] \|\| [[#Full Pass Test]] \|\| [[#Release Test]]		! [[#Sanity Test]] \|\| [[#Weekly Test]] \|\| [[#Full Pass Test]] \|\| [[#Release Test]]
	\|-		\|-
	! rowspan="4" \|Build type		! rowspan="5" \|Build type
			\|-
	! Daily (M.U.T.)		! Daily (M.U.T.)
	\| yes \|\| \|\| \|\|		\| yes \|\| \|\| \|\|
Line 199:		Line 200:
	\| \|\| \|\| yes \|\|		\| \|\| \|\| yes \|\|
	\|-		\|-
	! rowspan="9" \| Target machine		! rowspan="10" \| Target machine
			\|-
	! qemuarm		! qemuarm
	\| yes \|\| yes \|\| yes \|\|		\| yes \|\| yes \|\| yes \|\|
Line 226:		Line 228:
	! routerstationpro		! routerstationpro
	\| \|\| yes \|\| yes \|\| yes		\| \|\| yes \|\| yes \|\| yes
			\|-
			! rowspan="6" \| Target machine
			\|-
			! core-image-sato
			\| yes \|\| \|\| \|\|
			\|-
			! core-image-sato-dev
			\| yes \|\| \|\| \|\|
			\|-
			! core-image-sato-sdk
			\| yes \|\| yes \|\| yes \|\| yes
			\|-
			! core-image-minimal
			\| yes \|\| \|\| \|\|
			\|-
			! core-image-minimal-dev
			\| yes \|\| \|\| \|\|
	\|}		\|}


	== Sanity Test ==		== Sanity Test ==

2013-07-02T07:25:05Z

Test Cycle

← Older revision		Revision as of 07:25, 2 July 2013
Line 188:		Line 188:
	\|-		\|-
	! [[#System Performance]]		! [[#System Performance]]
	\| \|\| \|\| \|\|		\| \|\| \|\| \|\| yes
	\|-		\|-
	! [[#Application Development Toolkit]]		! [[#Application Development Toolkit]]

2013-06-21T10:20:58Z

Test report

← Older revision		Revision as of 10:20, 21 June 2013
Line 296:		Line 296:
	** [[Yocto Project v1.5 Status#Feature/Task Board]]		** [[Yocto Project v1.5 Status#Feature/Task Board]]

	= Test ~~report~~ =		= Test Report =
	* [[1.5 QA Status]] ~~will show a live status~~ of ~~currently~~ active test runs;		*; Objectives:
	* ~~When a test cycle is complete,~~ an email ~~containing the test report is sent~~ to the {{ns:4}} [https://lists.yoctoproject.org/listinfo/yocto mailing list];		** Show a live [[1.5 QA Status]] of the active test runs, on the latest build;
	* [[1.5 qa run history]] ~~contains previous test reports~~;		** Send out an report email to the {{ns:4}} [https://lists.yoctoproject.org/listinfo/yocto mailing list] at the end of a test cycle;
	* [[QA Status TEMPLATE]] ~~is used~~ for ~~reports~~;		** Archive reports at [[1.5 qa run history]];
	* [[Testopia]] ~~is used~~ for ~~test case management and~~ reporting.		** Use [[QA Status TEMPLATE]] for reporting;
			** Use [[Testopia]] as a tool for reporting;

2013-06-21T09:29:16Z

System Performance

← Older revision		Revision as of 09:29, 21 June 2013
Line 70:		Line 70:

	=== System Performance ===		=== System Performance ===
			*; Objective:
			**Track the run-time performance of targeted systems;

	~~The run-time performance metrics will be measured using the following methods~~:		*; Indicators:
			** Boot time for <tt>systemd</tt> and <tt>sysvinit</tt>;
	* ~~measure boot~~ time for ~~SystemD~~ and ~~SysVinit features~~		** Image size from [[Buildhistory]] to track regression;
	* ~~record image~~ size from ~~buildhistory~~ to track regression		** Piglit test suite results;
	* ~~use Phoronix Test Suite tests to benchmark Yocto images~~
	* ~~run~~ Piglit test suite

	== Developer Tools ==		== Developer Tools ==