Sangeeta Jain: /* Live Schedule & Execution History */

2021-09-08T05:28:02Z

Live Schedule & Execution History

← Older revision		Revision as of 05:28, 8 September 2021
Line 449:		Line 449:
	\| DONE		\| DONE
	\| https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/log/?h=intel-yocto-testresults		\| https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/log/?h=intel-yocto-testresults
	\|- bgcolor=""		\|- bgcolor="93DB70"
	\| M2		\| M2
	\|		\| 07/26/2021
	\|		\| 07/30/2021
	\|		\| DONE
	\|		\| https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/log/?h=intel-yocto-testresults
	\|- bgcolor=""		\|- bgcolor="FFD700"
	\| M3		\| M3
			\| 09/06/2021
	\|		\|
	\|		\|In Progress
	\|
	\|		\|
	\|- bgcolor=""		\|- bgcolor=""

Sangeeta Jain: /* Pass / Fail Criteria */

2021-07-14T01:43:49Z

Pass / Fail Criteria

← Older revision		Revision as of 01:43, 14 July 2021
Line 418:		Line 418:
	= Pass / Fail Criteria =		= Pass / Fail Criteria =

	This criteria is defined in [[Yocto_Project_v3.~~3_Status~~#Yocto_Project_v3.4_Release_Criteria]]		This criteria is defined in [[Yocto_Project_v3.4_Status#Yocto_Project_v3.4_Release_Criteria]]

	= Exit Criteria =		= Exit Criteria =

Sangeeta Jain: /* Schedule */

2021-07-14T01:42:55Z

Schedule

← Older revision		Revision as of 01:42, 14 July 2021
Line 433:		Line 433:
	= Schedule =		= Schedule =

	The planed schedule for 3.3 can be found at [[Yocto_3.4_Schedule]]		The planed schedule for 3.4 can be found at [[Yocto_3.4_Schedule]]

	== Live Schedule & Execution History ==		== Live Schedule & Execution History ==

Sangeeta Jain: /* Live Schedule & Execution History */

2021-07-14T01:42:38Z

Live Schedule & Execution History

← Older revision		Revision as of 01:42, 14 July 2021
Line 449:		Line 449:
	\| DONE		\| DONE
	\| https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/log/?h=intel-yocto-testresults		\| https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/log/?h=intel-yocto-testresults
	\|- bgcolor="~~93DB70~~"		\|- bgcolor=""
	\| M2		\| M2
	\|		\|

Sangeeta Jain: Created page with " {| {{#vardefine:ADT_MAUAL | 6539}} {{#vardefine:ADT_AUTO | 6540}} {{#vardefine:ANYQEMU_S..."

2021-07-14T01:42:00Z

Created page with "  {| {{#vardefine:ADT_MAUAL | 6539}} {{#vardefine:ADT_AUTO | 6540}} {{#vardefine:ANYQEMU_S..."

New page

{|
{{#vardefine:ADT_MAUAL | 6539}}
{{#vardefine:ADT_AUTO | 6540}}
{{#vardefine:ANYQEMU_SATO_MANUAL | 6563}}
{{#vardefine:ANYQEMU_SATO_AUTO | 6564}}
{{#vardefine:ANYBSP_SATO_AUTO | 6558}}
{{#vardefine:ANYBSP_LSB_AUTO | 6561}}
{{#vardefine:ANYBSP_WIC_AUTO | 6560}}
{{#vardefine:MMAX_CORE2_MANUAL | 6554}}
{{#vardefine:MMAX_I7_MANUAL | 6557}}
{{#vardefine:NUC_I7_MANUAL | 6556}}
{{#vardefine:NUC_GEX86-64_MANUAL | 6555}}
{{#vardefine:MMAX_GEX86-32_MANUAL | 6553}}
{{#vardefine:GAL_SATO_AUTO | 6565}}
{{#vardefine:CROPS_AUTO | 6541}}
{{#vardefine:CROPS_MANUAL | 6542}}
{{#vardefine:ECLIPSE_MANUAL | 6543}}
{{#vardefine:KERNEL_MANUAL | 6714}}
{{#vardefine:METAYOCTO_MANUAL | 6544}}
{{#vardefine:TOASTER_AUTO | 6545}}
{{#vardefine:TOASTER_MANUAL | 6546}}
{{#vardefine:ESDK_MANUAL | 6547}}
{{#vardefine:ESDK_AUTO | 6548}}
{{#vardefine:OE-CORE_AUTO | 6549}}
{{#vardefine:BITBAKE_AUTO | 6550}}
{{#vardefine:RUNTIME_AUTO | 6551}}
{{#vardefine:BUILD-APPLIANCE_AUTO | 6552}}
|}


= Revision history =
{|class="wikitable"
! Version || Modifier || Comments
|-
| 1.0 || Jain Sangeeta || First draft
|-
|}

= Introduction =

This is the the overall test plan for version 3.4 of the {{ns:4}}, for all the generic information this document will be pointing to [[QA Master Test Plan]]

= Objectives =

This test plan for Yocto Project 3.4 release supports the following objectives:
*To define the tools to be used throughout the testing process.
*To communicate to the responsible parties the items to be tested, set expectations around schedule, and define environmental needs.
*To define how the tests will be conducted.
*Release Criteria
*Risks and contingencies

[[QA_Master_Test_Plan#Objectives_and_Tasks]]

= Risk Analysis & Contingency Plan =

QA identified risks for this release are mentioned here.

{| class="wikitable"
! style="text-align: center; font-weight: bold;" | Module
! style="text-align: center; font-weight: bold;" | Risk Description
! style="text-align: center; font-weight: bold;" | Risk Level
! style="text-align: center; font-weight: bold;" | Contingency plan
! style="text-align: center; font-weight: bold;" | Owner
|-
| style="text-align: center;" | BSP
| 31 manual test cases
| medium
| test cases to be automated
| Intel
|-
| style="text-align: center;" | Build Appliance
| 3 manual test cases, not executed by any QA team
| medium
| test cases to be automated
|
|-
| style="text-align: center;" | Compliance
| 4 manual test cases, not executed by any QA team
| medium
| test cases to be automated
|
|-
| style="text-align: center;" | Kernel dev
| 9 manual test cases, not executed by any QA team
| medium
| test cases to be automated
|
|-
| style="text-align: center;" | OE-Core
| 4 manual test cases
| medium
| test cases to be automated
| Intel
|-
| style="text-align: center;" | SDK
| 1 manual test case, not executed by any QA team
| medium
| test case to be automated
|
|-
| style="text-align: center;" | Toaster
| 93 manual test cases, not executed by any QA team
| medium
| test cases to be automated
|
|}

= Test Strategy =

Is followed the general strategy defined on [[QA_Master_Test_Plan#Testing_Strategy]] and below is showed specific information applicable only for 3.4 Release

= Test Items =
The Yocto Project QA team verifies each release against recent versions of the most popular Linux distributions that provide stable releases.
* centos 7
* Debian 8
* Debian 9
* Fedora 28
* Fedora 29
* Fedora 30
* OpenSuse 150
* OpenSuse 151
* OpenSuse 423
* OpenSuse Tumbleweed
* ubuntu 16.04
* ubuntu 18.04

= Test Cases =

* http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/runtime
* http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/selftest
* http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/manual
* http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/sdk
* http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/sdkext

== OE-CORE ==

{| class="wikitable"
! style="text-align: center;" | Component
! style="text-align: center;" | Environment
! style="text-align: center;" | Auto
! style="text-align: center;" | Manual
! style="text-align: center;" | Owner
|-
| rowspan="8" style="text-align: center;" | OE-CORE
| Ubuntu 20.04
|
| Y
| Intel
|-
|}

== BSP/QEMU ==

{| class="wikitable"
! Component
! Arch
! HW
! Environment
! Image
! Auto
! Manual
! pTest
! Compliance
! ltp
|-
| rowspan="30" style="text-align: center;" | BSP
| rowspan="12" style="text-align: center;" | x86
| rowspan="2" style="text-align: center;" | MinwTurbot 32bit
| rowspan="2" style="text-align: center;" | genericx86
| core-image-sato-sdk
| Y
|
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="2" style="text-align: center;" | Coffee Lake
| rowspan="2" style="text-align: center;" | genericx86-64
| core-image-sato-sdk
| Y
|
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="2" style="text-align: center;" | NUC 6
| rowspan="2" style="text-align: center;" | genericx86-64
| core-image-sato-sdk
| Y
|
| Y
|
| Y
|-
| core-image-lsb-sdk
| Y
|
|
| Y
|
|-
| rowspan="2" style="text-align: center;" | NUC 7
| rowspan="2" style="text-align: center;" | genericx86-64
| core-image-sato-sdk
| Y
| Y
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="4" style="text-align: center;" | QEMU
| rowspan="2" style="text-align: center;" | qemux86
| core-image-sato-sdk
| Y
|
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="2" style="text-align: center;" | qemux86-64
| core-image-sato-sdk
| Y
|
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="7" style="text-align: center;" | non x86
| style="text-align: center;" | EdgeRouter
| EdgeRouter
| core-image-sato-sdk
| Y
| Y
|
| Y
|
|-
| style="text-align: center;" | Beaglebone Black
| Beaglebone
| core-image-sato-sdk
| Y
| Y
|
| Y
|
|-
| rowspan="5" style="text-align: center;" | QEMU
| qemuarm
| core-image-sato-sdk
| Y
|
|
|
|
|-
| qemuarm-64
| core-image-sato-sdk
| Y
|
| Y
|
| Y
|-
| qemuppc
| core-image-sato-sdk
| Y
|
|
|
|
|-
| qemumips
| core-image-sato-sdk
| Y
|
|
|
|
|-
| qemumips64
| core-image-sato-sdk
| Y
|
|
|
|
|-
| rowspan="10" style="text-align: center;" | Meta-Intel
| rowspan="2" style="text-align: center;" | MinwTurbot 32bit
| rowspan="2" style="text-align: center;" | core2-32
| core-image-sato-sdk
| Y
|
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="2" style="text-align: center;" | Coffee Lake
| rowspan="2" style="text-align: center;" | corei7-64
| core-image-sato-sdk
| Y
|
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="2" style="text-align: center;" | NUC 6
| rowspan="2" style="text-align: center;" | corei7-64
| core-image-sato-sdk
| Y
|
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| rowspan="3" style="text-align: center;" | NUC 7
| rowspan="3" style="text-align: center;" | corei7-64
| core-image-sato-sdk
| Y
| Y
|
|
|
|-
| core-image-lsb-sdk
| Y
|
|
|
|
|-
| poky-tiny
|
| Y
|
|
|
|}

All component to be tested on 3.4 are in [[#Test Items]] a detailed list of features per component can be found in Test Plan of the components [[QA_Master_Test_Plan#Component]]



=Approach=

Testing will be done as per QA process defined in main QA wiki page at https://wiki.yoctoproject.org/wiki/QA#QA_Process.

= Pass / Fail Criteria =

This criteria is defined in [[Yocto_Project_v3.3_Status#Yocto_Project_v3.4_Release_Criteria]]

= Exit Criteria =

As defined in [[QA_Master_Test_Plan#Entry and Exit Criteria]]

= Test Deliverables =

* Final Test results
* Final Test report
* Mail sent to the mailing list

= Schedule =

The planed schedule for 3.3 can be found at [[Yocto_3.4_Schedule]]

== Live Schedule & Execution History ==

{| class="wikitable"
! MILESTONE
! STARTED
! FINISHED
! STATUS
! REPORT
|- bgcolor="93DB70"
| M1
| 06/12/2021
| 06/18/2021
| DONE
| https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/log/?h=intel-yocto-testresults
|- bgcolor="93DB70"
| M2
|
|
|
|
|- bgcolor=""
| M3
|
|
|
|
|- bgcolor=""
| M4
|
|
|
|
|- bgcolor=""
|}

Yocto Project 3.4 Release Test Plan - Revision history

Sangeeta Jain: /* Live Schedule & Execution History */

Sangeeta Jain: /* Pass / Fail Criteria */

Sangeeta Jain: /* Schedule */

Sangeeta Jain: /* Live Schedule & Execution History */

Sangeeta Jain: Created page with " {| {{#vardefine:ADT_MAUAL | 6539}} {{#vardefine:ADT_AUTO | 6540}} {{#vardefine:ANYQEMU_S..."