Revision as of 20:00, 16 November 2016

{{#vardefine:adt_fedora_i686| 6469, 6470 }} {{#vardefine:adt_fedora_x86-64| }} {{#vardefine:adt_ubuntu_x86-64| 6467, 6468}} {{#vardefine:beaglebone_black| 6482, 6483}} {{#vardefine:edgerouter| 6484, 6485}} {{#vardefine:genericx86| 6519, 6523, 6520}} {{#vardefine:genericx86_64| 6517, 6504, 6503, 6524, 6516, 6516}} {{#vardefine:mpc8315e-rdb| 6486, 6487}} {{#vardefine:p1022ds-rdb| }} {{#vardefine:qemux86| 6499, 6501}} {{#vardefine:qemuarm| 6471, 6476, 6473, 6474}} {{#vardefine:qemumips| 6475, 6477, 6478, 6479}} {{#vardefine:qemuppc| 6480, 6481}} {{#vardefine:qemux86-64| 6500, 6502}} {{#vardefine:eclipseplugin| 6466}} {{#vardefine:meta-yocto| 6488}} {{#vardefine:hob| }} {{#vardefine:toaster| 6465, 6498}} {{#vardefine:oe-core| 6497, 6489, 6492, 6494, 6495, 6493, 6490, 6496}} {{#vardefine:distro| }} {{#vardefine:bitbake| 6522}} {{#vardefine:runtime| 6505}} {{#vardefine:build-appliance| }}

Testing data

 Test type:  Point Release Test Cycle
 Branch: krogoth
 Build name: 2.1.2 RC2
 poky commit:  cca8dd15c8096626052f6d8d25ff1e9a606104a3
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1.2.rc1/
 Distributions tested: 
 * centos 7 
 * Debian 8
 * Fedora 23 
 * Fedora 24
 * OpenSuse132 
 * OpenSuse421 
 * ubuntu 14.04 
 * ubuntu 16.04

Test Run Summary Report

{{#testopia:

run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}}

report_id=concatstats}}

{{#testopia:

chart=bstatus

report_id=bugs

charttype=bar

sortable=true

nudechart=true

chartpos=top

}}

{{#testopia:

run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}}

charttype=bar

report_id=status}}

Bugs Found during QA Test

New and notable issues Found during QA Test & Community

ID	Summary (4 tasks) ⇒	P	Assignee	QA	Milestone	Status	Resolution	cf_regression_type	Created
Eclipse Plugin
10685	Project runs successfully but debugging throws NullPointerException	Medium	Tim Orling	Humberto Ibarra	2.3	RESOLVED	MOVED	---	2016-11-16
Meta-yocto
10674	The patch file is not applied to linux-yocto by yocto-kernel add patch command in 2.1.2 rc1	Medium	Leonardo Sandoval Gonzalez	Yi Zhao	2.1.3	VERIFIED	FIXED	Regression (Found by QA test)	2016-11-16
OE-Core
10675	Failed to build cvs and iptables with extensible sdk on Fedora 24 i686 in Yocto 2.1.2	Medium+	Yi Zhao	Yi Zhao	2.1.3	VERIFIED	FIXED	Regression (Found by QA test)	2016-11-16
Toaster
10281	Configuration variables: I can set a value for standard shell environment variable http_proxy	Low	Toaster default assignee	yeoh ee peng	Future	NEW		---	2016-09-14

Other Bugs found during QA Test

ID	Summary (8 tasks) ⇒	P	Assignee	QA	Milestone	Status	Resolution	cf_regression_type	Created
---
5351	genericx86 auth.err getty[615]: tcgetattr: Input/output	Medium	Jianxun Zhang	Juan Ramos	2.2	RESOLVED	FIXED	---	2013-10-14
BSPs
9860	LAN device doesn't retrieve connection after resume from suspend state	Medium+	David Rodriguez	David Rodriguez	2.2 M3	VERIFIED	FIXED	---	2016-06-30
New (Never tested)
9048	Failed to build iptables with extensible sdk on Fedora 23 i686	Medium	Robert Yang	Yi Zhao	2.2 M4	VERIFIED	FIXED	New (Never tested)	2016-02-04
Regression (Found by QA test)
9271	dmi firmware registration failed, ioremap error on 32 bit MinnowBoard	Medium	California Sullivan	Juan Ramos	2.2	RESOLVED	WONTFIX	Regression (Found by QA test)	2016-03-16
9267	test_parselogs (oeqa.runtime.parselogs.ParseLogsTest) failed on NUC 6i5SYH, firmware load for i915/skl_guc_ver4.bin failed	Medium	California Sullivan	Apoorv	2.5	RESOLVED	FIXED	Regression (Found by QA test)	2016-03-15
9462	Boot and install from USB failed getting a xhci_hcd error after booting kernel panic is displayed	Medium	California Sullivan	Juan Ramos	2.2	RESOLVED	FIXED	Regression (Found by QA test)	2016-04-13
Regression (Used to work)
9259	The rpm database costs lots of disk space after install a package	Medium	Yi Zhao	Yi Zhao	2.4	RESOLVED	FIXED	Regression (Used to work)	2016-03-15
OE-Core
9120	The patch file is not applied to linux-yocto by yocto-kernel add patch command	Medium	Leonardo Sandoval Gonzalez	Yi Zhao	2.2 M1	VERIFIED	FIXED	Regression (Used to work)	2016-02-16

pTest open bugs

"None"

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

ID	P	Summary	Assignee	QA	Milestone	Status	cf_regression_type	Created
		0
Runtime Testing
8861	Medium+	System envs in /etc/profile are not injected in oeqa ssh connection	Ross Burton	Costin	2.1 M3	CLOSED	---	2015-12-24
		1

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.

RO Charts

GDC Charts

Below chars are showing the latest performance results taken from current milestone

Performance Charts

GDC performance machines were focused ta take measurements for master branch to monitor any degradation on Kernel, that is why there is no available charts for this Point release

pTest results for genericx86-64 on NUC

Detailed Report

Distro Testing

Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Core Build System

Bitbake

Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Meta-Yocyo

Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

OE-Core

Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Hob

Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

BSP

genericx86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

genericx86_64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Beaglebone Black: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

EdgeRouter: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

MPC8315e-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

P1022ds-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Qemu

qemux86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemux86-64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuarm: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemumips: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuppc: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Toaster

Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Runtime Testing

Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Detailed result at: Build performance metrics

Build-appliance

Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Eclipse Plugin

Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

@@ Line 111: / Line 111: @@
    |total=summary
    |status=!(RESOLVED,VERIFIED)
-   |milestone=2.1, 2.1 M1, 2.1 M2, 2.1 M3, 2.1 M4, 2.1.1
+   |milestone=2.1, 2.1 M1, 2.1 M2, 2.1 M3, 2.1 M4, 2.1.1, 2.1.2
 }}

WW46 - 2016-11-10 - Test Cycle 2.1.2 rc1: Difference between revisions

Revision as of 20:00, 16 November 2016

Testing data

Test Run Summary Report

Bugs Found during QA Test

New and notable issues Found during QA Test & Community

Other Bugs found during QA Test

pTest open bugs

Current community Open Bugs - Medium+/High

Bug Trend

Build Performance Test

Performance Charts

pTest results for genericx86-64 on NUC

Detailed Report

Distro Testing

Core Build System

Bitbake

Meta-Yocyo

OE-Core

Hob

BSP

genericx86: core-image-sato-sdk

genericx86_64: core-image-sato-sdk

Beaglebone Black: core-image-sato-sdk

EdgeRouter: core-image-sato-sdk

MPC8315e-rdb: core-image-sato-sdk

P1022ds-rdb: core-image-sato-sdk

Qemu

qemux86: core-image-sato-sdk

qemux86-64: core-image-sato-sdk

qemuarm: core-image-sato-sdk

qemumips: core-image-sato-sdk

qemuppc: core-image-sato-sdk

Toaster

Runtime Testing

Build-appliance

ADT

ADT on: Fedora i686

ADT on: Fedora i686

ADT on: Ubuntu x86-64

Eclipse Plugin

Navigation menu

Search