WW30 - 2016-07-21 - Full Test Cycle 2.2 M2.rc1

{{#vardefine:adt_fedora_i686| 6060, 6061 }} {{#vardefine:adt_fedora_x86-64| }} {{#vardefine:adt_ubuntu_x86-64| 6058, 6059 }} {{#vardefine:beaglebone_black| 6073, 6074 }} {{#vardefine:edgerouter| 6066, 6067 }} {{#vardefine:genericx86| 6035, 6041, 6038, 6070 }} {{#vardefine:genericx86_64| 6036, 6037, 6042, 6040, 6071, 6072 }} {{#vardefine:mpc8315e-rdb| 6068, 6069 }} {{#vardefine:p1022ds-rdb| }} {{#vardefine:qemux86| 6039 }} {{#vardefine:qemuarm| 6046, 6079, 6075, 6076 }} {{#vardefine:qemumips| 6047, 6080, 6077, 6078 }} {{#vardefine:qemuppc| 6044, 6081 }} {{#vardefine:qemux86-64| 6043 }} {{#vardefine:eclipseplugin| 6087, 6088 }} {{#vardefine:meta-yocto| 6091, 6092 }} {{#vardefine:eSDK| 6089 }} {{#vardefine:toaster| 6051, 6052 }} {{#vardefine:oe-core| 6050, 6082, 6065, 6062, 6063, 6049 }} {{#vardefine:distro| 6054, 6056, 6057 }} {{#vardefine:bitbake| 6045 }} {{#vardefine:runtime| 6086 }} {{#vardefine:build-appliance| 6085 }}

Testing data

 Test type:  Full Test Cycle
 Branch: master
 Build name: 2.2_M1.rc2
 poky commit: 6f0c5537e02c59e1c8f3b08f598dc049ff8ee098
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.2_M1.rc2
 Distributions tested: 
 -Ubuntu 15.10
 -Ubuntu 15.04 
 -Ubuntu 14 04 
 -Fedora 22 
 -Opensuse 13.2 
 -CentOS 7  
 -Debian 8 

Test Run Summary Report

{{#testopia:

run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:eSDK}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}}

report_id=concatstats}} {{#testopia:

chart=bstatus

report_id=bugs

charttype=bar

sortable=true

nudechart=true

chartpos=top }} {{#testopia:

run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:eSDK}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}}

charttype=bar

report_id=status}}

Bugs Found during QA Test

New and notable issues Found during QA Test & Community

ID	Summary (8 tasks) ⇒	P	Assignee	QA	Milestone	Status	Resolution	cf_regression_type	Created
BSPs
9652	boot and install from USB shows warning message "(sdx): Volume was not properly unmounted...Please run fsck."	Medium+	Jose Perez C	Francisco Pedraza	2.2 M4	RESOLVED	FIXED	Regression (Found by QA test)	2016-05-17
9520	test_parselogs failed on udevd[342] inotify_add_watch /dev/loop when running test image	Medium+	Alejandro Hernandez	Juan Ramos	2.2 M3	VERIFIED	FIXED	Regression (Found by QA test)	2016-04-25
OE-Core
9362	Failed to run and debug a project to qemux86 in Eclipse	Medium	brian avery	Valentin Hangan	2.1.2	RESOLVED	FIXED	---	2016-03-31
9287	Failed to build nativesdk-glibc for qemumips and qemumips64 on Fedora 23 i686	Medium+	Ross Burton	Yi Zhao	2.2 M4	VERIFIED	FIXED	Regression (Used to work)	2016-03-17
9285	Failed to build gobject-introspection for qemumips64 on i686 hosts	Medium+	Scott Rifenbark	Yi Zhao	2.2 M4	RESOLVED	FIXED	New (Never tested)	2016-03-17
Toaster
8037	External link to recipe file links to non-existing page when recipe information comes from a build	Medium	David Reyna	Libertad	2.2	RESOLVED	FIXED	---	2015-07-21
8556	Toaster: bitbake variables image_fstypes not being passed to build process	Medium+	Elliot Smith	Libertad	2.2 M2	RESOLVED	FIXED	---	2015-10-22
8952	Changes to the revision of an imported layer are not saved	Medium+	Michael Wood	Libertad	2.2	VERIFIED	FIXED	---	2016-01-20

Other Bugs found during QA Test

ID	Summary (18 tasks) ⇒	P	Assignee	QA	Milestone	Status	Resolution	cf_regression_type	Created
---
9834	with python upgraded to version 3, "yocto-kernel patch add" script failed	Medium	Humberto Ibarra		2.2 M2	RESOLVED	FIXED	---	2016-06-28
Toaster
9831	Pagination widget does not have the next and previous button for Packages, Tasks and Recipes pages	Low	Belen Barros Pena	Libertad	2.2	VERIFIED	NOTABUG	---	2016-06-27
9839	The "clear search" button on the – "Add | Remove packages table" - does not clear	Low	Toaster default assignee		Future	NEW		---	2016-06-28
9837	When trying to Download task log it returns Page not found (404)	Medium	Elliot Smith	Libertad	2.2 M3	RESOLVED	FIXED	---	2016-06-28
9846	"Most built recipes" section does not show recipes	Medium	Michael Wood	Libertad	2.2	RESOLVED	FIXED	---	2016-06-28
9836	Project builds table and Software Recipes: Sorting does not reset to default when hiding column that is currently being used as the sorting criteria	Medium	Elliot Smith	Libertad	2.2 M3	RESOLVED	FIXED	---	2016-06-28
9844	Cancel build button does not work	Medium	Sujith H	Libertad	2.2	VERIFIED	WORKSFORME	---	2016-06-28
9833	There can be a Task and Recipes table of 0 columns when deselecting them on the "Edit Columns" button	Medium	Elliot Smith	Libertad	2.2 M3	RESOLVED	FIXED	---	2016-06-27
9841	Build button in image detail page does not start build	Medium	Michael Wood	Libertad	2.2	RESOLVED	FIXED	---	2016-06-28
9832	(Tasks executed) and (Tasks not executed) link in build summary dont query any task when clicking on them	Medium	Belen Barros Pena	Libertad	2.2 M4	RESOLVED	FIXED	---	2016-06-27
9842	CLI started builds dont show properly on All builds view plus no cancel button	Medium+	Elliot Smith	David Lopez Barriba	2.2 M2	RESOLVED	FIXED	---	2016-06-28
Regression (Found by QA test)
9462	Boot and install from USB failed getting a xhci_hcd error after booting kernel panic is displayed	Medium	California Sullivan	Juan Ramos	2.2	RESOLVED	FIXED	Regression (Found by QA test)	2016-04-13
Regression (Used to work)
9824	WIC images fail to boot	Undecided	Ed Bartosh		---	RESOLVED	NOTABUG	Regression (Used to work)	2016-06-24
BSPs
9814	Test sudoku fails on qemuarm	Undecided	Saul Wold		---	RESOLVED	FIXED	Regression (Used to work)	2016-06-23
Matchbox
9828	[Beaglebone] mouse doesn't work when system startup	Medium+	Plauchu Edwin	Yi Zhao	2.2 M2	VERIFIED	FIXED	Regression (Used to work)	2016-06-27
OE-Core
9259	The rpm database costs lots of disk space after install a package	Medium	Yi Zhao	Yi Zhao	2.4	RESOLVED	FIXED	Regression (Used to work)	2016-03-15
6156	[crosstap] no trace message output on qemuarm	Medium	Tom Zanussi		2.2	VERIFIED	NOTABUG	Regression (Used to work)	2014-04-14
9822	devtool: fail to add recipe for some packages	Medium	Paul Eggleton	Yi Zhao	2.2 M2	VERIFIED	FIXED	Regression (Used to work)	2016-06-24

pTest open bugs

ID	Summary (9 tasks) ⇒	P	Assignee	QA	Milestone	Status	Resolution	cf_regression_type	Created
Runtime Testing
8834	pTest - attr test fail ln -s f	Medium	dengke		2.2 M3	VERIFIED	FIXED	---	2015-12-17
8471	ptest - some valgrind ptests fail on 2.4 M1.rc1	Medium	Maxin B. John		4.99	RESOLVED	DUPLICATE	Regression (Used to work)	2015-10-09
8832	pTest - bash tests fail for 2.1_M1.rc1	Medium	Changqing Li		2.7 M2	RESOLVED	WORKSFORME	---	2015-12-17
8146	ptest - some test cases are failing for acl	Medium	Ajay Kumar	Ross Burton	2.2	RESOLVED	DUPLICATE	---	2015-08-11
8831	pTest - busybox tests fail for 2.1_M1.rc1	Medium	dengke		Future	RESOLVED	DUPLICATE	---	2015-12-17
8828	pTest - lttng-tools tests fail	Medium	Richard Purdie	yeoh ee peng	4.99	RESOLVED	FIXED	Regression (Used to work)	2015-12-17
8656	ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3	Medium	Aníbal Limón	Francisco Pedraza	2.3 M1	RESOLVED	FIXED	Regression (Used to work)	2015-11-06
9042	pTest - strace fails on NUC 5425WYK for YP 2.1_M2.rc1	Medium	Changqing Li		2.7 M2	RESOLVED	FIXED	Regression (Used to work)	2016-02-03
8655	ptest - two openssl ptests fail on 2.0.rc3	Medium+	Maxin B. John	Francisco Pedraza	2.1 M3	VERIFIED	FIXED	Regression (Used to work)	2015-11-06

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

ID	P	Summary	Assignee	QA	Milestone	Status	cf_regression_type	Created
		0

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.

• RO Charts

• GDC Charts

Below chars are showing the latest performance results taken from current milestone

Performance Charts

For Bitbake core-image-sato with rm_work

Building the Virtual kernel

Building the rootfs

pTest results for genericx86-64 on NUC

pTest run was blocked due to the 9354 issue.

Detailed Report

Distro Testing

Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Core Build System

Bitbake

Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Meta-Yocyo

Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

OE-Core

Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

eSDK

Status {{#testopia: |run_id={{#var:eSDK}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:eSDK}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:eSDK}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

BSP

genericx86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

genericx86_64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Beaglebone Black: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

EdgeRouter: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

MPC8315e-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

P1022ds-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Qemu

qemux86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemux86-64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuarm: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemumips: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuppc: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Toaster

Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Runtime Testing

Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Detailed result at: Build performance metrics

Build-appliance

Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Eclipse Plugin

Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}