WW35 - 2016-08-19 - Test Cycle - 2.2 Master

From Yocto Project
Jump to navigationJump to search
{{#vardefine:adt_fedora_i686| 6261, 6262}} {{#vardefine:adt_fedora_x86-64| }} {{#vardefine:adt_ubuntu_x86-64| 6259, 6260}} {{#vardefine:beaglebone_black| 6278, 6279}} {{#vardefine:edgerouter| 6280, 6281}} {{#vardefine:genericx86| 6237, 6240, 6247}} {{#vardefine:genericx86_64| 6236, 6241, 6248, 6249, 6268, 6252}} {{#vardefine:mpc8315e-rdb| 6282, 6283}} {{#vardefine:p1022ds-rdb| }} {{#vardefine:qemux86| 6238, 6250}} {{#vardefine:qemuarm| 6265, 6266, 6270, 6271}} {{#vardefine:qemumips| 6272, 6273, 6274, 6275}} {{#vardefine:qemuppc| 6276, 6277}} {{#vardefine:qemux86-64| 6239, 6251}} {{#vardefine:eclipseplugin| 6257}} {{#vardefine:meta-yocto| }} {{#vardefine:eSDK| 6267}} {{#vardefine:toaster| 6254, 6256}} {{#vardefine:oe-core| 6242, 6243, 6258, 6244, 6245, 6246}} {{#vardefine:distro| }} {{#vardefine:bitbake| 6253}} {{#vardefine:runtime| }} {{#vardefine:build-appliance| 6263}}

Testing data

 Test type: Test Cycle
 Branch: master
 Build name: 2.2 Master
 poky commit: f038f069977170e323c9c6884c69e0b9e1cf1c6f 
 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/nightly/20160819-1
 Distributions tested: 
 -Ubuntu 15.10
 -Ubuntu 14 04 
 -Opensuse 13.2  
 -Debian 8 
 -Fedora 22
 -Fedora 24

Test Run Summary Report

{{#testopia: run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:eSDK}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} report_id=concatstats}}


{{#testopia:

chart=bstatus report_id=bugs charttype=bar sortable=true nudechart=true chartpos=top

}}


{{#testopia:

run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:eSDK}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} charttype=bar report_id=status}}



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (6 tasks) ⇒PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
10189Cannot install images Genericx86, Genericx86_64, Genericx86_64-lsb from USB, panic message is displayedMedium+Alejandro HernandezFrancisco Pedraza2.2 M4RESOLVEDFIXED---2016-08-25
OE-Core
10191Fail to build galculator with toolchain SDK on Fedora 24 i686MediumJussi Kukkonen 2.2 M4RESOLVEDFIXEDNew (Never tested)2016-08-26
Toaster
10179Default Columns in Tasks table include "Recipe Version"LowBelen Barros PenaDavid Lopez Barriba2.2 M4VERIFIEDFIXED---2016-08-23
10163having a poky git checkout that mixes http and git: urls for remotes fails to build if it is a local projectMediumEd BartoshLibertad2.2 M4RESOLVEDFIXEDRegression (Used to work)2016-08-18
10190Toaster UI- create a new project "release" combobox is missing optionsUndecidedToaster default assigneeLibertad---RESOLVEDNOTABUG---2016-08-25
10180Default Columns in Recipes table dont include "Section"UndecidedToaster default assigneeLibertad---RESOLVEDNOTABUG---2016-08-23


High and M+ issues Found during QA Test (not new)

IDSummary (4 tasks) ⇒PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
OE-Core
9287Failed to build nativesdk-glibc for qemumips and qemumips64 on Fedora 23 i686Medium+Ross BurtonYi Zhao2.2 M4VERIFIEDFIXEDRegression (Used to work)2016-03-17
9285Failed to build gobject-introspection for qemumips64 on i686 hostsMedium+Scott RifenbarkYi Zhao2.2 M4RESOLVEDFIXEDNew (Never tested)2016-03-17
Patchwork/Patchtest
10109install Toaster Mailing list patchwork instance on https://patchwork.openembedded.org/Medium+Michael HalsteadLibertad2.2 M4RESOLVEDFIXED---2016-08-10
Pseudo
10024Warning "Child process exit status 4: lock_held" when building imageHighRobert Yang 2.2 M4RESOLVEDFIXEDRegression (Used to work)2016-07-26


Other Bugs found during QA Test (not new)

IDSummary (9 tasks) ⇒PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
5351genericx86 auth.err getty[615]: tcgetattr: Input/outputMediumJianxun ZhangJuan Ramos2.2RESOLVEDFIXED---2013-10-14
OE-Core
10041mediaplayer fails to play audio on skylake (xv problem)Medium+Jussi KukkonenJuan Ramos2.2 M4VERIFIEDFIXED---2016-07-27
Toaster
9839The "clear search" button on the – "Add | Remove packages table" - does not clearLowToaster default assignee FutureNEW---2016-06-28
New (Never tested)
9048Failed to build iptables with extensible sdk on Fedora 23 i686MediumRobert YangYi Zhao2.2 M4VERIFIEDFIXEDNew (Never tested)2016-02-04
Regression (Found by QA test)
9271dmi firmware registration failed, ioremap error on 32 bit MinnowBoardMediumCalifornia SullivanJuan Ramos2.2RESOLVEDWONTFIXRegression (Found by QA test)2016-03-16
BSPs
9434Running testimage test_parselogs failed getting the following error message failed to retrieve link info, disabling eDP on Minnowboard Max 32 and 64UndecidedCalifornia SullivanDavid Rodriguez2.2RESOLVEDFIXEDRegression (Found by QA test)2016-04-11
Sato
9995Network icon is not displayed properly on SATOMediumJussi KukkonenFrancisco Pedraza2.2RESOLVEDFIXEDRegression (Found by QA test)2016-07-21
Regression (Used to work)
9259The rpm database costs lots of disk space after install a packageMediumYi ZhaoYi Zhao2.4RESOLVEDFIXEDRegression (Used to work)2016-03-15
OE-Core
9813Strange kernel image for qemumips and qemumips64 in deploy directoryMediumYi ZhaoYi Zhao4.99RESOLVEDOBSOLETERegression (Used to work)2016-06-23

pTest open bugs

IDSummary (9 tasks) ⇒PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Runtime Testing
8834pTest - attr test fail ln -s fMediumdengke 2.2 M3VERIFIEDFIXED---2015-12-17
8471ptest - some valgrind ptests fail on 2.4 M1.rc1MediumMaxin B. John 4.99RESOLVEDDUPLICATERegression (Used to work)2015-10-09
8832pTest - bash tests fail for 2.1_M1.rc1MediumChangqing Li 2.7 M2RESOLVEDWORKSFORME---2015-12-17
8146ptest - some test cases are failing for aclMediumAjay KumarRoss Burton2.2RESOLVEDDUPLICATE---2015-08-11
8831pTest - busybox tests fail for 2.1_M1.rc1Mediumdengke FutureRESOLVEDDUPLICATE---2015-12-17
8828pTest - lttng-tools tests failMediumRichard Purdieyeoh ee peng4.99RESOLVEDFIXEDRegression (Used to work)2015-12-17
8656ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3MediumAníbal LimónFrancisco Pedraza2.3 M1RESOLVEDFIXEDRegression (Used to work)2015-11-06
9042pTest - strace fails on NUC 5425WYK for YP 2.1_M2.rc1MediumChangqing Li 2.7 M2RESOLVEDFIXEDRegression (Used to work)2016-02-03
8655ptest - two openssl ptests fail on 2.0.rc3Medium+Maxin B. JohnFrancisco Pedraza2.1 M3VERIFIEDFIXEDRegression (Used to work)2015-11-06

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.

Below chars are showing the latest performance results taken from current milestone

Performance Charts

Performance Charts

For Bitbake core-image-sato with rm_work

Ww35-2k16 - rmwork.png

Building the Virtual kernel

Ww35-2k16 - kernel.png

Building the rootfs

Ww35-2k16 - rootfs.png

pTest results for genericx86-64 on NUC

< Back
Ran on a NUC and compared with commit 36feb38045b7a2af86ece147fec54b0db3bf491f

Results
Package Name Tests ran Passed Failed Passrate Last Passrate Run difference
tcl (NUC) 148 147 1 99.0% 100.0%
Yes
acl (NUC) 215 206 9 96.0% 96.0%
No
busybox (NUC) 474 466 8 98.0% 98.0%
No
bash (NUC) 76 72 4 95.0% 95.0%
No
gawk (NUC) 282 281 1 100.0% 100.0%
No
python (NUC) 14821 14771 50 100.0% 100.0%
No
dbus-test (NUC) 15 4 11 27.0% 27.0%
No
pango (NUC) 12 12 0 100.0% 100.0%
No
util-linux (NUC) 19 19 0 100.0% 100.0%
No
quilt (NUC) 55 55 0 100.0% 100.0%
No
gdk-pixbuf (NUC) 17 17 0 100.0% 100.0%
No
perl (NUC) 2263 2262 1 100.0% 100.0%
No
openssl (NUC) 50 50 0 100.0% 100.0%
No
bluez5 (NUC) 25 25 0 100.0% 100.0%
No
diffstat (NUC) 439 439 0 100.0% 100.0%
No
zlib (NUC) 2 2 0 100.0% 100.0%
No
libpcre (NUC) 3 3 0 100.0% 100.0%
No
attr (NUC) 108 108 0 100.0% 100.0%
No
libxml2 (NUC) 85 82 3 96.0% 96.0%
No
bzip2 (NUC) 6 6 0 100.0% 100.0%
No
lttng-tools (NUC) 2214 2200 14 99.0% 0.0%
Yes
diffutils (NUC) 12 12 0 100.0% 100.0%
No
perl5 (NUC) 2263 2262 1 100.0% 100.0%
No
valgrind (NUC) 538 2 536 0.0% 0.0% No
nettle (NUC) 87 86 1 99.0% 99.0%
No
e2fsprogs (NUC) 1 0 1 0.0% 0.0% No
glib-2.0 (NUC) 281 274 7 98.0% 98.0%
No
openssh (NUC) 54 54 0 100.0% 100.0%
No
strace (NUC) 262 261 1 100.0% 99.0%
Yes
gdbm (NUC) 11 11 0 100.0% 100.0%
No

Detailed Report

Distro Testing

Status {{#testopia:

run_id={{#var:distro}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:distro}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:distro}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Core Build System

Bitbake

Status {{#testopia:

run_id={{#var:bitbake}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:bitbake}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:bitbake}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Meta-Yocyo

Status {{#testopia:

run_id={{#var:meta-yocto}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:meta-yocto}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:meta-yocto}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

OE-Core

Status {{#testopia:

run_id={{#var:oe-core}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:oe-core}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:oe-core}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

eSDK

Status {{#testopia:

run_id={{#var:eSDK}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:eSDK}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:eSDK}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

BSP

genericx86: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:genericx86}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:genericx86}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:genericx86}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

genericx86_64: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:genericx86_64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:genericx86_64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:genericx86_64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Beaglebone Black: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:beaglebone_black}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:beaglebone_black}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:beaglebone_black}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

EdgeRouter: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:edgerouter}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:edgerouter}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:edgerouter}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

MPC8315e-rdb: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:mpc8315e-rdb}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:mpc8315e-rdb}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:mpc8315e-rdb}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

P1022ds-rdb: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:p1022ds-rdb}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:p1022ds-rdb}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:p1022ds-rdb}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}


Qemu

qemux86: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:qemux86}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:qemux86}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:qemux86}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

qemux86-64: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:qemux86-64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:qemux86-64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:qemux86-64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

qemuarm: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:qemuarm}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:qemuarm}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:qemuarm}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

qemumips: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:qemumips}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:qemumips}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:qemumips}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

qemuppc: core-image-sato-sdk

Status {{#testopia:

run_id={{#var:qemuppc}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:qemuppc}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:qemuppc}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Toaster

Status {{#testopia:

run_id={{#var:toaster}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:toaster}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:toaster}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Runtime Testing

Status {{#testopia:

run_id={{#var:runtime}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:runtime}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:runtime}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Detailed result at: Build performance metrics

Build-appliance

Status {{#testopia:

run_id={{#var:build-appliance}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:build-appliance}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:build-appliance}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

ADT

ADT on: Fedora i686

Status {{#testopia:

run_id={{#var:adt_fedora_i686}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:adt_fedora_i686}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:adt_fedora_i686}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

ADT on: Fedora i686

Status {{#testopia:

run_id={{#var:adt_fedora_x86-64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:adt_fedora_x86-64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:adt_fedora_x86-64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

ADT on: Ubuntu x86-64

Status {{#testopia:

run_id={{#var:adt_ubuntu_x86-64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:adt_ubuntu_x86-64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:adt_ubuntu_x86-64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Eclipse Plugin

Status {{#testopia:

run_id={{#var:eclipseplugin}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:eclipseplugin}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:eclipseplugin}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=WW35_-_2016-08-19_-_Test_Cycle_-_2.2_Master&oldid=20088"