WW43 - 2016-10-18 - Full Test Cycle 2.2 rc4
Testing data
Test type: Full Test Cycle Branch: master Build name: 2.2 rc4 poky commit: 4b94b498e21aeba945fe7e72a6b7c4bb0314fb83 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.2.rc4/ Distributions tested: -Ubuntu 16.04 -Ubuntu 14 04 -OpenSuse 421 -Opensuse 13.2 -Debian 8 -Centos 7 -Fedora 23 -Fedora 24
Test Run Summary Report
{{#testopia: | run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:eSDK}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | report_id=concatstats}}
|
chart=bstatus | report_id=bugs | charttype=bar | sortable=true | nudechart=true | chartpos=top
}}
|
run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:eSDK}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | charttype=bar | report_id=status}} |
Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID | Summary (10 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
BSPs | |||||||||
10455 | [morty][Test Case 1059] Parselogs is failing on genericx86 (32 and 64 bits) giving error: blk_update_request: I/O error, dev loop0 | Medium | California Sullivan | yeoh ee peng | 2.5 M3 | RESOLVED | FIXED | --- | 2016-10-18 |
10456 | X can not launch on qemumips64 | Medium+ | Armin Kuster | Yi Zhao | 2.2.2 | VERIFIED | FIXED | Regression (Used to work) | 2016-10-19 |
10481 | [Test Case 1059] Parselogs is failing on genericx86 (32 and 64 bits) WIC giving error: GPT: Use GNU Parted to correct GPT errors. | Medium | Jair Gonzalez | Juan Ramos | 2.3 M1 | RESOLVED | FIXED | --- | 2016-10-21 |
10490 | Error on oeqa.runtime.rpm.RpmInstallRemoveTest when running testimage | Medium+ | Jose Perez C | Juan Ramos | 2.3 M2 | VERIFIED | NOTABUG | --- | 2016-10-24 |
10494 | [Test Case 1059] Parselogs is failing on genericx86-64-WIC on NUC giving error: Failed to load DMC firmware | Medium | California Sullivan | 2.2.2 | RESOLVED | FIXED | --- | 2016-10-24 | |
eSDK | |||||||||
10447 | eSDK: runqemu fails unless unless DEPLOY_DIR_IMAGE is set | Medium+ | Paul Eggleton | Francisco Pedraza | 2.3 M4 | RESOLVED | FIXED | --- | 2016-10-17 |
Meta-yocto | |||||||||
10477 | yocto-bsp: tool should output a conf file to be consume by the qemu runner | Medium | Leonardo Sandoval Gonzalez | 2.5 | RESOLVED | OBSOLETE | --- | 2016-10-21 | |
Runtime | |||||||||
10434 | runqemu can not launch qemu image in Build Appliance | Medium+ | Juro Bystricky | Yi Zhao | 2.3 M1 | VERIFIED | FIXED | Regression (Used to work) | 2016-10-14 |
Toaster | |||||||||
10463 | [Test Case 910] "Recipe file" column isn't sortable | Medium | Michael Wood | Libertad | 2.3 | RESOLVED | NOTABUG | --- | 2016-10-19 |
10492 | [Test Case 1398] Build log cannot be downloaded | Medium | David Reyna | David Lopez Barriba | 2.3 M1 | VERIFIED | INVALID | --- | 2016-10-24 |
High and M+ issues Found during QA Test (NOT NEW)
Other Bugs found during QA Test (NOT NEW)
ID | Summary (3 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
--- | |||||||||
10281 | Configuration variables: I can set a value for standard shell environment variable http_proxy | Low | Toaster default assignee | yeoh ee peng | Future | NEW | --- | 2016-09-14 | |
Regression (Used to work) | |||||||||
10025 | Missing 'Connection Manager' icon for qemumips and qemumips64 | Medium | Jussi Kukkonen | Yi Zhao | 2.4 | RESOLVED | WORKSFORME | Regression (Used to work) | 2016-07-26 |
Toaster | |||||||||
8126 | Messages are missing when "IMAGE_FSTYPES" field is not properly edited | Medium | David Reyna | David Lopez Barriba | 2.4 M4 | RESOLVED | FIXED | Regression (Used to work) | 2015-08-07 |
pTest open bugs
ID | Summary (12 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
OE-Core | |||||||||
5697 | busybox: ptest cases failed | Medium | Changqing Li | 2.7 M2 | RESOLVED | FIXED | --- | 2013-12-31 | |
5695 | python: ptest cases failed | Medium | Ross Burton | 2.6 | RESOLVED | FIXED | --- | 2013-12-31 | |
Runtime Testing | |||||||||
8471 | ptest - some valgrind ptests fail on 2.4 M1.rc1 | Medium | Maxin B. John | 4.99 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-10-09 | |
9042 | pTest - strace fails on NUC 5425WYK for YP 2.1_M2.rc1 | Medium | Changqing Li | 2.7 M2 | RESOLVED | FIXED | Regression (Used to work) | 2016-02-03 | |
8146 | ptest - some test cases are failing for acl | Medium | Ajay Kumar | Ross Burton | 2.2 | RESOLVED | DUPLICATE | --- | 2015-08-11 |
8832 | pTest - bash tests fail for 2.1_M1.rc1 | Medium | Changqing Li | 2.7 M2 | RESOLVED | WORKSFORME | --- | 2015-12-17 | |
8831 | pTest - busybox tests fail for 2.1_M1.rc1 | Medium | dengke | Future | RESOLVED | DUPLICATE | --- | 2015-12-17 | |
9373 | ptest for perl hang | Medium | Aníbal Limón | 2.3 M1 | RESOLVED | DUPLICATE | --- | 2016-04-01 | |
8828 | pTest - lttng-tools tests fail | Medium | Richard Purdie | yeoh ee peng | 4.99 | RESOLVED | FIXED | Regression (Used to work) | 2015-12-17 |
9372 | Ptest for acl hang because of lack of two user bin and daemon | Medium | Chen Qi | oscar lopez arandas | 2.4 | RESOLVED | FIXED | --- | 2016-04-01 |
8656 | ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3 | Medium | Aníbal Limón | Francisco Pedraza | 2.3 M1 | RESOLVED | FIXED | Regression (Used to work) | 2015-11-06 |
9055 | pTest - acl (NUC) failed tested on NUC 5425WYK for YP 2.1_M2.rc1 | Medium | Robert Yang | Francisco Pedraza | 2.4 | RESOLVED | FIXED | Regression (Used to work) | 2016-02-04 |
Current community Open Bugs - Medium+/High
Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones
ID | P | Summary | Assignee | QA | Milestone | Status | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|
0 |
Bug Trend
An overview of this week's Yocto Bug Trend charts can be accessed on the following page
Build Performance Test
Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.
Below chars are showing the latest performance results taken from current milestone
Performance Charts
NOTE: Due bug 10285 performance results for "bitbake core-image-sato -c rootfs" measurements were failing on 2.2_M3.rc1, hence the numbers shown in the charts for that particular milestone are the ones reported on logs just before of the failure.
Performance Charts
For Bitbake core-image-sato with rm_work
Building the Virtual kernel
Building the rootfs
Building core-image-sato
pTest results for genericx86-64 on NUC
< Back
Ran on a NUC and compared with commit 2679a347c576f5411fbe802d2f6201c94036ecb2
Package Name | Tests ran | Passed | Failed | Passrate | Last Passrate |
acl | 380 | 354 | 26 | 93.20% | 96.00% |
attr | 143 | 143 | 0 | 100.00% | 100.00% |
bash | 76 | 72 | 4 | 94.70% | 95.00% |
bluez5 | 25 | 25 | 0 | 100.00% | 100.00% |
busybox | 487 | 480 | 7 | 98.60% | 98.00% |
bzip2 | 6 | 6 | 0 | 100.00% | 100.00% |
dbus-test | 15 | 4 | 11 | 26.70% | 27.00% |
diffstat | 440 | 440 | 0 | 100.00% | 100.00% |
diffutils | 16 | 16 | 0 | 100.00% | 100.00% |
e2fsprogs | 1 | 0 | 1 | 0.00% | 0.00% |
gawk | 284 | 283 | 1 | 99.60% | 100.00% |
gdbm | 22 | 22 | 0 | 100.00% | 100.00% |
gdk-pixbuf | 17 | 17 | 0 | 100.00% | 100.00% |
glib-2.0 | 280 | 273 | 7 | 97.50% | 98.00% |
kbd | 7 | 7 | 0 | 100.00% | |
libpcre | 3 | 3 | 0 | 100.00% | 100.00% |
libxml2 | 85 | 82 | 3 | 96.50% | 96.00% |
lttng-tools | 2467 | 2462 | 5 | 99.80% | 99.00% |
nettle | 87 | 86 | 1 | 98.90% | 99.00% |
openssh | 56 | 56 | 0 | 100.00% | 100.00% |
openssl | 52 | 52 | 0 | 100.00% | 100.00% |
pango | 12 | 12 | 0 | 100.00% | 100.00% |
perl | 2263 | 2262 | 1 | 100.00% | 100.00% |
perl5 | 2263 | 2262 | 1 | 100.00% | 100.00% |
python | 32056 | 31938 | 118 | 99.60% | 100.00% |
quilt | 55 | 54 | 1 | 98.20% | 100.00% |
strace | 264 | 263 | 1 | 99.60% | 100.00% |
tcl | 148 | 148 | 0 | 100.00% | 99.00% |
util-linux | 130 | 128 | 2 | 98.50% | 100.00% |
valgrind | 538 | 2 | 536 | 0.40% | 0.00% |
zlib | 2 | 2 | 0 | 100.00% | 100.00% |
Detailed Report
Distro Testing
Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Core Build System
Bitbake
Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Meta-Yocyo
Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
OE-Core
Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
eSDK
Status {{#testopia: |run_id={{#var:eSDK}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:eSDK}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:eSDK}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
BSP
genericx86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
genericx86_64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Beaglebone Black: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
EdgeRouter: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
MPC8315e-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
P1022ds-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Qemu
qemux86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemux86-64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuarm: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemumips: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuppc: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Toaster
Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Runtime Testing
Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Detailed result at: Build performance metrics
Build-appliance
Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Ubuntu x86-64
Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Eclipse Plugin
Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}