WW32 - 2016-08-01 - Test Cycle 2.1.1 rc2
Testing data
Test type: Point Release Test Cycle Branch: krogoth Build name: 2.1.1 RC2 poky commit: f5da2a5913319ad6ac2141438ba1aa17576326ab Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1.1.rc2 Distributions tested: * Debian 8 64bit * Ubuntu 15.10 x86_64 * Ubuntu 14.04 64bit * Fedora 22 64bit * Opensuse 13.2 64bit
Test Run Summary Report
{{#testopia: | run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | report_id=concatstats}}
|
chart=bstatus | report_id=bugs | charttype=bar | sortable=true | nudechart=true | chartpos=top
}}
|
run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | charttype=bar | report_id=status}} |
Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID | Summary (4 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
BSPs | |||||||||
10048 | Graphics - ABAT-fatal IO error 11 | Medium+ | Alejandro Hernandez | 2.2 M3 | VERIFIED | NOTABUG | --- | 2016-07-28 | |
OE-Core | |||||||||
9287 | Failed to build nativesdk-glibc for qemumips and qemumips64 on Fedora 23 i686 | Medium+ | Ross Burton | Yi Zhao | 2.2 M4 | VERIFIED | FIXED | Regression (Used to work) | 2016-03-17 |
9285 | Failed to build gobject-introspection for qemumips64 on i686 hosts | Medium+ | Scott Rifenbark | Yi Zhao | 2.2 M4 | RESOLVED | FIXED | New (Never tested) | 2016-03-17 |
Runtime Testing | |||||||||
8988 | test_rpm_query_nonroot (oeqa.runtime.rpm.RpmInstallRemoveTest) - Failed to create new user | Medium+ | Ross Burton | David Rodriguez | 2.2 M3 | VERIFIED | DUPLICATE | Regression (Used to work) | 2016-01-22 |
Other Bugs found during QA Test
ID | Summary (8 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
--- | |||||||||
5351 | genericx86 auth.err getty[615]: tcgetattr: Input/output | Medium | Jianxun Zhang | Juan Ramos | 2.2 | RESOLVED | FIXED | --- | 2013-10-14 |
BSPs | |||||||||
9860 | LAN device doesn't retrieve connection after resume from suspend state | Medium+ | David Rodriguez | David Rodriguez | 2.2 M3 | VERIFIED | FIXED | --- | 2016-06-30 |
New (Never tested) | |||||||||
9048 | Failed to build iptables with extensible sdk on Fedora 23 i686 | Medium | Robert Yang | Yi Zhao | 2.2 M4 | VERIFIED | FIXED | New (Never tested) | 2016-02-04 |
Regression (Found by QA test) | |||||||||
9462 | Boot and install from USB failed getting a xhci_hcd error after booting kernel panic is displayed | Medium | California Sullivan | Juan Ramos | 2.2 | RESOLVED | FIXED | Regression (Found by QA test) | 2016-04-13 |
9271 | dmi firmware registration failed, ioremap error on 32 bit MinnowBoard | Medium | California Sullivan | Juan Ramos | 2.2 | RESOLVED | WONTFIX | Regression (Found by QA test) | 2016-03-16 |
9267 | test_parselogs (oeqa.runtime.parselogs.ParseLogsTest) failed on NUC 6i5SYH, firmware load for i915/skl_guc_ver4.bin failed | Medium | California Sullivan | Apoorv | 2.5 | RESOLVED | FIXED | Regression (Found by QA test) | 2016-03-15 |
Regression (Used to work) | |||||||||
9259 | The rpm database costs lots of disk space after install a package | Medium | Yi Zhao | Yi Zhao | 2.4 | RESOLVED | FIXED | Regression (Used to work) | 2016-03-15 |
OE-Core | |||||||||
9120 | The patch file is not applied to linux-yocto by yocto-kernel add patch command | Medium | Leonardo Sandoval Gonzalez | Yi Zhao | 2.2 M1 | VERIFIED | FIXED | Regression (Used to work) | 2016-02-16 |
pTest open bugs
ID | Summary (8 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
Runtime Testing | |||||||||
9055 | pTest - acl (NUC) failed tested on NUC 5425WYK for YP 2.1_M2.rc1 | Medium | Robert Yang | Francisco Pedraza | 2.4 | RESOLVED | FIXED | Regression (Used to work) | 2016-02-04 |
8471 | ptest - some valgrind ptests fail on 2.4 M1.rc1 | Medium | Maxin B. John | 4.99 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-10-09 | |
9053 | pTest - util-linux (NUC) failed tested on NUC 5425WYK for YP 2.1_M2.rc1 | Medium | dengke | Francisco Pedraza | 2.3 | RESOLVED | DUPLICATE | Regression (Used to work) | 2016-02-04 |
8146 | ptest - some test cases are failing for acl | Medium | Ajay Kumar | Ross Burton | 2.2 | RESOLVED | DUPLICATE | --- | 2015-08-11 |
8834 | pTest - attr test fail ln -s f | Medium | dengke | 2.2 M3 | VERIFIED | FIXED | --- | 2015-12-17 | |
8832 | pTest - bash tests fail for 2.1_M1.rc1 | Medium | Changqing Li | 2.7 M2 | RESOLVED | WORKSFORME | --- | 2015-12-17 | |
8828 | pTest - lttng-tools tests fail | Medium | Richard Purdie | yeoh ee peng | 4.99 | RESOLVED | FIXED | Regression (Used to work) | 2015-12-17 |
8812 | Some util-linux ptests fail | Medium | dengke | 2.2 M4 | RESOLVED | FIXED | --- | 2015-12-16 |
Current community Open Bugs - Medium+/High
Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones
ID | P | Summary | Assignee | QA | Milestone | Status | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|
0 | ||||||||
Runtime Testing | ||||||||
8861 | Medium+ | System envs in /etc/profile are not injected in oeqa ssh connection | Ross Burton | Costin | 2.1 M3 | CLOSED | --- | 2015-12-24 |
1 |
Bug Trend
An overview of this week's Yocto Bug Trend charts can be accessed on the following page
Build Performance Test
Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.
Below chars are showing the latest performance results taken from current milestone
Performance Charts
GDC performance machines were focused ta take measurements for master branch to monitor any degradation on Kernel, that is why there is no available charts for this Point release
pTest results for genericx86-64 on NUC
< Back
Ran on a NUC and compared with commit 98c57bb512ea6790db8604fcf0b88c81651d2ab4
Package Name | Tests ran | Passed | Failed | Passrate | Last Passrate | Run difference |
tcl (NUC) | 148 | 147 | 1 | 99.0% | 99.0% | |
acl (NUC) | 212 | 203 | 9 | 96.0% | 96.0% | |
busybox (NUC) | 474 | 466 | 8 | 98.0% | 98.0% | |
bash (NUC) | 76 | 71 | 5 | 93.0% | 93.0% | |
gawk (NUC) | 282 | 281 | 1 | 100.0% | 100.0% | |
python (NUC) | 14593 | 14546 | 47 | 100.0% | 100.0% | |
dbus-test (NUC) | 15 | 4 | 11 | 27.0% | 27.0% | |
pango (NUC) | 12 | 12 | 0 | 100.0% | 100.0% | |
util-linux (NUC) | 19 | 18 | 1 | 95.0% | 95.0% | |
quilt (NUC) | 55 | 55 | 0 | 100.0% | 100.0% | |
gdk-pixbuf (NUC) | 15 | 15 | 0 | 100.0% | 100.0% | |
perl (NUC) | 2266 | 2256 | 10 | 100.0% | 100.0% | |
openssl (NUC) | 50 | 48 | 2 | 96.0% | 100.0% | |
bluez5 (NUC) | 25 | 25 | 0 | 100.0% | 100.0% | |
diffstat (NUC) | 439 | 439 | 0 | 100.0% | 100.0% | |
zlib (NUC) | 2 | 2 | 0 | 100.0% | 100.0% | |
libpcre (NUC) | 3 | 3 | 0 | 100.0% | 100.0% | |
attr (NUC) | 108 | 108 | 0 | 100.0% | 100.0% | |
libxml2 (NUC) | 85 | 82 | 3 | 96.0% | 96.0% | |
bzip2 (NUC) | 6 | 6 | 0 | 100.0% | 100.0% | |
lttng-tools (NUC) | 14 | 0 | 14 | 0.0% | 0.0% | No |
diffutils (NUC) | 12 | 12 | 0 | 100.0% | 100.0% | |
perl5 (NUC) | 2266 | 2256 | 10 | 100.0% | 100.0% | |
valgrind (NUC) | 538 | 2 | 536 | 0.0% | 0.0% | No |
nettle (NUC) | 87 | 86 | 1 | 99.0% | 99.0% | |
e2fsprogs (NUC) | 1 | 0 | 1 | 0.0% | 0.0% | No |
glib-2.0 (NUC) | 277 | 270 | 7 | 97.0% | 97.0% | |
openssh (NUC) | 56 | 56 | 0 | 100.0% | 100.0% | |
strace (NUC) | 90 | 90 | 0 | 100.0% | 100.0% | |
gdbm (NUC) | 11 | 11 | 0 | 100.0% | 100.0% |
Detailed Report
Distro Testing
Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Core Build System
Bitbake
Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Meta-Yocyo
Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
OE-Core
Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Hob
Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
BSP
genericx86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
genericx86_64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Beaglebone Black: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
EdgeRouter: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
MPC8315e-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
P1022ds-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Qemu
qemux86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemux86-64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuarm: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemumips: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuppc: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Toaster
Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Runtime Testing
Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Detailed result at: Build performance metrics
Build-appliance
Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Ubuntu x86-64
Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Eclipse Plugin
Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}