WW44 - 2015-11-04 - Full Pass 2.0.rc3
Testing data
Test type: Full Pass Release Test Branch: master Build name: 2.0.rc3 poky commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.0.rc3 Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit
Test Run Summary Report
{{#testopia: | run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | report_id=concatstats}}
|
chart=bstatus | report_id=bugs | charttype=bar | sortable=true | nudechart=false | chartpos=top
}}
|
run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | charttype=bar | report_id=status}} |
Bugs Found during QA Test
New and notable issues Found during QA Test & Community
ID | Summary (2 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
ADT | |||||||||
8124 | Fail to install sdk ext on i686 host | Medium+ | Randy Witt | Yi Zhao | 2.0.1 | VERIFIED | FIXED | New (Never tested) | 2015-08-07 |
Toaster | |||||||||
7880 | Toaster uses the same /tmp dir across releases | Medium+ | Ed Bartosh | Alexandru Roman | 2.1 M4 | VERIFIED | FIXED | New (Never tested) | 2015-06-11 |
Other Bugs found during QA Test
ID | Summary (19 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
--- | |||||||||
8484 | Yocto 2.0 rc1: i2c eeprom cannot be probed on MPC8315e-rdb | Medium | Kevin Hao | Ke Zou | 2.1 | VERIFIED | FIXED | --- | 2015-10-12 |
OE-Core | |||||||||
8575 | qemu fails to start on centos6 | Medium+ | Ross Burton | Mihail Stanciu | 2.0.1 | VERIFIED | WORKSFORME | --- | 2015-10-26 |
Toaster | |||||||||
8573 | [Toaster] the page heading doesn't change when search query returns no results | Low | Belen Barros Pena | Cristina Agurida | 2.2 | RESOLVED | DUPLICATE | --- | 2015-10-26 |
New (Never tested) | |||||||||
8448 | Audio via HDMI doesn't work | Medium | Jussi Kukkonen | Cristina Agurida | 2.1 | VERIFIED | FIXED | New (Never tested) | 2015-10-06 |
Regression (Found by QA test) | |||||||||
6584 | dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMax | Medium | Jianxun Zhang | Cristina Agurida | 2.1 | RESOLVED | FIXED | Regression (Found by QA test) | 2014-07-28 |
Regression (Used to work) | |||||||||
8308 | [ADT] Fail to install adt-installer | Medium | Juro Bystricky | Valentin Hangan | 2.0 | VERIFIED | FIXED | Regression (Used to work) | 2015-09-16 |
BSPs | |||||||||
8312 | Bad video quality during playback on media player | Medium | Saul Wold | Cristina Agurida | 2.1 | RESOLVED | FIXED | Regression (Used to work) | 2015-09-16 |
8568 | [p1022ds] Two strange core dump files in rootfs | Medium | Zhenhua Luo | Yi Zhao | 2.1 | RESOLVED | WORKSFORME | Regression (Used to work) | 2015-10-26 |
Eclipse Plugin | |||||||||
8579 | [eclipse-mars] Errors appear when debug a GTK project | Medium | Jose Lamego | Valentin Hangan | 2.1 M1 | VERIFIED | WONTFIX | Regression (Used to work) | 2015-10-26 |
OE-Core | |||||||||
8588 | OpenSUSE taps configuration failure | Medium | Cristian Iorga | Mihail Stanciu | 2.1 | VERIFIED | NOTABUG | Regression (Used to work) | 2015-10-27 |
8587 | runqemu deletes preconfigured tap on exit | Medium | Saul Wold | Mihail Stanciu | 2.1 M4 | RESOLVED | FIXED | Regression (Used to work) | 2015-10-27 |
6156 | [crosstap] no trace message output on qemuarm | Medium | Tom Zanussi | 2.2 | VERIFIED | NOTABUG | Regression (Used to work) | 2014-04-14 | |
System Startup | |||||||||
7236 | psplash: endian problem | Medium | Juro Bystricky | Yi Zhao | 2.1 | VERIFIED | FIXED | Regression (Used to work) | 2015-01-23 |
Toaster | |||||||||
8125 | Filter does not work as expected after clearing the search results | Medium | Michael Wood | Cristina Agurida | 2.2 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-08-07 |
8572 | Json import error: Openembedded branches include local branch | Medium | Mihail Stanciu | Mihail Stanciu | 2.1 | VERIFIED | OBSOLETE | Regression (Used to work) | 2015-10-26 |
7198 | Hiding a sorted column does not revert to default sorting | Medium | Michael Wood | Libertad | 2.2 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-01-20 |
8571 | Toaster "Disk I/O" and "CPU usage" fields content is not displayed | Medium | Elliot Smith | Cristina Agurida | 2.1 | RESOLVED | FIXED | Regression (Used to work) | 2015-10-26 |
8148 | Sorting the content of the Layer/Machines table doesn't work | Medium | Michael Wood | Alexandru Roman | 2.1 | VERIFIED | FIXED | Regression (Used to work) | 2015-08-11 |
8558 | Build images does not work as expected in Toaster | Undecided | Ed Bartosh | Cristina Agurida | 2.0 | VERIFIED | FIXED | Regression (Used to work) | 2015-10-22 |
pTest open bugs
ID | Summary (6 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|---|
Program Management | |||||||||
8064 | ptest fails tracker bug | Medium | Ross Burton | 2.5 | RESOLVED | OBSOLETE | --- | 2015-07-28 | |
Runtime Testing | |||||||||
8471 | ptest - some valgrind ptests fail on 2.4 M1.rc1 | Medium | Maxin B. John | 4.99 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-10-09 | |
8171 | ptest: testxlate test case failed for apr-util | Medium | Maxin B. John | Cristina Agurida | 2.1 | RESOLVED | FIXED | --- | 2015-08-17 |
8146 | ptest - some test cases are failing for acl | Medium | Ajay Kumar | Ross Burton | 2.2 | RESOLVED | DUPLICATE | --- | 2015-08-11 |
8656 | ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3 | Medium | Aníbal Limón | Francisco Pedraza | 2.3 M1 | RESOLVED | FIXED | Regression (Used to work) | 2015-11-06 |
8655 | ptest - two openssl ptests fail on 2.0.rc3 | Medium+ | Maxin B. John | Francisco Pedraza | 2.1 M3 | VERIFIED | FIXED | Regression (Used to work) | 2015-11-06 |
Current community Open Bugs - Medium+/High
Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones
ID | P | Summary | Assignee | QA | Milestone | Status | cf_regression_type | Created |
---|---|---|---|---|---|---|---|---|
0 | ||||||||
Runtime Testing | ||||||||
8307 | Medium+ | AttributeError: 'TestContext' object has no attribute 'sigterm' | Mariano Lopez | Alexandru Georgescu | 2.0 | CLOSED | --- | 2015-09-16 |
1 |
Bug Trend
An overview of this week's Yocto Bug Trend charts can be accessed on the following page
pTest results for genericx86-64 on NUC
Ran on a NUC and compared with commit 505a82673ac2487df5ea343a6422c2fc47018831
Package Name | Tests ran | Passed | Failed | Passrate | Last Passrate | Run difference |
lttng-tools (NUC) | 583 | 577 | 6 | 99.0% | 99.0% | |
beecrypt (NUC) | 21 | 21 | 0 | 100.0% | 100.0% | |
diffstat (NUC) | 439 | 439 | 0 | 100.0% | 100.0% | |
strace (NUC) | 30 | 24 | 6 | 80.0% | 80.0% | |
acl (NUC) | 211 | 197 | 14 | 93.0% | 93.0% | |
glib-2.0 (NUC) | 215 | 214 | 1 | 100.0% | 100.0% | |
libpcre (NUC) | 3 | 3 | 0 | 100.0% | 100.0% | |
nettle (NUC) | 84 | 84 | 0 | 100.0% | 100.0% | |
pango (NUC) | 11 | 10 | 1 | 91.0% | 91.0% | |
gdbm (NUC) | 11 | 11 | 0 | 100.0% | 100.0% | |
busybox (NUC) | 487 | 473 | 14 | 97.0% | 97.0% | |
dbus-test (NUC) | 15 | 15 | 0 | 100.0% | 100.0% | |
openssl (NUC) | 48 | 46 | 2 | 96.0% | 100.0% | |
libxml2 (NUC) | 85 | 85 | 0 | 100.0% | 100.0% | |
bash (NUC) | 76 | 69 | 7 | 91.0% | 91.0% | |
udev (NUC) | 139 | 139 | 0 | 100.0% | 100.0% | |
diffutils (NUC) | 12 | 12 | 0 | 100.0% | 100.0% | |
gdk-pixbuf (NUC) | 9 | 9 | 0 | 100.0% | 100.0% | |
tcl (NUC) | 148 | 145 | 3 | 98.0% | 98.0% | |
python (NUC) | 14192 | 14152 | 40 | 100.0% | 100.0% | |
e2fsprogs (NUC) | 1 | 0 | 1 | 0.0% | 0.0% | No |
attr (NUC) | 108 | 108 | 0 | 100.0% | 100.0% | |
gawk (NUC) | 282 | 281 | 1 | 100.0% | 100.0% | |
perl (NUC) | 2266 | 2257 | 9 | 100.0% | 96.0% | |
bzip2 (NUC) | 6 | 6 | 0 | 100.0% | 100.0% | |
zlib (NUC) | 2 | 2 | 0 | 100.0% | 100.0% | |
openssh (NUC) | 19 | 18 | 1 | 95.0% | 95.0% |
|
Build Performance Test
Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.8 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.
Performance Charts
For Bitbake core-image-sato with rm_work
Building the Virtual kernel
Building the rootfs
Detailed Report
Distro Testing
Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Core Build System
Bitbake
Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Meta-Yocyo
Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
OE-Core
Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Hob
Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
BSP
genericx86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
genericx86_64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Beaglebone Black: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
EdgeRouter: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
MPC8315e-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
P1022ds-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Qemu
qemux86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemux86-64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuarm: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemumips: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuppc: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Toaster
Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Runtime Testing
Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Detailed result at: Build performance metrics
Build-appliance
Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Ubuntu x86-64
Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Eclipse Plugin
Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}