WW50 - 2015-12-10 - Full Pass 2.1 M1.rc1: Difference between revisions
| Line 108: | Line 108: | ||
=pTest results for genericx86-64 on NUC= | =pTest results for genericx86-64 on NUC= | ||
Click table for details | |||
[[File:Ptest ww50.JPG | link=https://wiki.yoctoproject.org/wiki/Ptest_5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e ]] | [[File:Ptest ww50.JPG | link=https://wiki.yoctoproject.org/wiki/Ptest_5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e ]] | ||
Revision as of 11:35, 17 December 2015
Testing data
Test type: Full Pass Release Test Branch: master Build name: 2.1_M1.rc1 poky commit: 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e Autobuilder images repository: N/A Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit
Test Run Summary Report
| {{#testopia: | run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | report_id=concatstats}}
|
chart=bstatus | report_id=bugs | charttype=bar | sortable=true | nudechart=true | chartpos=top
}}
|
run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} | charttype=bar | report_id=status}} |
Bugs Found during QA Test
New and notable issues Found during QA Test & Community
| ID | Summary (7 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
|---|---|---|---|---|---|---|---|---|---|
| BSPs | |||||||||
| 8802 | meta-fsl-* fails in universe fetch | High | Richard Purdie | Alexandru Georgescu | 2.1 M3 | VERIFIED | FIXED | Regression (Found by QA test) | 2015-12-14 |
| General Runtime | |||||||||
| 8817 | LTP subset test suite fails | Undecided | Saul Wold | Cristina Agurida | --- | VERIFIED | DUPLICATE | Regression (Used to work) | 2015-12-16 |
| OE-Core | |||||||||
| 8825 | Failed to run devtool sdk-update | Medium+ | Ed Bartosh | Yi Zhao | 2.1 M2 | RESOLVED | FIXED | New (Never tested) | 2015-12-17 |
| 8826 | Failed to run devtool for ext_sdk on i686 host | Medium+ | Juro Bystricky | Yi Zhao | 1.4.5 | VERIFIED | FIXED | New (Never tested) | 2015-12-17 |
| Runtime | |||||||||
| 8808 | build-appliance: build core-image-minimal error under all ARCHs (2.1 M1) | Undecided | Cristian Iorga | Ke Zou | --- | RESOLVED | FIXED | --- | 2015-12-15 |
| Toaster | |||||||||
| 8669 | Wrong password encoding syntax error in "bash -c" | High | Michael Wood | Alexandru Roman | 2.1 M1 | VERIFIED | FIXED | New (Never tested) | 2015-11-09 |
| 8791 | Software recipes table is not sort by any column by default | Low | Alexandru Roman | Alexandru Roman | 2.1 M3 | VERIFIED | WORKSFORME | --- | 2015-12-11 |
Other Bugs found during QA Test
| ID | Summary (11 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
|---|---|---|---|---|---|---|---|---|---|
| --- | |||||||||
| 8484 | Yocto 2.0 rc1: i2c eeprom cannot be probed on MPC8315e-rdb | Medium | Kevin Hao | Ke Zou | 2.1 | VERIFIED | FIXED | --- | 2015-10-12 |
| New (Never tested) | |||||||||
| 7900 | Dmesg error failed to setup card detect gpio on Minnow Max | Low | California Sullivan | Cristina Agurida | 2.2 | RESOLVED | WONTFIX | New (Never tested) | 2015-06-17 |
| Runtime Testing | |||||||||
| 7897 | Dmesg error BAR 14 and BAR 15 failed to assign in Minnow Max | Medium | Saul Wold | Cristina Agurida | 2.1 M3 | RESOLVED | FIXED | New (Never tested) | 2015-06-17 |
| Toaster | |||||||||
| 7880 | Toaster uses the same /tmp dir across releases | Medium+ | Ed Bartosh | Alexandru Roman | 2.1 M4 | VERIFIED | FIXED | New (Never tested) | 2015-06-11 |
| Regression (Found by QA test) | |||||||||
| 6584 | dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMax | Medium | Jianxun Zhang | Cristina Agurida | 2.1 | RESOLVED | FIXED | Regression (Found by QA test) | 2014-07-28 |
| Regression (Used to work) | |||||||||
| 8324 | Fail to install adt on centos 6 | Medium+ | Scott Rifenbark | Yi Zhao | 2.1 M2 | VERIFIED | FIXED | Regression (Used to work) | 2015-09-18 |
| BSPs | |||||||||
| 8312 | Bad video quality during playback on media player | Medium | Saul Wold | Cristina Agurida | 2.1 | RESOLVED | FIXED | Regression (Used to work) | 2015-09-16 |
| OE-Core | |||||||||
| 6156 | [crosstap] no trace message output on qemuarm | Medium | Tom Zanussi | 2.2 | VERIFIED | NOTABUG | Regression (Used to work) | 2014-04-14 | |
| Toaster | |||||||||
| 7198 | Hiding a sorted column does not revert to default sorting | Medium | Michael Wood | Libertad | 2.2 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-01-20 |
| 8131 | All builds page "Errors"/"Warnings" filters doesn't work | Medium | Michael Wood | Libertad | 2.2 | RESOLVED | OBSOLETE | Regression (Used to work) | 2015-08-10 |
| 8125 | Filter does not work as expected after clearing the search results | Medium | Michael Wood | Cristina Agurida | 2.2 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-08-07 |
pTest open bugs
| ID | Summary (13 tasks) ⇒ | P | Assignee | QA | Milestone | Status | Resolution | cf_regression_type | Created |
|---|---|---|---|---|---|---|---|---|---|
| Program Management | |||||||||
| 8064 | ptest fails tracker bug | Medium | Ross Burton | 2.5 | RESOLVED | OBSOLETE | --- | 2015-07-28 | |
| Runtime Testing | |||||||||
| 8831 | pTest - busybox tests fail for 2.1_M1.rc1 | Medium | dengke | Future | RESOLVED | DUPLICATE | --- | 2015-12-17 | |
| 8471 | ptest - some valgrind ptests fail on 2.4 M1.rc1 | Medium | Maxin B. John | 4.99 | RESOLVED | DUPLICATE | Regression (Used to work) | 2015-10-09 | |
| 8830 | pTest - pango tests fail for 2.1_M1.rc1 | Medium | Jussi Kukkonen | 2.1 | RESOLVED | FIXED | --- | 2015-12-17 | |
| 8835 | pTest - openssh tests fail | Medium | Alexandru Georgescu | Bogdan Alexandru Voiculescu | 2.1 | VERIFIED | INVALID | --- | 2015-12-17 |
| 8146 | ptest - some test cases are failing for acl | Medium | Ajay Kumar | Ross Burton | 2.2 | RESOLVED | DUPLICATE | --- | 2015-08-11 |
| 8829 | pTest - glib-2.0 (NUC) tests fail | Medium | Jussi Kukkonen | Cristina Agurida | 2.1 | RESOLVED | FIXED | --- | 2015-12-17 |
| 8834 | pTest - attr test fail ln -s f | Medium | dengke | 2.2 M3 | VERIFIED | FIXED | --- | 2015-12-17 | |
| 8828 | pTest - lttng-tools tests fail | Medium | Richard Purdie | yeoh ee peng | 4.99 | RESOLVED | FIXED | Regression (Used to work) | 2015-12-17 |
| 8833 | pTest - gdk-pixbuf tests fail | Medium | Jussi Kukkonen | Cristina Agurida | 2.1 | RESOLVED | FIXED | --- | 2015-12-17 |
| 8656 | ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3 | Medium | Aníbal Limón | Francisco Pedraza | 2.3 M1 | RESOLVED | FIXED | Regression (Used to work) | 2015-11-06 |
| 8832 | pTest - bash tests fail for 2.1_M1.rc1 | Medium | Changqing Li | 2.7 M2 | RESOLVED | WORKSFORME | --- | 2015-12-17 | |
| 8655 | ptest - two openssl ptests fail on 2.0.rc3 | Medium+ | Maxin B. John | Francisco Pedraza | 2.1 M3 | VERIFIED | FIXED | Regression (Used to work) | 2015-11-06 |
Current community Open Bugs - Medium+/High
Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones
| ID | P | Summary | Assignee | QA | Milestone | Status | cf_regression_type | Created |
|---|---|---|---|---|---|---|---|---|
| 0 | ||||||||
| Runtime Testing | ||||||||
| 8861 | Medium+ | System envs in /etc/profile are not injected in oeqa ssh connection | Ross Burton | Costin | 2.1 M3 | CLOSED | --- | 2015-12-24 |
| 1 | ||||||||
Bug Trend
An overview of this week's Yocto Bug Trend charts can be accessed on the following page
pTest results for genericx86-64 on NUC
Click table for details
Build Performance Test
Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.8 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.
Performance Charts
For Bitbake core-image-sato with rm_work
Building the Virtual kernel
Building the rootfs
Detailed Report
Distro Testing
Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Core Build System
Bitbake
Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Meta-Yocyo
Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
OE-Core
Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Hob
Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
BSP
genericx86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
genericx86_64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Beaglebone Black: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
EdgeRouter: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
MPC8315e-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
P1022ds-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Qemu
qemux86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemux86-64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuarm: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemumips: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuppc: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Toaster
Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Runtime Testing
Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Detailed result at: Build performance metrics
Build-appliance
Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora i686
Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Ubuntu x86-64
Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Eclipse Plugin
Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
