WW51 - 2014-12-07 - Full Pass - 1.8 M1.rc1
Testing data
Test type: Full Pass Release Test Branch: master Build name: 1.8_M1.rc1 poky commit: b813bdebb36501500e86fea5f7e15b4b15ea0902 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.8M1 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit
Summary Report
{{#testopia: | run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora20_i686}}, {{#var:adt_ubuntu_1404_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}} | report_id=concatstats}} | {{#testopia: | run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora20_i686}}, {{#var:adt_ubuntu_1404_x86-64}}, {{#var:eclipseplugin}} | charttype=pie3 | report_id=status}} |
{{#testopia: |run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora20_i686}}, {{#var:adt_ubuntu_1404_x86-64}}, {{#var:eclipseplugin}} |report_id=bugs |chart=bstatus |charttype=bar |sortable=true |chartpos=top}}
Bug Trend
An overview of this week's Yocto Bug Trend charts can be accessed on the following page
Build Performance Test
Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.
- The rootfs takes a little longer, with 4:20 against 4:16 minutes on ubuntu and 4:17 against 4:14 on Fedora.
- Building the Kernel takes less, with 12:11 against 12:16 on Ubuntu and 11:12 against 11:18 on Fedora.
- Building a core-image-sato with rm_work shows some degradation by taking 1:09:39 hours against 1:08:36 on Ubuntu and 1:13:02 hours against 1:10:32 on Fedora.
Overall we can see improvements in building the Kernel, the rootfs is stable but building the image takes more with an 1 minute average on Ubuntu and 2:30 minutes on Fedora, a normal consequence of the many changes between 1.7 release and 1.8_M1. Depending on the future changes in master, we might see improvements or degradations in this test.
Performance Charts
For Bitbake core-image-sato with rm_work
Building the Virtual kernel
Building the rootfs
Distro Testing
Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.
Summary
At this point all buildsets are fine.
Distro Results
BRANCH | master |
---|---|
COMMIT | Poky: b813bdebb36501500e86fea5f7e15b4b15ea0902 |
RELEASE | 1.8_M1.rc1 |
Ubuntu 14.10 | |
• nighlty-world | PASS |
• buildtools | PASS |
• nightly-arm | PASS |
• nightly-multilib | PASS |
• nightly-qa-systemd | PASS |
• nightly-x86 | PASS |
• nightly-x86-64 | PASS |
• nightly-x86-64-lsb | PASS |
Fedora 20 | |
• nighlty-world | PASS |
• buildtools | PASS |
• nightly-arm | PASS |
• nightly-multilib | PASS |
• nightly-qa-systemd | PASS |
• nightly-x86 | PASS |
• nightly-x86-64 | PASS |
• nightly-x86-64-lsb | PASS |
CentOS 7 | |
• nighlty-world | PASS |
• buildtools | PASS |
• nightly-arm | PASS |
• nightly-multilib | PASS |
• nightly-qa-systemd | PASS |
• nightly-x86 | PASS |
• nightly-x86-64 | PASS |
• nightly-x86-64-lsb | PASS |
OpenSuse 13.2 | |
• nighlty-world | PASS |
• buildtools | PASS |
• nightly-arm | PASS |
• nightly-multilib | PASS |
• nightly-qa-systemd | PASS |
• nightly-x86 | PASS |
• nightly-x86-64 | PASS |
• nightly-x86-64-lsb | PASS |
Detailed Report
Core Build System
Bitbake
Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Meta-Yocyo
Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
OE-Core
Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Hob
Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
BSP
Atom-pc: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:atom-pc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:atom-pc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:atom-pc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
genericx86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
genericx86_64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Beaglebone Black: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
EdgeRouter: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
MPC8315e-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
P1022ds-rdb: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Qemu
qemux86: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemux86-64: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuarm: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemumips: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
qemuppc: core-image-sato-sdk
Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Toaster
Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Performance Testing
Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Detailed result at: Build performance metrics
Build-appliance
Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
{{#if: {{#var:adt_fedora20_i686}}{{#var:adt_fedora17_x86-64}}{{#var:adt_ubuntu_1310_x86-64}}{{#var:adt_opensuse_122_x86-64}}{{#var:adt_opensuse_123_x86-64}}{{#var:eclipseplugin}}{{#var:adt_fedora18_i686}}{{#var:adt_fedora19_i686}}{{#var:adt_ubuntu_1210_x86-64}}{{#var:adt_ubuntu_1404_x86-64}} |
ADT
ADT on: Fedora 20 i686
Status {{#testopia: |run_id={{#var:adt_fedora20_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora20_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora20_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT
ADT on: Fedora 20 i686
Status {{#testopia: |run_id={{#var:adt_fedora20_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora20_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora20_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora 17 x86-64
Status {{#testopia: |run_id={{#var:adt_fedora17_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora17_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora17_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora 17 x86-64
Status {{#testopia: |run_id={{#var:adt_fedora19_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora19_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora19_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora 18 i686
Status {{#testopia: |run_id={{#var:adt_fedora18_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora18_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora18_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Fedora 19 i686
Status {{#testopia: |run_id={{#var:adt_fedora19_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_fedora19_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_fedora19_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Ubuntu 12.04 x86-64
Status {{#testopia: |run_id={{#var:adt_ubuntu_1310_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_ubuntu_1310_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_ubuntu_1310_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Ubuntu 12.10 x86-64
Status {{#testopia: |run_id={{#var:adt_ubuntu_1210_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_ubuntu_1210_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_ubuntu_1210_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: Ubuntu 14.04 x86-64
Status {{#testopia: |run_id={{#var:adt_ubuntu_1404_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_ubuntu_1404_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_ubuntu_1404_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: OpenSUSE 12.2 x86-64
Status {{#testopia: |run_id={{#var:adt_opensuse_122_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_opensuse_122_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_opensuse_122_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
ADT on: OpenSUSE 12.3 x86-64
Status {{#testopia: |run_id={{#var:adt_opensuse_123_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:adt_opensuse_123_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:adt_opensuse_123_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}
Eclipse Plugin
Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}
Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}
Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}