WW28 - 2014-07-09 - Full Pass Release Dora 1.5.3

From Yocto Project
Jump to navigationJump to search
{{#vardefine:bitbake| 2624, 2625 }} {{#vardefine:meta-yocto| 2636, 2637 }} {{#vardefine:oe-core| 2626, 2627 }} {{#vardefine:hob| 2633, 2634 }} {{#vardefine:atom-pc| }} {{#vardefine:genericx86| 2628, 2629 }} {{#vardefine:genericx86_64| 2619, 2620 }} {{#vardefine:beagleboard| 2641, 2645 }} {{#vardefine:routerstationpro| 2648, 2649 }} {{#vardefine:mpc8315e-rdb| 2650, 2651 }} {{#vardefine:p1022ds-rdb| 2646, 2647 }} {{#vardefine:qemux86| 2630, 2631 }} {{#vardefine:qemux86-64| 2652, 2653 }} {{#vardefine:qemuarm| 2638, 2639 }} {{#vardefine:qemumips| 2643, 2644 }} {{#vardefine:qemuppc| 2640, 2642 }} {{#vardefine:runtime| 2658 }} {{#vardefine:build-appliance| 2635 }} {{#vardefine:adt_fedora17_i686| }} {{#vardefine:adt_fedora20_i686| 2655, 2657 }} {{#vardefine:adt_fedora17_x86-64| }} {{#vardefine:adt_fedora19_x86-64| }} {{#vardefine:adt_ubuntu_1204_x86-64| }} {{#vardefine:adt_opensuse_122_x86-64| }} {{#vardefine:adt_opensuse_123_x86-64| }} {{#vardefine:eclipseplugin| 2621, 2622, 2623, 2661, 2662, 2663 }} {{#vardefine:adt_ubuntu_1210_x86-64| }} {{#vardefine:adt_fedora18_i686| }} {{#vardefine:adt_ubuntu_1404_x86-64| 2654, 2656 }} {{#vardefine:adt_ubuntu_1310_x86-64| }}

Testing data

 Test type: Full Pass Release
 Branch: Dora
 Build name: 1.5.3
 poky commit: dc743744d8e3a9caef577aeab6b7f51bc08ded17
 Eclipse Plugin commit Kepler:  master:4a167fd662262ebdaa3cf0d332ac0debb52d7904
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.5.3.rc1/
 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit

Summary Report

{{#testopia: run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beagleboard}}, {{#var:routerstationpro}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora20_i686}}, {{#var:adt_ubuntu_1404_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}} report_id=concatstats}} {{#testopia: run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beagleboard}}, {{#var:routerstationpro}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora20_i686}}, {{#var:adt_ubuntu_1404_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}} charttype=pie3 report_id=status}}

{{#testopia: |run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beagleboard}}, {{#var:routerstationpro}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora20_i686}}, {{#var:adt_ubuntu_1404_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}} |report_id=bugs |chart=bstatus |charttype=bar |sortable=true |chartpos=top}}

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki.

Performance Charts

On the build performance side, 1.5.3 overall the build time increased. Building the rootfs increased with about 1:30 minutes on Ubuntu host (from 4:50 to 6:21 on average) and about 50 seconds on Fedora host (from 4:03 to 4:56 on average). Baking a sato image with rm_work increased with about 2 minutes (from 1:09:07 hours to 1:11:) and 20 seconds (from 1:13:56 to 1:14:16). The kernel remained on average the same (14:25 minutes on Ubuntu and 12:26 minutes on Fedora).

Below you can see some snapshots of the charts, but you can view more details on this link.


For Bitbake core-image-sato with rm_work

Yocto 153 - build core-image-sato with rm work.png


Building the Virtual kernel

Yocto 153 - bitbake virtual kernel.png

Building the rootfs

Yocto 153 - creating rootfs for core-image-sato.png

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.

Summary

All tests are green on all distributions excepting nightly-world on OpenSuse 13.1 which is giving constant timeouts and on Ubuntu 14.04 which is failing at do_compile for gtk+. We are currently investigating the both issues.

Distro Results

     

BRANCH master
COMMIT Poky: dc743744d8e3a9caef577aeab6b7f51bc08ded17
RELEASE 1.5.3 RC1
Ubuntu 14.04 LTS
• nighlty-world FAIL
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
Fedora 20
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
CentOS 6.5
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
OpenSuse 13.1
• nighlty-world FAIL
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS

Detailed Report

Core Build System

Bitbake

Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Meta-Yocyo

Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

OE-Core

Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Hob

Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

BSP

Atom-pc: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:atom-pc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:atom-pc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:atom-pc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

genericx86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

genericx86_64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Beagleboard: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:beagleboard}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:beagleboard}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:beagleboard}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Routerstationpro: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:routerstationpro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:routerstationpro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:routerstationpro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

MPC8315e-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

P1022ds-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Qemu

qemux86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemux86-64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuarm: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemumips: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuppc: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Performance Testing

Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Detailed result at: Build performance metrics

Build-appliance

Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT

ADT on: Fedora 17 i686

Status {{#testopia: |run_id={{#var:adt_fedora17_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora17_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora17_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora 17 x86-64

Status {{#testopia: |run_id={{#var:adt_fedora17_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora17_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora17_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu 12.10 x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_1310_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_1310_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_1310_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora 17 x86-64

Status {{#testopia: |run_id={{#var:adt_fedora19_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora19_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora19_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora 18 i686

Status {{#testopia: |run_id={{#var:adt_fedora18_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora18_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora18_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora 20 i686

Status {{#testopia: |run_id={{#var:adt_fedora20_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora20_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora20_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu 12.04 x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_1204_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_1204_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_1204_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu 12.10 x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_1210_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_1210_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_1210_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu 14.04 x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_1404_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_1404_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_1404_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: OpenSUSE 12.2 x86-64

Status {{#testopia: |run_id={{#var:adt_opensuse_122_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_opensuse_122_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_opensuse_122_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: OpenSUSE 12.3 x86-64

Status {{#testopia: |run_id={{#var:adt_opensuse_123_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_opensuse_123_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_opensuse_123_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Eclipse Plugin

Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=WW28_-_2014-07-09_-_Full_Pass_Release_Dora_1.5.3&oldid=13206"