WW28 - 2014-07-09 - Full Pass Release Dora 1.5.3

From Yocto Project
(Difference between revisions)
Jump to: navigation, search
(Summary)
(Build Performance Test)
Line 68: Line 68:
 
== Performance Charts==
 
== Performance Charts==
  
On the build performance side, 1.5.3 [TODO].  
+
On the build performance side, 1.5.3 . The charts are available on this [https://wiki.yoctoproject.org/charts/charts_15/performance_test.html link] as well .  
  
  

Revision as of 00:22, 21 July 2014

Contents

Testing data

 Test type: Full Pass Release
 Branch: Dora
 Build name: 1.5.3
 poky commit: dc743744d8e3a9caef577aeab6b7f51bc08ded17
 Eclipse Plugin commit Kepler:  master:4a167fd662262ebdaa3cf0d332ac0debb52d7904
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.5.3.rc1/
 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit
 

Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
2655 2657 ADT: dora branchFedora 20 i68682.8%none1.7%6535 15.5%6536 6535 100.0%
2654 2656 ADT: dora branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
2661 2662 2663 Eclipse plugin: Dora branchFedora 20 x86_6496.4%none0.0%none3.6%5640 100.0%
2621 2622 2623 Eclipse plugin: Dora branchUbuntu 14.04 x86_64100.0%5473 5850 0.0%none0.0%none100.0%
2636 2637 Meta-yocto: dora branchUbuntu 14.04 x86_64100.0%6527 0.0%none0.0%none100.0%
2633 2634 Hob: dora branchUbuntu 14.04 x86_6493.5%none6.5%6008 5892 5995 0.0%none100.0%
2635 Build Appliance: dora branchqemu-kvm on Ubuntu 12.04 libvirt100.0%6525 0.0%none0.0%none100.0%
2626 2627 OE-Core: dora branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
2624 2625 Bitbake: dora branchUbuntu 14.04 x86_6495.5%none4.5%6528 0.0%none100.0%
2641 2645 BSP/QEMU: dora branchBeagleboard71.0%none4.3%5182 24.6%5182 100.0%
2628 2629 BSP/QEMU: dora branchgeneric-x86 on AtomPC97.1%none2.9%4005 5834 0.0%none100.0%
2619 2620 BSP/QEMU: dora branchgenericx86-64 on Sugarbay98.6%none1.4%5834 0.0%none100.0%
2650 2651 BSP/QEMU: dora branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
2646 2647 BSP/QEMU: dora branchP1022ds100.0%none0.0%none0.0%none100.0%
2630 2631 BSP/QEMU: dora branchqemu-x86100.0%none0.0%none0.0%none100.0%
2638 2639 BSP/QEMU: dora branchqemuarm100.0%none0.0%none0.0%none100.0%
2643 2644 BSP/QEMU: dora branchqemumips100.0%none0.0%none0.0%none100.0%
2640 2642 BSP/QEMU: dora branchqemuppc100.0%none0.0%none0.0%none100.0%
2652 2653 BSP/QEMU: dora branchqemux86-64100.0%none0.0%none0.0%none100.0%
2648 2649 BSP/QEMU: dora branchRouterstationpro100.0%none0.0%none0.0%none100.0%
2658 Runtime: dora branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 21
Test Case Status Report
StatusCount
BLOCKED36
FAILED12
PASSED985
Total: 1033
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
4005LowRESOLVEDNOTABUG2628 dmesg log errors in Atom-PC1.3.11.8 M4485
5182Medium+RESOLVEDWONTFIX2645 2641 [Beagleboard xM]X can not startup with 3.10 kernel1.51.5.1299
5473MediumRESOLVEDWONTFIX2621 [KEPLER] unable to create new bitbake commander project1.51.5.4246
5640MediumVERIFIEDFIXED2661 systemtap output is useless in Juno1.61.6215
5834MediumRESOLVEDWONTFIX2620 2629 Cannot wake from suspend state using the USB mouse or keyboard1.61.8 M2142
5850LowRESOLVEDWORKSFORME2622 Application name not listed in run configurations when installing the ADT using Bitbake1.6Future140
5892MediumRESOLVEDFIXED2634 Deploy image does not always write correctly to USB1.61.6 M4132
5995MediumRESOLVEDWORKSFORME2634 xinit:giving up on sato image1.61.6 M4113
6008MediumRESOLVEDFIXED2633 All layers can be removed1.4.31.4.3112
6525Medium+RESOLVEDFIXED2635 Wrong build-appliance image for 1.5.3 rc11.5.31.5.3NEW
6527MediumRESOLVEDFIXED2637 [1.5.3] yocto-bsp tool: Wrong tune file for qemuppc1.5.31.5.4NEW
6528LowRESOLVEDINVALID2624 Case 147 - Check if AUTOPR could be export/import for package build (pre 1.6)1.5.31.5.3NEW
6535Medium+VERIFIEDFIXED2657 2655 ADT installation failed for x86_64 with build 1.5.3 rc11.5.31.7NEW
6536MediumVERIFIEDFIXED2655 2657 autobuilder: for 1.5.3rc1 build, no x86-64 toolchain exists for i686 type host1.5.31.5.3NEW
Total: 14

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki.

Performance Charts

On the build performance side, 1.5.3 . The charts are available on this link as well .


For Bitbake core-image-sato with rm_work

Building the Virtual kernel

Building the rootfs


Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.

Summary

All tests are green on all distributions excepting nightly-world on OpenSuse 13.1 which is giving constant timeouts and on Ubuntu 14.04 which is failing at do_compile for gtk+. We are currently investigating the both issues.

Distro Results

     

BRANCH master
COMMIT Poky: dc743744d8e3a9caef577aeab6b7f51bc08ded17
RELEASE 1.5.3 RC1
Ubuntu 14.04 LTS
• nighlty-world FAIL
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
Fedora 20
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
CentOS 6.5
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
OpenSuse 13.1
• nighlty-world FAIL
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS

Detailed Report

Core Build System

Bitbake

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Meta-Yocyo

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

OE-Core

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Hob

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

BSP

genericx86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

genericx86_64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Beagleboard: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Routerstationpro: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

MPC8315e-rdb: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

P1022ds-rdb: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Qemu

qemux86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

qemux86-64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

qemuarm: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

qemumips: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

qemuppc: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Performance Testing

Status

Bugs

**No results**

Agenda

Detailed result at: Build performance metrics

Build-appliance

Status

Bugs

Agenda

ADT

ADT on: Fedora 20 i686

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda


ADT on: Ubuntu 14.04 x86-64

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Eclipse Plugin

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda
Personal tools