1.7 QA Status TEMPLATE

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:  Full Pass Release Test
 Branch: master
 Build name: 1.7_M1.rc1
 poky commit: 68824d9b8f6e290da078383316b3f4b732585f2b
 Eclipse Plugin commit Kepler:  4a167fd662262ebdaa3cf0d332ac0debb52d7904
 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7_M1.rc1
 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 6.5 64 bit 

Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
2553 2555 ADT: master branchFedora 20 i68694.0%none6.0%6490 0.0%none100.0%
2552 2554 ADT: master branchUbuntu 14.04 x86_6494.0%none6.0%6490 0.0%none100.0%
2561 Eclipse-Plugin: master branchFedora 20 x86_64100.0%5760 6500 0.0%none0.0%none100.0%
2536 2540 Meta-yocto: master branchUbuntu 14.04 x86_6492.0%6162 8.0%6156 6482 0.0%none100.0%
2496 Hob: master branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
2533 Build-Appliance: master branchqemu-kvm on Ubuntu 12.04 libvirt66.7%none33.3%6495 0.0%none100.0%
2506 Toaster: master branchFedora 20 x86_6489.2%none10.8%5187 5226 5844 6445 0.0%none100.0%
2542 Toaster: master branchUbuntu 12.04 x86_64100.0%none0.0%none0.0%none100.0%
2510 2511 OE-Core: master branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
2508 2509 BitBake: master branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
2564 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
2557 Runtime: master branchqemuarm40.0%none60.0%6015 6016 6498 0.0%none100.0%
2558 Runtime: master branchqemuppc60.0%none40.0%6121 6498 0.0%none100.0%
Total: 13
Test Case Status Report
StatusCount
FAILED27
PASSED439
Total: 466
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
5187MediumVERIFIEDWORKSFORME2506 same cooker log file name used for several buildsunspecified1.9285
5226LowVERIFIEDOBSOLETE2506 in 'variables' API, the 'changed' field seems to return always 'FALSE'1.51.9280
5760LowRESOLVEDWORKSFORME2561 headless build takes took long1.6Future149
5844MediumVERIFIEDFIXED2506 Wrong script_type when task is not executed.unspecified1.9 M4127
6015MediumRESOLVEDFIXED2557 Lttng does not work on qemuarm due to lttng-tracer module not found1.61.797
6016MediumRESOLVEDDUPLICATE2557 CrossTap has issues on running scheduler script against qemuppc1.62.3 M497
6121Medium+VERIFIEDFIXED2558 powertop --calibrate does not work on QemuPPC1.61.7.182
6156MediumVERIFIEDNOTABUG2540 [crosstap] no trace message output on qemuarm1.62.272
6162MediumRESOLVEDFIXED2540 linux-yocto failed to do_patch after add a patch by yocto-kernel tool1.62.1 M471
6445MediumVERIFIEDNOTABUG2506 The value of the revision field from Package table doesn't start with 'r'1.6.11.6.212
6482MediumRESOLVEDFIXED2540 yocto-bsp tool: Wrong tune files for qemux86-64 and qemuppc1.71.7NEW
6490Medium+VERIFIEDFIXED2552 2553 2554 2555 [ADT-INSTALLER] build yocto-1.7_M1.rc1: ADT ppc cross compilation error1.71.7 M1NEW
6495Medium+VERIFIEDFIXED2533 [Build Appliance] qemu-native: do configure failed1.71.7 M1NEW
6498LowRESOLVEDWONTFIX2557 2558 Latencytop -d does not work for qemuppc and qemuarm1.7FutureNEW
6500MediumRESOLVEDWORKSFORME2561 no permissions when first deploying an app to QEMU and running it1.71.7NEW
Total: 15


Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki.

Performance Charts

On the build performance side, 1.7_M1.rc1 is doing fairy well agasint 1.6 release. We have an increase of 20 seconds on building with the rootfs for a core-image-sato. Also, building the actual image with rm_work set improved with an 1:30 minutes on average. The kernel build time decreased a little bit for about 1 minute.

For Bitbake core-image-sato

1.7 M1.rc1 - bbsato.png

Building the Virtual kernel

1.7 M1.rc1 - kernel.png

Building the rootfs

1.7 M2.rc1 - rootfs.png

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.

Summary

Fedora 20 and Cent OS are all green. As well for Ubuntu with a fail on nightly-world bug #6467. Since 1.7_M1.rc1 overlapped with 1.6.1 the distro results on OpenSuse are still running.

Distro Results

     

BRANCH daisy
COMMIT Poky: 68824d9b8f6e290da078383316b3f4b732585f2b
RELEASE 1.7 RC1
Ubuntu 14.04 LTS
• nighlty-world FAIL – 6467
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
Fedora 20
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
CentOS 6.5
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
OpenSuse 13.1
• nighlty-world
• buildtools PASS
• nightly-arm
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86
• nightly-x86-64
• nightly-x86-64-lsb

Detailed Report

Core Build System

Bitbake

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Meta-Yocyo

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

OE-Core

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Hob

Status

Bugs

**No results**

Agenda

BSP

genericx86: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

genericx86_64: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Beaglebone Black: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

EdgeRouter: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

MPC8315e-rdb: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

P1022ds-rdb: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Qemu

qemuarm: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemumips: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemuppc: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Toaster

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Performance Testing

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Detailed result at: Build performance metrics

Build-appliance

Status

Bugs

Agenda

ADT

ADT on: Fedora 20 i686

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda




ADT on: Ubuntu 14.04 x86-64

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Eclipse Plugin

Status

Bugs

Agenda

Personal tools