WW43 - 2014-10-18 - Full Pass - 1.7 M4.rc5

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:  Full Pass Release Test
 Branch: master
 Build name: 1.7_M4.rc5
 poky commit: 924da20c6f2f183fa7e930e4c3c6b14c090acbe5.tar
 Eclipse Plugin commit Kepler: 4a167fd662262ebdaa3cf0d332ac0debb52d7904
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-1.7.rc5/
 Distributions tested: Ubuntu 14.04 64bit, Fedora 20 64bit, Opensuse 13.1 64bit, CentOS 7 64 bit 

Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
3038 3040 ADT: master branchFedora 20 i686100.0%none0.0%none0.0%none100.0%
3037 3039 ADT: master branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
3065 Eclipse-Plugin: master branchUbuntu 14.04 x86_6493.9%5163 5769 6.1%4403 5285 5713 0.0%none100.0%
3067 3068 Meta-yocto: master branchUbuntu 14.04 x86_64100.0%6156 0.0%none0.0%none100.0%
3070 3073 Hob: master branchUbuntu 14.04 x86_6497.8%none0.0%none2.2%none100.0%
3066 Build-Appliance: master branchqemu-kvm on Ubuntu 12.04 libvirt100.0%none0.0%none0.0%none100.0%
3048 Toaster: master branchFedora 20 x86_6496.7%none3.3%6684 0.0%none100.0%
3069 Toaster: master branchUbuntu 14.04 LTS x86_6490.5%none9.5%5255 5266 5811 6685 6688 6832 6833 0.0%none100.0%
3049 3050 OE-Core: master branchUbuntu 14.04 x86_6496.6%none3.4%6804 0.0%none100.0%
3046 3047 BitBake: master branchUbuntu 14.04 x86_6491.9%none5.4%6752 2.7%none100.0%
3077 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 11
Test Case Status Report
StatusCount
BLOCKED2
FAILED10
PASSED481
Total: 493
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
4403LowRESOLVEDWONTFIX3065 stap fails on core-image-sato x86-641.4Future543
5163MediumRESOLVEDWORKSFORME3065 no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2)1.5Future402
5255MediumACCEPTED3069 Provide access to tasks executable output in ToasterunspecifiedFuture390
5266MediumRESOLVEDFIXED3069 quagga/ripd: two unexpected behavior after received SIGHUP signalunspecified1.5.1388
5285MediumCLOSEDOBSOLETE3065 powertop: Eclipse plugin output is useless for new versions of powertopunspecifiedFuture386
5713MediumCLOSEDOBSOLETE3065 systemtap displays blank pop-up error window1.5Future281
5769MediumCLOSEDOBSOLETE3065 Eclipse Plugin: ssh connection doesn't disconnect when qemu is restarted/shut down1.6Future262
5811LowACCEPTED3069 the variable history should collect and display the variable value for each modification sequence1.9Future249
6156MediumVERIFIEDNOTABUG3068 [crosstap] no trace message output on qemuarm1.62.2187
6684MediumVERIFIEDWONTFIX3048 The content of the license column shouldn't be 4.0k.1.71.7.143
6685MediumRESOLVEDWONTFIX3069 Elapsed_time value null for tasks with outcome=01.71.7.143
6688MediumVERIFIEDFIXED3069 Build image using managed mode - Toaster web interface tries to load from address http://0.0.0.0:80001.71.843
6752MediumRESOLVEDFIXED3047 bitbake-prserv-tool has issues when it comes to exporting the PR database1.71.825
6804MediumRESOLVEDFIXED3050 do_rootfs fails for btrfs image build1.71.812
6832MediumVERIFIEDDUPLICATE3069 disk_io value in database doesn't match sometime with the value in the task buildstats file1.71.8 M44 (Recent)
6833MediumRESOLVEDFIXED3069 elapsed_time value in database doesn't match sometime the value in the task stats file1.71.7.14 (Recent)
Total: 16

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.7 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.

  • As a status, building the rootfs remained the same as rc4, with 4:16 minutes against 4:40 (1.6 release) on Ubuntu 12.04 and 4:14 against 4:36(1.6 release) on Fedora 19 so overall we have an improvement on building the rootfs.
  • Comparing the build time for the kernel we can see that it takes 12:16 minutes (1.7_M4.rc5) against 12:03 (1.6 release) on Ubuntu 12 and 11:18 minutes (1.7_M4.rc5) against 10:53 (1.6 release) on Fedora. This shows the building the kernel takes a little longer, but this is mainly because of the kernel upgrade which took a lot long to build on 1.7_M1.
  • Also, for building a sato image with rm_work shows an improvement trend with 1:08:36 hours (1.7_M4.rc5) against 1:11:32(1.6 release) on Ubuntu 12 and 1:10:32 hours (1.7_M4.rc5) against 1:15:56(1.6 release) on Fedora 19. This is the best performance we had starting 1.6.

Overall there are improvements against beginning of 1.7, but also no degradations against the last release candidate, 1.7_M4.rc5, which can be seen in the charts below.

Performance Charts

For Bitbake core-image-sato with rm_work

Ww43 - rmwork.png

Building the Virtual kernel

Ww43 - kernel.png

Building the rootfs

Ww43 - rootfs.png

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.

Summary

At this point all buildsets are fine.

Distro Results

BRANCH master
COMMIT Poky: 924da20c6f2f183fa7e930e4c3c6b14c090acbe5
RELEASE 1.7_M4.rc5
Ubuntu 14.04 LTS
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
Fedora 20
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
CentOS 7
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
OpenSuse 13.1
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS

Detailed Report

Core Build System

Bitbake

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Meta-Yocyo

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

OE-Core

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Hob

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

BSP

genericx86: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

genericx86_64: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Beaglebone Black: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

EdgeRouter: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

MPC8315e-rdb: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

P1022ds-rdb: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Qemu

qemux86: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemux86-64: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemuarm: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemumips: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemuppc: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Toaster

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Performance Testing

Status

Bugs

**No results**

Agenda

Detailed result at: Build performance metrics

Build-appliance

Status

Bugs

**No results**

Agenda

{{#if: 3038, 304030653037, 3039 |

ADT

ADT on: Fedora 20 i686

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda


ADT

ADT on: Ubuntu 14.04 x86-64

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Eclipse Plugin

Status

Bugs

Agenda

Personal tools