WW06 - 2015-02-03 - Full Pass 1.8 M2.rc2

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:  Full Pass Release Test
 Branch: master
 Build name: 1.8_M2.rc2
 poky commit: 22c38e2d8a058619e3d05534b5e830b750aa4241 
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20150202-1/
 Distributions tested: Ubuntu 14.04 64bit, Fedora 21 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit 

Test Run Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
3440 3441 ADT: master branchFedora 21 i686100.0%7227 0.0%none0.0%none100.0%
3438 3439 ADT: master branchUbuntu 14.04 x86_6499.1%7290 0.9%7289 0.0%none100.0%
3461 Eclipse-Plugin: master branchUbuntu 14.10 x86_6497.0%5285 5769 3.0%7054 0.0%none100.0%
3444 3445 Meta-yocto: master branchUbuntu 14.04 x86_64100.0%6156 0.0%none0.0%none100.0%
3433 3434 Hob: master branchUbuntu 14.10 x86_6497.8%none0.0%none2.2%none100.0%
3448 Build-Appliance: master branchqemu-kvm on Ubuntu 12.04 libvirt100.0%7288 7300 0.0%none0.0%none100.0%
3452 3453 Toaster: master branchUbuntu 14.04 LTS x86_6485.0%7023 7025 15.0%7004 7026 7052 7060 7198 0.0%none100.0%
3435 3468 Toaster: master branchUbuntu 14.10 x86_6485.9%none12.5%5255 6832 7200 7201 7005 7283 7284 7285 1.6%none100.0%
3472 3473 OE-Core: master branchUbuntu 14.10 x86_6496.6%none3.4%6804 0.0%none100.0%
3466 3467 BitBake: master branchUbuntu 14.10 x86_6497.3%none0.0%none2.7%none100.0%
3437 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 11


Bug Status


Test Case Status Report
StatusCount
BLOCKED3
FAILED17
PASSED505
Total: 525



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (5 tasks) PAssigneeQAMilestoneStatuscf_regression_typeCreated
ADT
7289Fail to build iptables with mips toolchain sdkMedium+Randy WittAlexandru Georgescu1.8 M3VERIFIEDRegression (Used to work)2015-02-05
7290A warning message when installing toolchain sdk if using dashMedium+Saul WoldAlexandru Georgescu1.8 M3VERIFIEDNew (Never tested)2015-02-05
Runtime
7300many selectable packages are missing when try to build image in build appliance(build 20150202-1)UndecidedCristian Iorga 1.8 M4RESOLVEDRegression (Used to work)2015-02-09
Toaster
7285Toaster managed mode: toaster fails to start a build with meta-selftest added as a new local layerHighAlexandru DamianMihail Stanciu1.8 M3VERIFIEDNew (Never tested)2015-02-04
7283Toaster fails to start in managed mode due to tracebackHighAlexandru DamianMihail Stanciu1.8 M3VERIFIEDRegression (Used to work)2015-02-04


Other Bugs found during QA Test (including regressions)

IDSummary (22 tasks) PAssigneeQAMilestoneStatuscf_regression_typeCreated
---
5589gst-plugins-* main package itself is uselessMedium+Cristian IorgaJuan Ramos1.8 M3RESOLVED---2013-11-22
New (Never tested)
7025View all targets: graphical overlap in tableMediumBelen Barros PenaMihail Stanciu1.9 M3VERIFIEDNew (Never tested)2014-12-03
Toaster
7004Toaster UI - wrong ETA displayed for current running buildMediumAlexandru DamianAlexandru Roman1.8 M4VERIFIEDNew (Never tested)2014-12-02
7026All layers page: Sorting does not workMediumMichael WoodCristina Agurida1.9 M1VERIFIEDNew (Never tested)2014-12-03
7005Toaster UI - two or more projects having the same name can be createdMediumSujith HLibertad2.2 M1VERIFIEDNew (Never tested)2014-12-02
5255Provide access to tasks executable output in ToasterMediumToaster default assignee FutureACCEPTEDNew (Never tested)2013-09-23
7052Filters in the all layers page return only the information shown in the pageMediumMichael Wood 1.8 M3RESOLVEDNew (Never tested)2014-12-09
7023All layers page: column head misspelledMediumBelen Barros PenaAlexandru Roman1.8 M3VERIFIEDNew (Never tested)2014-12-03
6832disk_io value in database doesn't match sometime with the value in the task buildstats fileMediumAlexandru DamianAlexandru Roman1.8 M4VERIFIEDNew (Never tested)2014-10-14
7284Toaster managed mode: two or more variables having the same name can be added for the same projectMediumDavid ReynaAlexandru Roman1.8 M3VERIFIEDNew (Never tested)2015-02-04
7060Filters in "All targets" page not workingMediumMichael WoodMihail Stanciu1.8 M3RESOLVEDNew (Never tested)2014-12-11
Regression (Found by QA test)
6584dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMaxMediumJianxun ZhangCristina Agurida2.1RESOLVEDRegression (Found by QA test)2014-07-28
OE-Core
6665[Beaglebone] Xserver segmentation fault when reboot the systemMediumRoss Burton (Arm)Yi Zhao1.8 M3VERIFIEDRegression (Found by QA test)2014-08-28
Regression (Used to work)
7227Fail to build mesa for qemuppc on 32-bit hostMediumRoss Burton (Arm)Yi Zhao1.8RESOLVEDRegression (Used to work)2015-01-22
6156[crosstap] no trace message output on qemuarmMediumTom Zanussi 2.2VERIFIEDRegression (Used to work)2014-04-14
6804do_rootfs fails for btrfs image buildMediumSaul WoldCostin1.8RESOLVEDRegression (Used to work)2014-10-06
Runtime
7288(20150202-1)build appliance behave oddly when compiling qemuppc core-image-minimal in vmplayerMediumKe Zou 1.8 M3RESOLVEDRegression (Used to work)2015-02-05
System Startup
7236psplash: endian problemMediumJuro BystrickyYi Zhao2.1VERIFIEDRegression (Used to work)2015-01-23
Toaster
7198Hiding a sorted column does not revert to default sortingMediumMichael WoodLibertad2.2RESOLVEDRegression (Used to work)2015-01-20
7200cpu_usage value for some tasks doesn't match the value in the stats fileMediumAlexandru DamianAlexandru Roman1.8 M3VERIFIEDRegression (Used to work)2015-01-20
7201elapsed_time value in task table doesn't match sometime the value in the task stats fileMediumAlexandru DamianAlexandru Roman1.8 M3VERIFIEDRegression (Used to work)2015-01-20
Unknown (Hard to categorize)
6474genericx86 does not work on Emenlow hardwareMediumSaul WoldCristina Agurida1.9VERIFIEDUnknown (Hard to categorize)2014-06-23

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page


Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.8 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.

  • Building the Kernel remained fairly the same on both Ubuntu and Fedora hosts, since no major updates were performed between rc1 and rc2
  • The rootfs build time improved with few seconds, now having 4:19 on Ubuntu and 4:22 on Fedora.
  • Due to the latest libtool upstream changes, we have a spike in performance when building the core-image-sato with rm-work. The RC2 take with an average of 10 minutes longer. We have 1:19:37 against 1:18:11 hours on Ubuntu and 1:22:15 against 1:11:18 hours on Fedora. Some fixes have been made, with notable improvements in the latest master (1:13:52 on Ubuntu and 1:16:13 on Fedora).

Overall we can see small improvements in building the Kernel and rootfs but a notable degradation when building the image with rm-work.


Performance Charts

For Bitbake core-image-sato with rm_work

2k15ww06 - rmwork.png

Building the Virtual kernel

2k15ww06 - kernel.png

Building the rootfs

2k15ww06 - rootfs.png

Distro Testing

Distro Testing is intended to catch bugs that are distribution specific using the yocto-autobuilder. The tests are all run on identical hardware and with all OS-es updated. The distributions used will be Fedora, Ubuntu, CentOS, OpenSuse with their latest update. More details on the coverage for the Distro testing is available here at Distribution_Support#Distro_Testing wiki.

Summary

At this point all buildsets are fine excepting systemd that was observed when running nightly-qa-systemd buildest; see bug 7239 for details.

Distro Results

BRANCH master
COMMIT Poky:22c38e2d8a058619e3d05534b5e830b750aa4241
RELEASE 1.8_M2.rc2
Ubuntu 14.04 LTS
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
• nightly-x32 PASS
• nightly-rpm PASS
• poky-tiny PASS
• nightly-qa-extras PASS
• nightly-qa-targetbuilds PASS
• nightly-qa-logrotate PASS
• nightly-qa-skeleton PASS
Fedora 21
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
• nightly-x32 PASS
• nightly-rpm PASS
• poky-tiny PASS
• nightly-qa-extras PASS
• nightly-qa-targetbuilds PASS
• nightly-qa-logrotate PASS
• nightly-qa-skeleton PASS
CentOS 7
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
• nightly-x32 PASS
• nightly-rpm PASS
• poky-tiny PASS
• nightly-qa-extras PASS
• nightly-qa-targetbuilds PASS
• nightly-qa-logrotate PASS
• nightly-qa-skeleton PASS
OpenSuse 13.1
• nighlty-world PASS
• buildtools PASS
• nightly-arm PASS
• nightly-multilib PASS
• nightly-qa-systemd PASS
• nightly-x86 PASS
• nightly-x86-64 PASS
• nightly-x86-64-lsb PASS
• nightly-x32 PASS
• nightly-rpm PASS
• poky-tiny PASS
• nightly-qa-extras PASS
• nightly-qa-targetbuilds PASS
• nightly-qa-logrotate PASS
• nightly-qa-skeleton PASS

Detailed Report

Core Build System

Bitbake

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

Meta-Yocyo

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

OE-Core

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Hob

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

BSP

genericx86: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

genericx86_64: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Beaglebone Black: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

EdgeRouter: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

MPC8315e-rdb: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

P1022ds-rdb: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Qemu

qemux86: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemux86-64: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemuarm: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemumips: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

qemuppc: core-image-sato-sdk

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Toaster

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Performance Testing

Status

Bugs

**No results**

Agenda

Detailed result at: Build performance metrics

Build-appliance

Status

Bugs

Agenda

{{#if: 3440, 344134613438, 3439 |

ADT

ADT on: Fedora 20 i686

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda


ADT

ADT on: Ubuntu 14.04 x86-64

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Eclipse Plugin

Status

Bugs

Agenda

Personal tools