WW15 - 2016-03-28 - Full Pass 2.1 M3.rc2

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:  Full Pass Release Test
 Branch: master
 Build name: 2.1_M3.rc2
 poky commit: 21823cb466e79540567ad1a43ae6f93d850e4057
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1_M3.rc2
 Distributions tested: Ubuntu 15.10 x86_64, Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 23 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit 

Test Run Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
5645 5646 ADT: master branchFedora 23 i68698.6%9048 9370 1.4%9285 9286 9019 9287 9301 0.0%none100.0%
5643 5644 ADT: master branchUbuntu 14.04 x86_6499.3%9019 9370 0.7%9301 0.0%none100.0%
5609 Eclipse-Plugin: master branchLuna on Fedora 22 X86_6470.8%none29.2%7054 9362 0.0%none100.0%
5610 Eclipse-Plugin: master branchMars on Fedora 22 x86_6470.8%none29.2%9362 0.0%none100.0%
5662 5663 Meta-yocto: master branchUbuntu 14.04 x86_6496.9%6156 3.1%9120 0.0%none100.0%
5651 Build-Appliance: master branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
5606 5607 Toaster: master branchDebian 4.3.0-0.bpo.1-amd6489.0%none1.4%9358 9.6%8125 100.0%
5638 OE-Core: master branchCentOS 7.1 x86_6498.9%none1.1%9355 0.0%none100.0%
5637 OE-Core: master branchFedora 23 x86_6498.9%none1.1%9355 0.0%none100.0%
5636 OE-Core: master branchOpenSuse 13.2 x86_6498.9%none1.1%9355 0.0%none100.0%
5635 OE-Core: master branchUbuntu 15.10 x86_6498.9%none1.1%9355 0.0%none100.0%
5639 BitBake: master branchFedora 21 x86_64100.0%none0.0%none0.0%none100.0%
5659 5660 BSP/QEMU: master branchBeaglebone Black98.5%none1.5%9259 0.0%none100.0%
5647 5648 BSP/QEMU: master branchEdgeRouter98.3%none1.7%9259 0.0%none100.0%
5617 5618 5619 BSP/QEMU: master branchgenericx86 - on MMAX32bit97.1%none2.9%9392 9271 9354 0.0%none100.0%
5614 BSP/QEMU: master branchgenericx86-64 on MMAX6498.1%none1.9%9378 0.0%none100.0%
5612 5613 5616 BSP/QEMU: master branchgenericx86-64 on NUC98.6%none1.4%9354 9398 0.0%none100.0%
5652 BSP/QEMU: master branchgenericx86-64-WIC on MMAX64100.0%none0.0%none0.0%none100.0%
5661 BSP/QEMU: master branchgenericx86-64-WIC on NUC97.7%none2.3%8988 0.0%none100.0%
5664 BSP/QEMU: master branchgenericx86-WIC on MMAX3297.7%none2.3%9271 0.0%none100.0%
5649 5650 BSP/QEMU: master branchMPC8315e-rdb98.3%none1.7%9259 0.0%none100.0%
5657 5658 BSP/QEMU: master branchP1022ds98.2%none1.8%9259 0.0%none100.0%
5620 5621 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
5624 5625 BSP/QEMU: master branchqemuarm98.4%none1.6%9259 0.0%none100.0%
5655 5656 BSP/QEMU: master branchqemuarm6498.4%none1.6%9259 0.0%none100.0%
5626 5627 BSP/QEMU: master branchqemumips98.4%none1.6%9259 0.0%none100.0%
5653 5654 BSP/QEMU: master branchqemumips6498.5%none1.5%9259 0.0%none100.0%
5628 5629 BSP/QEMU: master branchqemuppc98.4%none1.6%9259 0.0%none100.0%
5622 5623 BSP/QEMU: master branchqemux86-64100.0%none0.0%none0.0%none100.0%
5634 Automated Build Testing: master branchCentOS 7 x86_6494.1%none5.9%9198 9374 0.0%none100.0%
5633 Automated Build Testing: master branchFedora 22 x86-6494.1%none5.9%9374 9198 0.0%none100.0%
5632 Automated Build Testing: master branchOpenSuse 13.2 x86_6494.1%none5.9%9198 9374 0.0%none100.0%
5631 Automated Build Testing: master branchUbuntu 15.04 x86_6494.1%none5.9%9198 9374 0.0%none100.0%
5630 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 34


Bug Status


Test Case Status Report
StatusCount
BLOCKED7
FAILED49
PASSED2333
Total: 2389



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (10 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Automated Runtime Testing
8988test_rpm_query_nonroot (oeqa.runtime.rpm.RpmInstallRemoveTest) - Failed to create new userMedium+Ross BurtonDavid Rodriguez2.2 M3VERIFIEDDUPLICATERegression (Used to work)2016-01-22
BSPs
9354pTest image does not boot after installHighRobert YangFrancisco Pedraza2.1 M4RESOLVEDFIXEDRegression (Used to work)2016-03-30
OE-Core
9048Failed to build iptables with extensible sdk on Fedora 23 i686MediumRobert YangYi Zhao2.2 M4VERIFIEDFIXEDNew (Never tested)2016-02-04
9362Failed to run and debug a project to qemux86 in EclipseMediumbrian averyValentin Hangan2.1.2RESOLVEDFIXED---2016-03-31
9019Failed to install sdk_ext if sdk_ext build with 'rm_work' featureMedium+Bill RandleYi Zhao2.1 M4VERIFIEDFIXEDRegression (Used to work)2016-02-01
9198webkitgtk compiler errorMedium+Alexander KanavinMihail Stanciu2.1 M4VERIFIEDNOTABUGRegression (Used to work)2016-03-02
9285Failed to build gobject-introspection for qemumips64 on i686 hostsMedium+Scott RifenbarkYi Zhao2.2 M4RESOLVEDFIXEDNew (Never tested)2016-03-17
9286Failed to build gst-player for qemuarm64 on Fedora23 i686Medium+Yi ZhaoYi Zhao2.2 M2VERIFIEDWONTFIXRegression (Used to work)2016-03-17
9287Failed to build nativesdk-glibc for qemumips and qemumips64 on Fedora 23 i686Medium+Ross BurtonYi Zhao2.2 M4VERIFIEDFIXEDRegression (Used to work)2016-03-17
9301Extensible SDK: failed to run sdk-update: checksum mismatch for uninativeMedium+Paul EggletonYi Zhao2.2 M1VERIFIEDFIXEDNew (Never tested)2016-03-18


Other Bugs found during QA Test

IDSummary (12 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
9355test_mkgummidisk & test_mkefidisk are failing on 21823cb466e79540567ad1a43ae6f93d850e4057UndecidedAlexandru GeorgescuDaniel Istrate---VERIFIEDFIXED---2016-03-30
Toaster
9358[Test Case 1402] Test bitbake variables - IMAGE_FSTYPESMediumElliot SmithLibertad2.2RESOLVEDDUPLICATE---2016-03-30
Regression (Found by QA test)
9378Running testimage test_cvs failed oeqa.runtime.buildcvs.BuildCvsTestUndecidedAlexandru Georgescu 2.1 M4RESOLVEDNOTABUGRegression (Found by QA test)2016-04-01
BSPs
9398When running testimage test_parselogs failed (oeqa.runtime.parselogs.ParseLogsTest) Volume was not properly unmounted. Some data may be corrupt.MediumSaul WoldFrancisco Pedraza2.1 M4RESOLVEDWORKSFORMERegression (Found by QA test)2016-04-05
9271dmi firmware registration failed, ioremap error on 32 bit MinnowBoardMediumCalifornia SullivanJuan Ramos2.2RESOLVEDWONTFIXRegression (Found by QA test)2016-03-16
Regression (Used to work)
6156[crosstap] no trace message output on qemuarmMediumTom Zanussi 2.2VERIFIEDNOTABUGRegression (Used to work)2014-04-14
OE-Core
7054Need remote profiler (sysprof or eclipse?)MediumMaxin B. JohnApoorv2.5ACCEPTEDRegression (Used to work)2014-12-09
9120The patch file is not applied to linux-yocto by yocto-kernel add patch commandMediumLeonardo Sandoval GonzalezYi Zhao2.2 M1VERIFIEDFIXEDRegression (Used to work)2016-02-16
9259The rpm database costs lots of disk space after install a packageMediumYi ZhaoYi Zhao2.4RESOLVEDFIXEDRegression (Used to work)2016-03-15
9370Fail to run devtool package in second timeUndecidedPaul EggletonYi Zhao---RESOLVEDFIXEDRegression (Used to work)2016-04-01
9374Missing intltool-native for epiphanyUndecidedJussi KukkonenMihail Stanciu2.1 M4RESOLVEDFIXEDRegression (Used to work)2016-04-01
Toaster
8125Filter does not work as expected after clearing the search resultsMediumMichael WoodCristina Agurida2.2RESOLVEDDUPLICATERegression (Used to work)2015-08-07

pTest open bugs

pTest execution blocked by bug 9354


Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      
Automated Runtime Testing
8861Medium+System envs in /etc/profile are not injected in oeqa ssh connectionRoss BurtonCostin2.1 M3CLOSED---2015-12-24
  1      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.8 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.


Performance Charts

For Bitbake core-image-sato with rm_work

Ww15-2k16 - rmwork.JPG

Building the Virtual kernel

Ww15-2k16 - kernel.JPG

Building the rootfs

Ww15-2k16 - rootfs.JPG

pTest results for genericx86-64 on NUC

pTest run was blocked due to the 9354 issue.


Detailed Report

Distro Testing

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Core Build System

Bitbake

Status

Bugs

**No results**

Agenda

Meta-Yocyo

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

OE-Core

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

BSP

genericx86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

genericx86_64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Beaglebone Black: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

EdgeRouter: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

MPC8315e-rdb: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

P1022ds-rdb: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda


Qemu

qemux86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

qemux86-64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

qemuarm: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda