WW15 - 2016-03-28 - Full Pass 2.1 M3.rc2

From Yocto Project
Jump to navigationJump to search
{{#vardefine:adt_fedora_i686| 5645, 5646 }} {{#vardefine:adt_fedora_x86-64| }} {{#vardefine:adt_ubuntu_x86-64| 5643, 5644 }} {{#vardefine:beaglebone_black| 5659, 5660 }} {{#vardefine:edgerouter| 5647, 5648 }} {{#vardefine:genericx86| 5617, 5618, 5619, 5664 }} {{#vardefine:genericx86_64| 5614, 5612, 5613, 5616, 5652, 5661 }} {{#vardefine:mpc8315e-rdb| 5649, 5650 }} {{#vardefine:p1022ds-rdb| 5657, 5658 }} {{#vardefine:qemux86| 5620, 5621 }} {{#vardefine:qemuarm| 5624, 5625, 5655, 5656 }} {{#vardefine:qemumips| 5626, 5627, 5653, 5654 }} {{#vardefine:qemuppc| 5628, 5629 }} {{#vardefine:qemux86-64| 5622, 5623 }} {{#vardefine:eclipseplugin| 5609, 5610 }} {{#vardefine:meta-yocto| 5662, 5663 }} {{#vardefine:hob| }} {{#vardefine:toaster| 5606, 5607 }} {{#vardefine:oe-core| 5638, 5637, 5636, 5635 }} {{#vardefine:distro| 5634, 5633, 5632, 5631 }} {{#vardefine:bitbake| 5639 }} {{#vardefine:runtime| 5630 }} {{#vardefine:build-appliance| 5651 }}

Testing data

 Test type:  Full Pass Release Test
 Branch: master
 Build name: 2.1_M3.rc2
 poky commit: 21823cb466e79540567ad1a43ae6f93d850e4057
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1_M3.rc2
 Distributions tested: Ubuntu 15.10 x86_64, Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 23 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit 

Test Run Summary Report

{{#testopia: run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} report_id=concatstats}}


{{#testopia:

chart=bstatus report_id=bugs charttype=bar sortable=true nudechart=true chartpos=top

}}


{{#testopia:

run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} charttype=bar report_id=status}}



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (10 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
9354pTest image does not boot after installHighRobert YangFrancisco Pedraza2.1 M4RESOLVEDFIXEDRegression (Used to work)2016-03-30
OE-Core
9362Failed to run and debug a project to qemux86 in EclipseMediumbrian averyValentin Hangan2.1.2RESOLVEDFIXED---2016-03-31
9048Failed to build iptables with extensible sdk on Fedora 23 i686MediumRobert YangYi Zhao2.2 M4VERIFIEDFIXEDNew (Never tested)2016-02-04
9286Failed to build gst-player for qemuarm64 on Fedora23 i686Medium+Yi ZhaoYi Zhao2.2 M2VERIFIEDWONTFIXRegression (Used to work)2016-03-17
9285Failed to build gobject-introspection for qemumips64 on i686 hostsMedium+Scott RifenbarkYi Zhao2.2 M4RESOLVEDFIXEDNew (Never tested)2016-03-17
9198webkitgtk compiler errorMedium+Alexander KanavinMihail Stanciu2.1 M4VERIFIEDNOTABUGRegression (Used to work)2016-03-02
9301Extensible SDK: failed to run sdk-update: checksum mismatch for uninativeMedium+Paul EggletonYi Zhao2.2 M1VERIFIEDFIXEDNew (Never tested)2016-03-18
9019Failed to install sdk_ext if sdk_ext build with 'rm_work' featureMedium+Bill RandleYi Zhao2.1 M4VERIFIEDFIXEDRegression (Used to work)2016-02-01
9287Failed to build nativesdk-glibc for qemumips and qemumips64 on Fedora 23 i686Medium+Ross BurtonYi Zhao2.2 M4VERIFIEDFIXEDRegression (Used to work)2016-03-17
Runtime Testing
8988test_rpm_query_nonroot (oeqa.runtime.rpm.RpmInstallRemoveTest) - Failed to create new userMedium+Ross BurtonDavid Rodriguez2.2 M3VERIFIEDDUPLICATERegression (Used to work)2016-01-22


Other Bugs found during QA Test

IDSummary (10 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
9355test_mkgummidisk & test_mkefidisk are failing on 21823cb466e79540567ad1a43ae6f93d850e4057UndecidedAlexandru GeorgescuDaniel Istrate---VERIFIEDFIXED---2016-03-30
Toaster
9358[Test Case 1402] Test bitbake variables - IMAGE_FSTYPESMediumElliot SmithLibertad2.2RESOLVEDDUPLICATE---2016-03-30
Regression (Found by QA test)
9271dmi firmware registration failed, ioremap error on 32 bit MinnowBoardMediumCalifornia SullivanJuan Ramos2.2RESOLVEDWONTFIXRegression (Found by QA test)2016-03-16
Runtime Testing
9378Running testimage test_cvs failed oeqa.runtime.buildcvs.BuildCvsTestUndecidedAlexandru Georgescu 2.1 M4RESOLVEDNOTABUGRegression (Found by QA test)2016-04-01
Regression (Used to work)
6156[crosstap] no trace message output on qemuarmMediumTom Zanussi 2.2VERIFIEDNOTABUGRegression (Used to work)2014-04-14
OE-Core
9259The rpm database costs lots of disk space after install a packageMediumYi ZhaoYi Zhao2.4RESOLVEDFIXEDRegression (Used to work)2016-03-15
9120The patch file is not applied to linux-yocto by yocto-kernel add patch commandMediumLeonardo Sandoval GonzalezYi Zhao2.2 M1VERIFIEDFIXEDRegression (Used to work)2016-02-16
9374Missing intltool-native for epiphanyUndecidedJussi KukkonenMihail Stanciu2.1 M4RESOLVEDFIXEDRegression (Used to work)2016-04-01
9370Fail to run devtool package in second timeUndecidedPaul EggletonYi Zhao---RESOLVEDFIXEDRegression (Used to work)2016-04-01
Toaster
8125Filter does not work as expected after clearing the search resultsMediumMichael WoodCristina Agurida2.2RESOLVEDDUPLICATERegression (Used to work)2015-08-07

pTest open bugs

IDSummary (9 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Runtime Testing
8656ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3MediumAníbal LimónFrancisco Pedraza2.3 M1RESOLVEDFIXEDRegression (Used to work)2015-11-06
9042pTest - strace fails on NUC 5425WYK for YP 2.1_M2.rc1MediumChangqing Li 2.7 M2RESOLVEDFIXEDRegression (Used to work)2016-02-03
8834pTest - attr test fail ln -s fMediumdengke 2.2 M3VERIFIEDFIXED---2015-12-17
8471ptest - some valgrind ptests fail on 2.4 M1.rc1MediumMaxin B. John 4.99RESOLVEDDUPLICATERegression (Used to work)2015-10-09
8832pTest - bash tests fail for 2.1_M1.rc1MediumChangqing Li 2.7 M2RESOLVEDWORKSFORME---2015-12-17
8146ptest - some test cases are failing for aclMediumAjay KumarRoss Burton2.2RESOLVEDDUPLICATE---2015-08-11
8831pTest - busybox tests fail for 2.1_M1.rc1Mediumdengke FutureRESOLVEDDUPLICATE---2015-12-17
8828pTest - lttng-tools tests failMediumRichard Purdieyeoh ee peng4.99RESOLVEDFIXEDRegression (Used to work)2015-12-17
8655ptest - two openssl ptests fail on 2.0.rc3Medium+Maxin B. JohnFrancisco Pedraza2.1 M3VERIFIEDFIXEDRegression (Used to work)2015-11-06

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      
Runtime Testing
8861Medium+System envs in /etc/profile are not injected in oeqa ssh connectionRoss BurtonCostin2.1 M3CLOSED---2015-12-24
  1      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.8 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.


Performance Charts

For Bitbake core-image-sato with rm_work

Ww12-2k16 - rmwork.JPG

Building the Virtual kernel

Ww12-2k16 - kernel.JPG

Building the rootfs

Ww12-2k16 - rootfs.JPG

pTest results for genericx86-64 on NUC

pTest run was blocked due to the 9354 issue.


Detailed Report

Distro Testing

Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Core Build System

Bitbake

Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Meta-Yocyo

Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

OE-Core

Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Hob

Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

BSP

genericx86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

genericx86_64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Beaglebone Black: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

EdgeRouter: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

MPC8315e-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

P1022ds-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}


Qemu

qemux86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemux86-64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuarm: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemumips: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuppc: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Toaster

Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Runtime Testing

Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Detailed result at: Build performance metrics

Build-appliance

Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Eclipse Plugin

Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}