WW43 - 2016-10-18 - Full Test Cycle 2.2 rc4

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:  Full Test Cycle
 Branch: master
 Build name: 2.2 rc4
 poky commit: 4b94b498e21aeba945fe7e72a6b7c4bb0314fb83
 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-2.2.rc4/
 Distributions tested: 
 -Ubuntu 16.04
 -Ubuntu 14 04 
 -OpenSuse 421
 -Opensuse 13.2  
 -Debian 8
 -Centos 7
 -Fedora 23
 -Fedora 24 

Test Run Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
6362 6363 eSDK: master branchFedora 230%none0%none0%none0%
6372 6373 ADT: master branchFedora 24 i68699.2%none0.8%10447 0.0%none100.0%
6370 6371 ADT: master branchUbuntu 14.04 x86_6499.2%none0.8%10447 0.0%none100.0%
6360 Eclipse-Plugin: master branchMars on Fedora 22 x86_64100.0%none0.0%none0.0%none100.0%
6361 Eclipse-Plugin: master branchNeon on Fedora 22 x86_64100.0%none0.0%none0.0%none100.0%
6375 Meta-yocto: master branchUbuntu 14.04 x86_64100.0%10477 0.0%none0.0%none100.0%
6374 Build-Appliance: master branchVMWare Player on Ubuntu75.0%none25.0%10434 0.0%none100.0%
6357 6364 Toaster: master branchDebian 4.3.0-0.bpo.1-amd6496.2%none3.8%10463 8126 10281 10492 0.0%none100.0%
6348 OE-Core: master branchCentOS 7.1 x86_64100.0%none0.0%none0.0%none100.0%
6349 OE-Core: master branchDebian 8 x86_64100.0%none0.0%none0.0%none100.0%
6350 OE-Core: master branchFedora 23 x86_64100.0%none0.0%none0.0%none100.0%
6351 OE-Core: master branchFedora 24 x86_64100.0%none0.0%none0.0%none100.0%
6352 OE-Core: master branchOpenSuse 13.2 x86_64100.0%none0.0%none0.0%none100.0%
6353 OE-Core: master branchOpenSuse421 x86_64100.0%none0.0%none0.0%none100.0%
6355 OE-Core: master branchubuntu 14.04 GDC100.0%none0.0%none0.0%none100.0%
6354 OE-Core: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
6356 BitBake: master branchDebian 4.3.5-1~bpo8+1100.0%none0.0%none0.0%none100.0%
6386 6387 BSP/QEMU: master branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
6388 6389 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
6358 6365 BSP/QEMU: master branchgenericx86 - on MMAX32bit98.9%none1.1%10455 0.0%none100.0%
6402 BSP/QEMU: master branchgenericx86-64 on MMAX6498.1%none1.9%10455 0.0%none100.0%
6367 6397 BSP/QEMU: master branchgenericx86-64 on NUC98.9%none1.1%10455 0.0%none100.0%
6399 BSP/QEMU: master branchgenericx86-64-lsb on MMAX6498.1%none1.9%10490 0.0%none100.0%
6400 BSP/QEMU: master branchgenericx86-64-lsb on NUC98.1%none1.9%10490 0.0%none100.0%
6403 BSP/QEMU: master branchgenericx86-64-WIC on MMAX6497.7%none2.3%10481 0.0%none100.0%
6401 BSP/QEMU: master branchgenericx86-64-WIC on NUC97.7%none2.3%10481 10494 0.0%none100.0%
6392 BSP/QEMU: master branchgenericx86-lsb on MMAX32bit100.0%none0.0%none0.0%none100.0%
6394 BSP/QEMU: master branchgenericx86-WIC on MMAX3297.7%none2.3%10481 0.0%none100.0%
6390 6391 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
6368 6396 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
6376 6377 BSP/QEMU: master branchqemuarm100.0%none0.0%none0.0%none100.0%
6378 6379 BSP/QEMU: master branchqemuarm64100.0%none0.0%none0.0%none100.0%
6380 6381 BSP/QEMU: master branchqemumips100.0%10025 0.0%none0.0%none100.0%
6382 6383 BSP/QEMU: master branchqemumips6498.4%none1.6%10456 0.0%none100.0%
6384 6385 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
6369 6393 BSP/QEMU: master branchqemux86-64100.0%none0.0%none0.0%none100.0%
6395 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 37


Bug Status


Test Case Status Report
StatusCount
FAILED15
PASSED2982
Total: 2997



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (10 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
10455[morty][Test Case 1059] Parselogs is failing on genericx86 (32 and 64 bits) giving error: blk_update_request: I/O error, dev loop0MediumCalifornia Sullivanyeoh ee peng2.5 M3RESOLVEDFIXED---2016-10-18
10456X can not launch on qemumips64Medium+Armin KusterYi Zhao2.2.2VERIFIEDFIXEDRegression (Used to work)2016-10-19
10481[Test Case 1059] Parselogs is failing on genericx86 (32 and 64 bits) WIC giving error: GPT: Use GNU Parted to correct GPT errors.MediumJair GonzalezJuan Ramos2.3 M1RESOLVEDFIXED---2016-10-21
10490Error on oeqa.runtime.rpm.RpmInstallRemoveTest when running testimageMedium+Jose Perez CJuan Ramos2.3 M2VERIFIEDNOTABUG---2016-10-24
10494[Test Case 1059] Parselogs is failing on genericx86-64-WIC on NUC giving error: Failed to load DMC firmwareMediumCalifornia Sullivan 2.2.2RESOLVEDFIXED---2016-10-24
eSDK
10447eSDK: runqemu fails unless unless DEPLOY_DIR_IMAGE is setMedium+Paul EggletonFrancisco Pedraza2.3 M4RESOLVEDFIXED---2016-10-17
Meta-yocto
10477yocto-bsp: tool should output a conf file to be consume by the qemu runnerMediumLeonardo Sandoval Gonzalez 2.5RESOLVEDOBSOLETE---2016-10-21
Runtime
10434runqemu can not launch qemu image in Build ApplianceMedium+Juro BystrickyYi Zhao2.3 M1VERIFIEDFIXEDRegression (Used to work)2016-10-14
Toaster
10463[Test Case 910] "Recipe file" column isn't sortableMediumMichael WoodLibertad2.3RESOLVEDNOTABUG---2016-10-19
10492[Test Case 1398] Build log cannot be downloadedMediumDavid ReynaDavid Lopez Barriba2.3 M1VERIFIEDINVALID---2016-10-24


High and M+ issues Found during QA Test (NOT NEW)

"None"


Other Bugs found during QA Test (NOT NEW)

IDSummary (3 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
10281Configuration variables: I can set a value for standard shell environment variable http_proxyLowToaster default assigneeyeoh ee pengFutureNEW---2016-09-14
Regression (Used to work)
10025Missing 'Connection Manager' icon for qemumips and qemumips64MediumJussi KukkonenYi Zhao2.4RESOLVEDWORKSFORMERegression (Used to work)2016-07-26
Toaster
8126Messages are missing when "IMAGE_FSTYPES" field is not properly editedMediumDavid ReynaDavid Lopez Barriba2.4 M4RESOLVEDFIXEDRegression (Used to work)2015-08-07

pTest open bugs

IDSummary (12 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
OE-Core
5695python: ptest cases failedMediumRoss Burton 2.6RESOLVEDFIXED---2013-12-31
5697busybox: ptest cases failedMediumChangqing Li 2.7 M2RESOLVEDFIXED---2013-12-31
Runtime Testing
8828pTest - lttng-tools tests failMediumRichard Purdieyeoh ee peng2.99ACCEPTEDRegression (Used to work)2015-12-17
9373ptest for perl hangMediumAníbal Limón 2.3 M1RESOLVEDDUPLICATE---2016-04-01
8146ptest - some test cases are failing for aclMediumAjay KumarRoss Burton2.2RESOLVEDDUPLICATE---2015-08-11
8471ptest - some valgrind ptests fail on 2.4 M1.rc1MediumMaxin B. John 2.99RESOLVEDDUPLICATERegression (Used to work)2015-10-09
8656ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3MediumAníbal LimónFrancisco Pedraza2.3 M1RESOLVEDFIXEDRegression (Used to work)2015-11-06
8831pTest - busybox tests fail for 2.1_M1.rc1Mediumdengke FutureRESOLVEDDUPLICATE---2015-12-17
8832pTest - bash tests fail for 2.1_M1.rc1MediumChangqing Li 2.7 M2RESOLVEDWORKSFORME---2015-12-17
9042pTest - strace fails on NUC 5425WYK for YP 2.1_M2.rc1MediumChangqing Li 2.7 M2RESOLVEDFIXEDRegression (Used to work)2016-02-03
9055pTest - acl (NUC) failed tested on NUC 5425WYK for YP 2.1_M2.rc1MediumRobert YangFrancisco Pedraza2.4RESOLVEDFIXEDRegression (Used to work)2016-02-04
9372Ptest for acl hang because of lack of two user bin and daemonMediumChen Qioscar lopez arandas2.4RESOLVEDFIXED---2016-04-01

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.

Below chars are showing the latest performance results taken from current milestone

Performance Charts

NOTE: Due bug 10285 performance results for "bitbake core-image-sato -c rootfs" measurements were failing on 2.2_M3.rc1, hence the numbers shown in the charts for that particular milestone are the ones reported on logs just before of the failure.

Performance Charts

For Bitbake core-image-sato with rm_work

Ww43-2k16 - rmwork.png

Building the Virtual kernel

Ww43-2k16 - kernel.png

Building the rootfs

Ww43-2k16 - rootfs.png

Building core-image-sato

Ww43-2k16 - sato.png

pTest results for genericx86-64 on NUC

< Back
Ran on a NUC and compared with commit 2679a347c576f5411fbe802d2f6201c94036ecb2

FULL LOG

Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 354 26 93.20% 96.00%
attr 143 143 0 100.00% 100.00%
bash 76 72 4 94.70% 95.00%
bluez5 25 25 0 100.00% 100.00%
busybox 487 480 7 98.60% 98.00%
bzip2 6 6 0 100.00% 100.00%
dbus-test 15 4 11 26.70% 27.00%
diffstat 440 440 0 100.00% 100.00%
diffutils 16 16 0 100.00% 100.00%
e2fsprogs 1 0 1 0.00% 0.00%
gawk 284 283 1 99.60% 100.00%
gdbm 22 22 0 100.00% 100.00%
gdk-pixbuf 17 17 0 100.00% 100.00%
glib-2.0 280 273 7 97.50% 98.00%
kbd 7 7 0 100.00%
libpcre 3 3 0 100.00% 100.00%
libxml2 85 82 3 96.50% 96.00%
lttng-tools 2467 2462 5 99.80% 99.00%
nettle 87 86 1 98.90% 99.00%
openssh 56 56 0 100.00% 100.00%
openssl 52 52 0 100.00% 100.00%
pango 12 12 0 100.00% 100.00%
perl 2263 2262 1 100.00% 100.00%
perl5 2263 2262 1 100.00% 100.00%
python 32056 31938 118 99.60% 100.00%
quilt 55 54 1 98.20% 100.00%
strace 264 263 1 99.60% 100.00%
tcl 148 148 0 100.00% 99.00%
util-linux 130 128 2 98.50% 100.00%
valgrind 538 2 536 0.40% 0.00%
zlib 2 2 0 100.00% 100.00%

Detailed Report

Distro Testing

Core Build System

Bitbake

Status

Bugs

**No results**

Agenda

Meta-Yocyo

Status

Bugs

Agenda

OE-Core

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

eSDK

Status

**No results**

Bugs

**No results**

Agenda

**No results**

BSP

genericx86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

genericx86_64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda