WW30 - 2016-07-21 - Full Test Cycle 2.2 M2.rc1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:  Full Test Cycle
 Branch: master
 Build name: 2.2_M2.rc1
 poky commit: 36feb38045b7a2af86ece147fec54b0db3bf491f 
 Autobuilder images repository:  http://autobuilder.yoctoproject.org/pub/releases/yocto-2.2_M2.rc1/ 
 Distributions tested: 
 -Ubuntu 15.10
 -Ubuntu 14 04 
 -Opensuse 13.2  
 -Debian 8 

Test Run Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
6169 eSDK: master branchuser-preference (any supported environment)0%none0%none0%none0%
6146 6147 ADT: master branchFedora 24 i68688.4%9285 9287 10024 9813 9048 11.6%10028 0.0%none100.0%
6144 6145 ADT: master branchUbuntu 16.04 x86_6489.3%9999 10024 9813 10.7%10028 0.0%none100.0%
6135 Eclipse-Plugin: master branchMars on Fedora 22 x86_6426.9%none34.6%10008 9362 7054 9838 5163 10022 9840 38.5%5163 5285 9840 10022 100.0%
6172 Meta-yocto: master branchUbuntu 14.04 x86_6479.2%none12.5%10027 10016 10026 8.3%10016 10026 100.0%
6173 Build-Appliance: master branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
6138 6139 Toaster: master branchDebian 4.3.0-0.bpo.1-amd6486.3%9839 13.8%9836 10042 9837 10037 9833 10043 0.0%none100.0%
6164 OE-Core: master branchDebian 8 x86_64100.0%none0.0%none0.0%none100.0%
6175 OE-Core: master branchOpenSuse 13.2 x86_64100.0%none0.0%none0.0%none100.0%
6136 OE-Core: master branchubuntu 14.04 GDC100.0%none0.0%none0.0%none100.0%
6165 OE-Core: master branchubuntu 15.10 GDC100.0%none0.0%none0.0%none100.0%
6182 BitBake: master branchDebian 4.3.5-1~bpo8+166.7%none33.3%10044 0.0%none100.0%
6158 6159 BSP/QEMU: master branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
6160 6161 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
6141 6178 BSP/QEMU: master branchgenericx86 - on MMAX32bit93.3%none6.7%9271 9462 9860 10045 9652 0.0%none100.0%
6166 BSP/QEMU: master branchgenericx86-64 on MMAX6496.3%none1.9%9204 1.9%none100.0%
6143 6179 BSP/QEMU: master branchgenericx86-64 on NUC86.2%9995 10041 5.3%9204 9267 9860 10041 10048 8.5%9204 10041 100.0%
6174 BSP/QEMU: master branchgenericx86-64-lsb on MMAX64100.0%none0.0%none0.0%none100.0%
6171 BSP/QEMU: master branchgenericx86-64-lsb on NUC98.1%none1.9%5351 0.0%none100.0%
6167 BSP/QEMU: master branchgenericx86-64-WIC on NUC98.1%none1.9%9267 0.0%none100.0%
6170 BSP/QEMU: master branchgenericx86-lsb on MMAX32bit100.0%none0.0%none0.0%none100.0%
6168 BSP/QEMU: master branchgenericx86-WIC on MMAX3298.1%none1.9%9271 0.0%none100.0%
6162 6163 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
6137 6180 BSP/QEMU: master branchqemu-x8698.4%none1.6%9996 0.0%none100.0%
6148 6149 BSP/QEMU: master branchqemuarm100.0%none0.0%none0.0%none100.0%
6150 6151 BSP/QEMU: master branchqemuarm64100.0%none0.0%none0.0%none100.0%
6152 6153 BSP/QEMU: master branchqemumips100.0%none0.0%none0.0%none100.0%
6154 6155 BSP/QEMU: master branchqemumips64100.0%none0.0%none0.0%none100.0%
6156 6157 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
6140 6181 BSP/QEMU: master branchqemux86-64100.0%none0.0%none0.0%none100.0%
6177 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 31


Bug Status


Test Case Status Report
StatusCount
BLOCKED21
FAILED67
PASSED2167
Total: 2255



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (22 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BitBake
10044bitbake can use alternate download methods than gitMedium+LibertadLibertad2.2RESOLVEDNOTABUG---2016-07-27
9999Random warning: Unrecognised command on FIFOUndecidedRoss BurtonYi Zhao---VERIFIEDFIXEDRegression (Used to work)2016-07-22
BSPs
10045Media player cannot be closed Minnow32MediumMaxin B. John 2.2 M3RESOLVEDFIXED---2016-07-27
10025Missing 'Connection Manager' icon for qemumips and qemumips64MediumJussi KukkonenYi Zhao2.4RESOLVEDWORKSFORMERegression (Used to work)2016-07-26
10048Graphics - ABAT-fatal IO error 11Medium+Alejandro Hernandez 2.2 M3VERIFIEDNOTABUG---2016-07-28
9996Testimage is failing due missing "__init__.py" fileMedium+Mariano LopezJose Perez C2.2 M3VERIFIEDFIXED---2016-07-21
Eclipse Plugin
10008[Test Case 25] connection to Target can not be carried outMediumJose Perez CHumberto Ibarra2.2 M3RESOLVEDNOTABUG---2016-07-22
10022[Test Case 145] New yocto project BB Commander does not accept any folderUndecidedTim OrlingLibertad---RESOLVEDWONTFIX---2016-07-25
Manual Testing
10028Fail to build sudoku-savant with toolchain SDKMediumRoss Burton 2.2 M3RESOLVEDFIXEDRegression (Used to work)2016-07-26
Matchbox
9828[Beaglebone] mouse doesn't work when system startupMedium+Plauchu EdwinYi Zhao2.2 M2VERIFIEDFIXEDRegression (Used to work)2016-06-27
Meta-yocto
10016Fail to build linux-yocto for custom qemumips64 bsp with yocto-bspMediumBruce AshfieldYi Zhao2.2 M3RESOLVEDFIXEDRegression (Used to work)2016-07-25
10026Kernel panic for custom qemux86-64 bsp with yocto-bspMedium+Alejandro HernandezYi Zhao2.2 M4RESOLVEDFIXEDRegression (Used to work)2016-07-26
OE-Core
9285Failed to build gobject-introspection for qemumips64 on i686 hostsMedium+Scott RifenbarkYi Zhao2.2 M4RESOLVEDFIXEDNew (Never tested)2016-03-17
9287Failed to build nativesdk-glibc for qemumips and qemumips64 on Fedora 23 i686Medium+Ross BurtonYi Zhao2.2 M4VERIFIEDFIXEDRegression (Used to work)2016-03-17
10027Fail to run 'bitbake linux-yocto -c menuconfig'Medium+Ross BurtonYi Zhao2.2 M3VERIFIEDFIXEDRegression (Used to work)2016-07-26
10041mediaplayer fails to play audio on skylake (xv problem)Medium+Jussi KukkonenJuan Ramos2.2 M4VERIFIEDFIXED---2016-07-27
10047Piglit isn't in images (removed from tools-testapps)Medium+Ross Burton 2.5 M4RESOLVEDWONTFIXRegression (Used to work)2016-07-28
Pseudo
10024Warning "Child process exit status 4: lock_held" when building imageHighRobert Yang 2.2 M4RESOLVEDFIXEDRegression (Used to work)2016-07-26
Sato
9995Network icon is not displayed properly on SATOMediumJussi KukkonenFrancisco Pedraza2.2RESOLVEDFIXEDRegression (Found by QA test)2016-07-21
Toaster
10037Custom image page details repeats layer informationLowBelen Barros PenaLibertad2.2 M4RESOLVEDFIXED---2016-07-27
10042When Importing new layers cant add dependenciesUndecidedToaster default assigneeLibertad---RESOLVEDDUPLICATE---2016-07-27
10043Provide help information icons on tables task, packages are missingUndecidedToaster default assigneeLibertad---RESOLVEDNOTABUG---2016-07-27


Other Bugs found during QA Test

IDSummary (18 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
5351genericx86 auth.err getty[615]: tcgetattr: Input/outputMediumJianxun ZhangJuan Ramos2.2RESOLVEDFIXED---2013-10-14
BSPs
9860LAN device doesn't retrieve connection after resume from suspend stateMedium+David RodriguezDavid Rodriguez2.2 M3VERIFIEDFIXED---2016-06-30
Eclipse Plugin
9838perf fails on eclipse, sending a weird command remotely to qemuMediumTim OrlingLibertad2.2RESOLVEDWONTFIX---2016-06-28
9840Bitbake Commander: populate button not working when creating new recipeMediumTim OrlingLibertad2.2RESOLVEDWONTFIX---2016-06-28
OE-Core
9362Failed to run and debug a project to qemux86 in EclipseMediumbrian averyValentin Hangan2.1.2RESOLVEDFIXED---2016-03-31
Toaster
9839The "clear search" button on the – "Add | Remove packages table" - does not clearLowUnassigned FutureNEW---2016-06-28
9833There can be a Task and Recipes table of 0 columns when deselecting them on the "Edit Columns" buttonMediumElliot SmithLibertad2.2 M3RESOLVEDFIXED---2016-06-27
9836Project builds table and Software Recipes: Sorting does not reset to default when hiding column that is currently being used as the sorting criteriaMediumElliot SmithLibertad2.2 M3RESOLVEDFIXED---2016-06-28
9837When trying to Download task log it returns Page not found (404)MediumElliot SmithLibertad2.2 M3RESOLVEDFIXED---2016-06-28
New (Never tested)
5163no external tools displayed when first trying to run QEMU - test case 48 failed on Ubuntu 12.04 x86-64 host(build 1.5 M4 rc2)MediumChin Huat Ang FutureRESOLVEDWORKSFORMENew (Never tested)2013-09-11
OE-Core
9048Failed to build iptables with extensible sdk on Fedora 23 i686MediumRobert YangYi Zhao2.2 M4VERIFIEDFIXEDNew (Never tested)2016-02-04
Regression (Found by QA test)
9267test_parselogs (oeqa.runtime.parselogs.ParseLogsTest) failed on NUC 6i5SYH, firmware load for i915/skl_guc_ver4.bin failedMediumCalifornia SullivanApoorv2.5RESOLVEDFIXEDRegression (Found by QA test)2016-03-15
BSPs
9271dmi firmware registration failed, ioremap error on 32 bit MinnowBoardMediumCalifornia SullivanJuan Ramos2.2RESOLVEDWONTFIXRegression (Found by QA test)2016-03-16
9462Boot and install from USB failed getting a xhci_hcd error after booting kernel panic is displayedMediumCalifornia SullivanJuan Ramos2.2RESOLVEDFIXEDRegression (Found by QA test)2016-04-13
Regression (Used to work)
7054Need remote profiler (sysprof or eclipse?)MediumUnassignedApoorvFutureACCEPTEDRegression (Used to work)2014-12-09
OE-Core
9813Strange kernel image for qemumips and qemumips64 in deploy directoryMediumHe ZheYi Zhao2.99IN PROGRESS DESIGNRegression (Used to work)2016-06-23
Runtime Testing
9204Cleanup should be made after testing smartMediumPlauchu EdwinFrancisco Pedraza2.2 M3RESOLVEDFIXEDRegression (Used to work)2016-03-03
Unknown (Hard to categorize)
5285powertop: Eclipse plugin output is useless for new versions of powertopMediumPaul Eggleton FutureRESOLVEDOBSOLETEUnknown (Hard to categorize)2013-09-27

pTest open bugs

IDSummary (9 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Runtime Testing
8146ptest - some test cases are failing for aclMediumAjay KumarRoss Burton2.2RESOLVEDDUPLICATE---2015-08-11
8471ptest - some valgrind ptests fail on 2.4 M1.rc1MediumMaxin B. John 2.99RESOLVEDDUPLICATERegression (Used to work)2015-10-09
8656ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3MediumAníbal LimónFrancisco Pedraza2.3 M1RESOLVEDFIXEDRegression (Used to work)2015-11-06
8828pTest - lttng-tools tests failMediumRichard Purdieyeoh ee peng2.99ACCEPTEDRegression (Used to work)2015-12-17
8831pTest - busybox tests fail for 2.1_M1.rc1Mediumdengke FutureRESOLVEDDUPLICATE---2015-12-17
8832pTest - bash tests fail for 2.1_M1.rc1MediumChangqing Li 2.7 M2RESOLVEDWORKSFORME---2015-12-17
8834pTest - attr test fail ln -s fMediumdengke 2.2 M3VERIFIEDFIXED---2015-12-17
9042pTest - strace fails on NUC 5425WYK for YP 2.1_M2.rc1MediumChangqing Li 2.7 M2RESOLVEDFIXEDRegression (Used to work)2016-02-03
8655ptest - two openssl ptests fail on 2.0.rc3Medium+Maxin B. JohnFrancisco Pedraza2.1 M3VERIFIEDFIXEDRegression (Used to work)2015-11-06

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.

Below chars are showing the latest performance results taken from current milestone

Performance Charts

Performance Charts

For Bitbake core-image-sato with rm_work

Ww30-2k16 - rmwork.png

Building the Virtual kernel

Ww30-2k16 - kernel.png

Building the rootfs

Ww30-2k16 - rootfs.png

pTest results for genericx86-64 on NUC

< Back
Ran on a NUC and compared with commit 6f0c5537e02c59e1c8f3b08f598dc049ff8ee098

Results
Package Name Tests ran Passed Failed Passrate Last Passrate Run difference
tcl (NUC) 148 148 0 100.0% 99.0%
Yes

Results for NUC ptest tcl 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

http.test

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 0

acl (NUC) 215 206 9 96.0% 96.0%
No

Results for NUC ptest acl 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 9

$ ls -l g | awk -- '{ print $1 $3 $4 }'
$ ls -dl d | awk '{print $1}'
$ getfacl --omit-header i/x
$ ls -dl f | awk '{print $1}'
$ ls -dl d/d | awk '{print $1}'
$ ls -dl -L d/l | awk '{print $1}'
$ ls -dl d/f | awk '{print $1}'
$ ls -l f | awk -- '{ print $1 }'
$ ls -dl g | awk '{print $1}'
busybox (NUC) 474 465 9 98.0% 98.0%
No

Results for NUC ptest busybox 2016-07-21:
********************************

Tests that failed now and worked last time: 1

hostname-d-works

Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 9

ls-s-works
cpio lists hardlinks
ls-l-works
sed n (flushes pattern space terminates early)
hostname-d-works
sed append autoinserts newline
sed embedded NUL
sed NUL in command
sed nonexistent label
bash (NUC) 76 72 4 95.0% 95.0%
No

Results for NUC ptest bash 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 4

run-vredir
run-intl
run-lastpipe
run-trap
gawk (NUC) 282 281 1 100.0% 100.0%
No
python (NUC) 14597 14554 43 100.0% 100.0%
No
dbus-test (NUC) 15 4 11 27.0% 27.0%
No

Results for NUC ptest dbus-test 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 11

test/test-bus-launch-helper
test/test-bus-system
test/test-refs
test/test-dbus-daemon
test/test-dbus-daemon-eavesdrop
test/test-relay
test/test-corrupt
test/test-bus
test/test-shell
test/test-loopback
test/test-dbus
pango (NUC) 12 12 0 100.0% 100.0%
No
util-linux (NUC) 19 19 0 100.0% 95.0%
Yes

Results for NUC ptest util-linux 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

paths

Tests that were skipped now and worked last time: 1

md5:

Tests that were skipped last time and worked now: 1

md5

Tests that failed now: 0

quilt (NUC) 55 55 0 100.0% 100.0%
No
gdk-pixbuf (NUC) 17 17 0 100.0% 100.0%
No
perl (NUC) 2263 2262 1 100.0% 100.0%
No
openssl (NUC) 50 50 0 100.0% 96.0%
Yes

Results for NUC ptest openssl 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 2

test_clienthello
test_sslv2conftest

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 0

bluez5 (NUC) 25 25 0 100.0% 100.0%
No
diffstat (NUC) 439 439 0 100.0% 100.0%
No
zlib (NUC) 2 2 0 100.0% 100.0%
No
libpcre (NUC) 3 3 0 100.0% 100.0%
No
attr (NUC) 108 108 0 100.0% 100.0%
No
libxml2 (NUC) 85 82 3 96.0% 96.0%
No

Results for NUC ptest libxml2 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 3

Error cases stream regression tests
Error cases regression tests
runtest
bzip2 (NUC) 6 6 0 100.0% 100.0%
No
lttng-tools (NUC) 14 0 14 0.0% 0.0% No
diffutils (NUC) 12 12 0 100.0% 100.0%
No
perl5 (NUC) 2263 2262 1 100.0% 100.0%
No
valgrind (NUC) 538 2 536 0.0% 0.0% No
nettle (NUC) 87 86 1 99.0% 99.0%
No

Results for NUC ptest nettle 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 1

dlopen-test
e2fsprogs (NUC) 1 0 1 0.0% 0.0% No
glib-2.0 (NUC) 281 274 7 98.0% 98.0%
No

Results for NUC ptest glib-2.0 2016-07-21:
********************************

Tests that failed now and worked last time: 1

glib/regex.test (Child process killed by signal 6)

Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 1

glib/regex.test

Tests that were skipped last time and worked now: 1

glib/regex.test (Child process killed by signal 6)

Tests that failed now: 7

wget-handles-empty-path
wget-supports--P
wget--O-overrides--P
wget-retrieves-google-index
glib/regex.test (Child process killed by signal 6)
unzip (subdir only)
unzip (bad archive)
openssh (NUC) 54 54 0 100.0% 100.0%
No
strace (NUC) 239 236 3 99.0% 99.0%
No

Results for NUC ptest strace 2016-07-21:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 3

vhangup.test
chown.test
strace-V.test
gdbm (NUC) 11 11 0 100.0% 100.0%
No

Detailed Report

Distro Testing

Core Build System

Bitbake

Status

Bugs

Agenda

Meta-Yocyo

Status

Bugs

Agenda

OE-Core

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

eSDK

Status

**No results**

Bugs

**No results**

Agenda

**No results**

BSP

genericx86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

genericx86_64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Beaglebone Black: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

EdgeRouter: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

MPC8315e-rdb: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda


Qemu

qemux86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

qemux86-64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

qemuarm: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda