WW32 - 2016-08-01 - Test Cycle 2.1.1 rc2

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:  Point Release Test Cycle
 Branch: krogoth
 Build name: 2.1.1 RC2
 poky commit:  f5da2a5913319ad6ac2141438ba1aa17576326ab
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1.1.rc2
 Distributions tested: 
 * Debian 8 64bit
 * Ubuntu 15.10 x86_64
 * Ubuntu 14.04 64bit
 * Fedora 22 64bit
 * Opensuse 13.2 64bit

Test Run Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
6186 6187 ADT: krogoth branchFedora 24 i68699.2%9048 0.8%9285 9287 0.0%none100.0%
6184 6185 ADT: krogoth branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
6224 Meta-yocto: krogoth branchUbuntu 14.04 x86_6495.8%none4.2%9120 0.0%none100.0%
6188 Build-Appliance: krogoth branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
6218 Toaster: krogoth branchDebian 4.3.0-0.bpo.1-amd64100.0%none0.0%none0.0%none100.0%
6205 OE-Core:krogoth branchDebian 8 x86_64100.0%none0.0%none0.0%none100.0%
6206 OE-Core:krogoth branchFedora 22 x86_64100.0%none0.0%none0.0%none100.0%
6208 OE-Core:krogoth branchOpenSuse 13.2 x86_64100.0%none0.0%none0.0%none100.0%
6207 OE-Core:krogoth branchubuntu 14.04 GDC100.0%none0.0%none0.0%none100.0%
6209 OE-Core:krogoth branchUbuntu 15.10 x86_64100.0%none0.0%none0.0%none100.0%
6217 BitBake: krogoth branchDebian 4.3.5-1~bpo8+1100.0%none0.0%none0.0%none100.0%
6199 6200 BSP/QEMU: krogoth branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
6201 6202 BSP/QEMU: krogoth branchEdgeRouter100.0%none0.0%none0.0%none100.0%
6183 6215 BSP/QEMU: krogoth branchgenericx86 - on MMAX32bit95.5%none4.5%9462 9860 10048 9271 0.0%none100.0%
6222 BSP/QEMU: krogoth branchgenericx86-64 on MMAX64100.0%none0.0%none0.0%none100.0%
6210 6216 BSP/QEMU: krogoth branchgenericx86-64 on NUC96.8%none3.2%9860 8988 9267 0.0%none100.0%
6219 BSP/QEMU: krogoth branchgenericx86-64-lsb on MMAX64100.0%none0.0%none0.0%none100.0%
6220 BSP/QEMU: krogoth branchgenericx86-64-lsb on NUC98.1%none1.9%5351 0.0%none100.0%
6221 BSP/QEMU: krogoth branchgenericx86-lsb on MMAX32bit100.0%none0.0%none0.0%none100.0%
6203 6204 BSP/QEMU: krogoth branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
6211 6213 BSP/QEMU: krogoth branchqemu-x8698.4%none1.6%9259 0.0%none100.0%
6189 6190 BSP/QEMU: krogoth branchqemuarm100.0%none0.0%none0.0%none100.0%
6195 6196 BSP/QEMU: krogoth branchqemuarm64100.0%none0.0%none0.0%none100.0%
6191 6192 BSP/QEMU: krogoth branchqemumips100.0%none0.0%none0.0%none100.0%
6197 6198 BSP/QEMU: krogoth branchqemumips64100.0%none0.0%none0.0%none100.0%
6193 6194 BSP/QEMU: krogoth branchqemuppc100.0%none0.0%none0.0%none100.0%
6212 6214 BSP/QEMU: krogoth branchqemux86-6498.4%none1.6%9259 0.0%none100.0%
Total: 27


Bug Status


Test Case Status Report
StatusCount
FAILED12
PASSED2230
Total: 2242



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (4 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
10048Graphics - ABAT-fatal IO error 11Medium+Alejandro Hernandez 2.2 M3VERIFIEDNOTABUG---2016-07-28
OE-Core
9287Failed to build nativesdk-glibc for qemumips and qemumips64 on Fedora 23 i686Medium+Ross Burton (Arm)Yi Zhao2.2 M4VERIFIEDFIXEDRegression (Used to work)2016-03-17
9285Failed to build gobject-introspection for qemumips64 on i686 hostsMedium+Scott RifenbarkYi Zhao2.2 M4RESOLVEDFIXEDNew (Never tested)2016-03-17
Runtime Testing
8988test_rpm_query_nonroot (oeqa.runtime.rpm.RpmInstallRemoveTest) - Failed to create new userMedium+Ross Burton (Arm)David Rodriguez2.2 M3VERIFIEDDUPLICATERegression (Used to work)2016-01-22


Other Bugs found during QA Test

IDSummary (8 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
5351genericx86 auth.err getty[615]: tcgetattr: Input/outputMediumJianxun ZhangJuan Ramos2.2RESOLVEDFIXED---2013-10-14
BSPs
9860LAN device doesn't retrieve connection after resume from suspend stateMedium+David RodriguezDavid Rodriguez2.2 M3VERIFIEDFIXED---2016-06-30
New (Never tested)
9048Failed to build iptables with extensible sdk on Fedora 23 i686MediumRobert YangYi Zhao2.2 M4VERIFIEDFIXEDNew (Never tested)2016-02-04
Regression (Found by QA test)
9267test_parselogs (oeqa.runtime.parselogs.ParseLogsTest) failed on NUC 6i5SYH, firmware load for i915/skl_guc_ver4.bin failedMediumCalifornia SullivanApoorv2.5RESOLVEDFIXEDRegression (Found by QA test)2016-03-15
9271dmi firmware registration failed, ioremap error on 32 bit MinnowBoardMediumCalifornia SullivanJuan Ramos2.2RESOLVEDWONTFIXRegression (Found by QA test)2016-03-16
9462Boot and install from USB failed getting a xhci_hcd error after booting kernel panic is displayedMediumCalifornia SullivanJuan Ramos2.2RESOLVEDFIXEDRegression (Found by QA test)2016-04-13
Regression (Used to work)
9120The patch file is not applied to linux-yocto by yocto-kernel add patch commandMediumLeonardo Sandoval GonzalezYi Zhao2.2 M1VERIFIEDFIXEDRegression (Used to work)2016-02-16
OE-Core
9259The rpm database costs lots of disk space after install a packageMediumYi ZhaoYi Zhao2.4RESOLVEDFIXEDRegression (Used to work)2016-03-15

pTest open bugs

IDSummary (8 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Runtime Testing
8146ptest - some test cases are failing for aclMediumAjay KumarRoss Burton (Arm)2.2RESOLVEDDUPLICATE---2015-08-11
8471ptest - some valgrind ptests fail on 2.4 M1.rc1MediumMaxin B. John 3.99RESOLVEDDUPLICATERegression (Used to work)2015-10-09
8812Some util-linux ptests failMediumdengke 2.2 M4RESOLVEDFIXED---2015-12-16
8828pTest - lttng-tools tests failMediumRichard Purdieyeoh ee peng3.99RESOLVEDFIXEDRegression (Used to work)2015-12-17
8832pTest - bash tests fail for 2.1_M1.rc1MediumChangqing Li 2.7 M2RESOLVEDWORKSFORME---2015-12-17
8834pTest - attr test fail ln -s fMediumdengke 2.2 M3VERIFIEDFIXED---2015-12-17
9053pTest - util-linux (NUC) failed tested on NUC 5425WYK for YP 2.1_M2.rc1MediumdengkeFrancisco Pedraza2.3RESOLVEDDUPLICATERegression (Used to work)2016-02-04
9055pTest - acl (NUC) failed tested on NUC 5425WYK for YP 2.1_M2.rc1MediumRobert YangFrancisco Pedraza2.4RESOLVEDFIXEDRegression (Used to work)2016-02-04

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      
Runtime Testing
8861Medium+System envs in /etc/profile are not injected in oeqa ssh connectionRoss Burton (Arm)Costin2.1 M3CLOSED---2015-12-24
  1      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.2 M2. Performance execution has 2 stages, one executed form 1.6 to 2.1 in RO and another one started on 2.1 from GDC, there are difference between HW used in both location hence the numbers are different.

Below chars are showing the latest performance results taken from current milestone


Performance Charts

GDC performance machines were focused ta take measurements for master branch to monitor any degradation on Kernel, that is why there is no available charts for this Point release


pTest results for genericx86-64 on NUC

< Back
Ran on a NUC and compared with commit 98c57bb512ea6790db8604fcf0b88c81651d2ab4

Results
Package Name Tests ran Passed Failed Passrate Last Passrate Run difference
tcl (NUC) 148 147 1 99.0% 99.0%
No

Results for NUC ptest tcl 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

httpold.test

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 1

http.test
acl (NUC) 212 203 9 96.0% 96.0%
No

Results for NUC ptest acl 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 9

$ ls -l g | awk -- '{ print $1 $3 $4 }'
$ ls -dl d | awk '{print $1}'
$ getfacl --omit-header i/x
$ ls -dl f | awk '{print $1}'
$ ls -dl d/d | awk '{print $1}'
$ ls -dl -L d/l | awk '{print $1}'
$ ls -dl d/f | awk '{print $1}'
$ ls -l f | awk -- '{ print $1 }'
$ ls -dl g | awk '{print $1}'
busybox (NUC) 474 466 8 98.0% 98.0%
No

Results for NUC ptest busybox 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

hostname-d-works

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 8

ls-s-works
cpio lists hardlinks
ls-l-works
sed n (flushes pattern space terminates early)
sed append autoinserts newline
sed embedded NUL
sed NUL in command
sed nonexistent label
bash (NUC) 76 71 5 93.0% 93.0%
No

Results for NUC ptest bash 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 5

run-nquote4
run-vredir
run-intl
run-lastpipe
run-trap
gawk (NUC) 282 281 1 100.0% 100.0%
No
python (NUC) 14593 14546 47 100.0% 100.0%
No
dbus-test (NUC) 15 4 11 27.0% 27.0%
No

Results for NUC ptest dbus-test 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 11

test/test-bus-launch-helper
test/test-bus-system
test/test-refs
test/test-dbus-daemon
test/test-dbus-daemon-eavesdrop
test/test-relay
test/test-corrupt
test/test-bus
test/test-shell
test/test-loopback
test/test-dbus
pango (NUC) 12 12 0 100.0% 100.0%
No
util-linux (NUC) 19 18 1 95.0% 95.0%
No

Results for NUC ptest util-linux 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 1

paths
quilt (NUC) 55 55 0 100.0% 100.0%
No
gdk-pixbuf (NUC) 15 15 0 100.0% 100.0%
No
perl (NUC) 2266 2256 10 100.0% 100.0%
No
openssl (NUC) 50 48 2 96.0% 100.0%
Yes

Results for NUC ptest openssl 2016-08-01:
********************************

Tests that failed now and worked last time: 2

test_clienthello
test_sslv2conftest

Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 2

test_clienthello
test_sslv2conftest
bluez5 (NUC) 25 25 0 100.0% 100.0%
No
diffstat (NUC) 439 439 0 100.0% 100.0%
No
zlib (NUC) 2 2 0 100.0% 100.0%
No
libpcre (NUC) 3 3 0 100.0% 100.0%
No
attr (NUC) 108 108 0 100.0% 100.0%
No
libxml2 (NUC) 85 82 3 96.0% 96.0%
No

Results for NUC ptest libxml2 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 3

Error cases stream regression tests
Error cases regression tests
runtest
bzip2 (NUC) 6 6 0 100.0% 100.0%
No
lttng-tools (NUC) 14 0 14 0.0% 0.0% No
diffutils (NUC) 12 12 0 100.0% 100.0%
No
perl5 (NUC) 2266 2256 10 100.0% 100.0%
No
valgrind (NUC) 538 2 536 0.0% 0.0% No
nettle (NUC) 87 86 1 99.0% 99.0%
No

Results for NUC ptest nettle 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 1

dlopen-test
e2fsprogs (NUC) 1 0 1 0.0% 0.0% No
glib-2.0 (NUC) 277 270 7 97.0% 97.0%
No

Results for NUC ptest glib-2.0 2016-08-01:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

Tests that failed now: 7

wget-handles-empty-path
wget-supports--P
wget--O-overrides--P
wget-retrieves-google-index
glib/regex.test (Child process killed by signal 6)
unzip (subdir only)
unzip (bad archive)
openssh (NUC) 56 56 0 100.0% 100.0%
No
strace (NUC) 90 90 0 100.0% 100.0%
No
gdbm (NUC) 11 11 0 100.0% 100.0%
No

Detailed Report

Distro Testing

Core Build System

Bitbake

Status

Bugs

**No results**

Agenda

Meta-Yocyo

Status

Bugs

Agenda

OE-Core

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

BSP

genericx86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

genericx86_64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

Beaglebone Black: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

EdgeRouter: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

MPC8315e-rdb: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda


Qemu

qemux86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

qemux86-64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

qemuarm: core-image-sato-sdk

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda