WW10 - 2018-03-05- Full Test Cycle - 2.4.2 rc2

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: rocko
 Build name: yocto-2.4.2.rc2
 poky commit: 342fbd6a3e57021c8e28b124b3adb241936f3d9d
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.4.2.rc2
 Distributions tested:
      CentOs 7
      Debian 9
      Tumbleweed
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
9223 9224 eSDK: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9219 9220 CROPS: rocko branchUbuntu 16.0488.9%none11.1%11015 0.0%none100.0%
9215 9217 ADT: rocko branchFedora 26 i68696.7%none0.8%none2.5%none100.0%
9216 9218 ADT: rocko branchUbuntu 16.04 x86_6497.5%none0.0%none2.5%none100.0%
9225 Kernel: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9222 Eclipse-Plugin: rocko branchNeon - Fedora 24100.0%none0.0%none0.0%none100.0%
9221 Eclipse-Plugin: rocko branchOxygen - Fedora26100.0%none0.0%none0.0%none100.0%
9205 Meta-yocto: rocko branchUbuntu 16.04 x86_6478.3%none21.7%12443 12445 0.0%none100.0%
9213 Build-Appliance: rocko branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
9214 Toaster: rocko branchUbuntu 16.04 x86_6498.5%none1.5%12591 0.0%none100.0%
9206 OE-Core: rocko branchCentOS 7 x86_6496.8%none0.0%none0.0%none96.8%
9207 OE-Core: rocko branchDebian 9 x86_6496.5%none0.4%12587 0.0%none96.8%
9208 OE-Core: rocko branchFedora 26 x86_6497.2%none0.0%none0.0%none97.2%
9209 OE-Core: rocko branchFedora 27 x86_6497.2%none0.0%none0.0%none97.2%
9210 OE-Core: rocko branchOpenSuse 42.3 x86_6496.8%none0.4%12587 0.0%none97.2%
9211 OE-Core: rocko branchUbuntu 16.04 x86_6495.8%none0.0%none0.0%none95.8%
9212 OE-Core: rocko branchUbuntu 17.10 x86_6497.2%none0.0%none0.0%none97.2%
9229 BitBake: rocko branchUbuntu 16.04 x86_6485.7%none0.0%none14.3%none100.0%
9177 9197 BSP/QEMU: rocko branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
9198 9239 BSP/QEMU: rocko branchEdgeRouter100.0%none0.0%none0.0%none100.0%
9176 9194 BSP/QEMU: rocko branchgenericx86 on MMAX32bit98.9%none1.1%12590 0.0%none100.0%
9195 BSP/QEMU: rocko branchgenericx86-64 on MMAX64bit100.0%none0.0%none0.0%none100.0%
9175 9196 BSP/QEMU: rocko branchgenericx86-64 on NUC698.9%none1.1%12590 0.0%none100.0%
9201 BSP/QEMU: rocko branchgenericx86-64-WIC on MMAX64bit97.9%none0.0%none2.1%none100.0%
9202 BSP/QEMU: rocko branchgenericx86-64-WIC on NUC695.8%none2.1%12214 2.1%none100.0%
9200 BSP/QEMU: rocko branchgenericx86-WIC on MMAX32bit97.9%none0.0%none2.1%none100.0%
9179 9199 BSP/QEMU: rocko branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
9180 9187 BSP/QEMU: rocko branchqemu-x86100.0%none0.0%none0.0%none100.0%
9181 9188 BSP/QEMU: rocko branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
9204 BSP/QEMU: rocko branchqemu-x86-64-WIC100.0%none0.0%none0.0%none100.0%
9203 BSP/QEMU: rocko branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
9182 9189 BSP/QEMU: rocko branchqemuarm96.3%none3.7%12499 0.0%none100.0%
9183 9190 BSP/QEMU: rocko branchqemuarm6498.1%none1.9%11288 0.0%none100.0%
9184 9191 BSP/QEMU: rocko branchqemumips100.0%none0.0%none0.0%none100.0%
9185 9192 BSP/QEMU: rocko branchqemumips64100.0%none0.0%none0.0%none100.0%
9186 9193 BSP/QEMU: rocko branchqemuppc100.0%none0.0%none0.0%none100.0%
9226 Runtime: rocko branchuser-preference (any supported environment)88.9%none11.1%12240 0.0%none100.0%
9227 Package-Management-Issues: rocko branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 38


Bug Status


Test Case Status Report
StatusCount
BLOCKED10
FAILED17
IDLE62
PASSED3311
RUNNING1
Total: 3401

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummary (3 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12590[2.4.2 rc2] No. of Chars/sec For Yocto Image is very Low To that of UbuntuMedium+Ross BurtonAshwin Soman2.4.4RESOLVEDFIXED---2018-03-08
OE-Core
12587[2.4.2 rc2] test_sstate_sametune_samesigs (sstatetests.SStateTests)HighRoss BurtonAaron Chan2.4.2RESOLVEDFIXEDRegression (Found by QA test)2018-03-06
Toaster
12591[2.4.2 rc2] Run again button from all builds page must run the specified taskMediumDavid ReynaToaster default assignee4.1 M2IN PROGRESS IMPLEMENTATION---2018-03-08


High and M+ issues: Found during QA Test (NOT NEW)

"None"

Other Bugs found during QA Test (NOT NEW)

IDSummary (6 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
12214[TC 1059] [test_parselogs] failed on MMAX64 (Turbot, WIC image) : usb 1-3: device descriptor read/64, error -71Mediumnagarajagopalpravin4.99RESOLVEDFIXED---2017-10-10
OE-Core
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureRESOLVEDWONTFIX---2018-01-18
11015devtool: fails to add node.js project that has local dependencyMediumUnassigned FutureNEW---2017-02-04
12443[Test Case 312,313] Bitbake failed after using yocto-kernel add patchUndecidedStephano Cetola ---RESOLVEDWONTFIX---2017-12-21
12445[Test Case 309,310,311] Bitbake fails after add layer with yocto-bsp createUndecidedStephano Cetola ---RESOLVEDWONTFIX---2017-12-21
Sato
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3RESOLVEDFIXED---2017-04-03

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results in below are both executed from the same machines in Linux Foundation.

Ww09-2k18 - table.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.4.1.rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 76 3 96.2 96.2
bluez5 7 7 0 100.0 100.0
busybox 487 480 7 98.56 98.26 Up rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 19 19 0 100.0 100.0
e2fsprogs 309 265 44 85.76 85.76
flex 114 114 0 100.0 100.0
gawk 298 298 0 100.0 100.0
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 284 278 6 97.89 100.0 Down rate.png
gzip 18 18 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 2 1 66.67 66.67
libxml2 133 133 0 100.0 100.0
lttng-tools 2057 1988 69 96.65 96.65
lzo 5 5 0 100.0 0 Up rate.png
nettle 88 88 0 100.0 100.0
openssh 58 58 0 100.0 100.0
openssl 53 53 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2287 2286 1 99.96 99.96
perl5 2287 2286 1 99.96 99.96
python 32476 32358 118 99.64 99.59 Up rate.png
quilt 57 57 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 356 355 1 99.72 99.72
tcl 45 45 0 100.0 100.0
util-linux 351 340 11 96.87 96.88 Down rate.png
valgrind 559 299 260 53.49 53.49
zlib 2 2 0 100.0 100.0


Detailed Report

BSPs

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Meta-yocto

Status

Bugs

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda