WW24 - 2018-06-12- Full Test Cycle - 2.4.3 rc2

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: rocko
 Build name: yocto-2.4.3.rc2 
 poky commit: 7e7ee662f5dea4d090293045f7498093322802cc 
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.4.3.rc2
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
9503 9504 eSDK: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9499 9500 CROPS: rocko branchUbuntu 16.0488.9%none11.1%11431 0.0%none100.0%
9495 9497 ADT: rocko branchFedora 26 i68691.7%none5.8%12695 2.5%none100.0%
9496 9498 ADT: rocko branchUbuntu 16.04 x86_6491.7%none5.8%12695 2.5%none100.0%
9505 Kernel: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9502 Eclipse-Plugin: rocko branchNeon on Ubuntu 1604100.0%none0.0%none0.0%none100.0%
9501 Eclipse-Plugin: rocko branchOxygen on Ubuntu 1604100.0%none0.0%none0.0%none100.0%
9485 Meta-yocto: rocko branchUbuntu 16.04 x86_6477.3%none22.7%12443 12445 0.0%none100.0%
9493 Build-Appliance: rocko branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
9494 Toaster: rocko branchUbuntu 16.04 x86_6498.5%none1.5%12591 0.0%none100.0%
9486 OE-Core: rocko branchCentOS 7 x86_6499.6%none0.0%none0.0%none99.6%
9487 OE-Core: rocko branchDebian 9 x86_6499.6%none0.0%none0.0%none99.6%
9488 OE-Core: rocko branchFedora 26 x86_6499.6%none0.0%none0.0%none99.6%
9489 OE-Core: rocko branchFedora 27 x86_6499.6%none0.0%none0.0%none99.6%
9490 OE-Core: rocko branchOpenSuse 42.3 x86_6499.6%none0.0%none0.0%none99.6%
9491 OE-Core: rocko branchUbuntu 16.04 x86_6499.6%none0.0%none0.0%none99.6%
9492 OE-Core: rocko branchUbuntu 17.10 x86_6499.6%none0.0%none0.0%none99.6%
9454 BitBake: rocko branchUbuntu 16.04 x86_6471.4%none28.6%12670 12771 0.0%none100.0%
9457 9477 BSP/QEMU: rocko branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
9478 9611 BSP/QEMU: rocko branchEdgeRouter100.0%none0.0%none0.0%none100.0%
9456 9474 BSP/QEMU: rocko branchgenericx86 on MMAX32bit98.9%none1.1%12590 0.0%none100.0%
9475 BSP/QEMU: rocko branchgenericx86-64 on MMAX64bit100.0%none0.0%none0.0%none100.0%
9455 9476 BSP/QEMU: rocko branchgenericx86-64 on NUC698.9%none1.1%12590 0.0%none100.0%
9481 BSP/QEMU: rocko branchgenericx86-64-WIC on MMAX64bit97.9%none0.0%none2.1%none100.0%
9482 BSP/QEMU: rocko branchgenericx86-64-WIC on NUC695.8%none2.1%12770 2.1%none100.0%
9480 BSP/QEMU: rocko branchgenericx86-WIC on MMAX32bit97.6%none0.0%none2.4%none100.0%
9459 9479 BSP/QEMU: rocko branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
9460 9467 BSP/QEMU: rocko branchqemu-x86100.0%none0.0%none0.0%none100.0%
9461 9468 BSP/QEMU: rocko branchqemu-x86-6496.3%none0.0%none0.0%none96.3%
9484 BSP/QEMU: rocko branchqemu-x86-64-WIC100.0%none0.0%none0.0%none100.0%
9483 BSP/QEMU: rocko branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
9462 9469 BSP/QEMU: rocko branchqemuarm96.3%none3.7%12499 0.0%none100.0%
9463 9470 BSP/QEMU: rocko branchqemuarm6498.1%none1.9%11288 0.0%none100.0%
9464 9471 BSP/QEMU: rocko branchqemumips100.0%none0.0%none0.0%none100.0%
9465 9472 BSP/QEMU: rocko branchqemumips64100.0%none0.0%none0.0%none100.0%
9466 9473 BSP/QEMU: rocko branchqemuppc100.0%none0.0%none0.0%none100.0%
9506 Runtime: rocko branchuser-preference (any supported environment)88.9%none11.1%12240 0.0%none100.0%
9507 Package-Management-Issues: rocko branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 38


Bug Status


Test Case Status Report
StatusCount
BLOCKED9
FAILED30
IDLE9
PASSED3273
RUNNING7
Total: 3328

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummary (3 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
OE-Core
12782[2.4.3.rc2] libxml2 ptest failedMedium+Armin Kuster 2.4.4RESOLVEDFIXEDRegression (Used to work)2018-06-13
12786[2.4.3.rc2] openssl ptest failedMedium+Armin Kuster 2.4.4RESOLVEDWORKSFORMERegression (Found by QA test)2018-06-14
12788[2.4.3.rc2] python ptest failedMedium+Anuj Mittal 2.6 M4RESOLVEDFIXEDRegression (Found by QA test)2018-06-14


High and M+ issues Found during QA Test (NOT NEW)

"None"

Other Bugs found during QA Test (NOT NEW)

IDSummary (6 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
12670[2.5 M3 RC1]MANUAL_BitBake:test dependancy explorer is launched with failed logsUndecidedStephano Cetola 2.6RESOLVEDFIXED---2018-04-10
CROPS
11431Crops-ESDK: devtool is unable to add recipe for nodejs-native recipeMediumAnuj Mittalnagarajagopal2.7RESOLVEDNOTABUG---2017-04-27
OE-Core
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureRESOLVEDWONTFIX---2018-01-18
12443[Test Case 312,313] Bitbake failed after using yocto-kernel add patchUndecidedStephano Cetola ---RESOLVEDWONTFIX---2017-12-21
12445[Test Case 309,310,311] Bitbake fails after add layer with yocto-bsp createUndecidedStephano Cetola ---RESOLVEDWONTFIX---2017-12-21
Toaster
12591[2.4.2 rc2] Run again button from all builds page must run the specified taskMediumDavid ReynaToaster default assignee4.1 M3IN PROGRESS IMPLEMENTATION---2018-03-08

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results in below are both executed from the same machines in Linux Foundation.

Ww24-2k18 - table.png

pTest for genericx86-64 on NUC

< Archive


Ran on a NUC and compared with 2.4.2.rc2

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 76 3 96.2 96.2
bluez5 7 7 0 100.0 100.0
busybox 518 509 9 98.26 98.56 Down rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 19 19 0 100.0 100.0
e2fsprogs 309 264 45 85.44 85.76 Down rate.png
flex 114 114 0 100.0 100.0
gawk 298 298 0 100.0 100.0
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 253 253 0 100.0 97.89 Up rate.png
gzip 18 18 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 66.67 Up rate.png
libxml2 0 0 0 0 100.0 Down rate.png
lttng-tools 2089 2020 69 96.7 96.65 Up rate.png
lzo 5 5 0 100.0 100.0
nettle 88 88 0 100.0 100.0
openssh 58 58 0 100.0 100.0
openssl 53 51 2 96.23 100.0 Down rate.png
pango 12 12 0 100.0 100.0
perl 2287 2284 3 99.87 99.96 Down rate.png
perl5 2287 2284 3 99.87 99.96 Down rate.png
python 32502 32320 182 99.44 99.64 Down rate.png
quilt 57 57 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 356 355 1 99.72 99.72
tcl 148 146 2 98.65 100.0 Down rate.png
util-linux 351 340 11 96.87 96.87
valgrind 559 300 259 53.67 53.49 Up rate.png
zlib 2 2 0 100.0 100.0


open bugs

"None"

results

{{:Ptest <ADD HERE THE PROOPER COMMIT>}}

Detailed Report

BitBake

Status

Bugs

Agenda

BSPs

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Meta-yocto

Status

Bugs

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda