WW07 - 2019-02-14 - Full Test Cycle 2.7 M2 RC2

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: Master
 Build name: yocto-2.7_M2.rc2
 poky commit: be52da152a4d9f9e798844f592ec9ae7e051c658
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.7_M2.rc2
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 28
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 18.04
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
11564 11565 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11561 CROPS: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11555 ADT: master branchFedora 26 i686100.0%none0.0%none0.0%none100.0%
11548 11557 ADT: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
11549 ADT: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
11550 11558 ADT: master branchqemuarm100.0%none0.0%none0.0%none100.0%
11551 ADT: master branchqemuarm64100.0%none0.0%none0.0%none100.0%
11552 11559 ADT: master branchqemumips100.0%none0.0%none0.0%none100.0%
11553 ADT: master branchqemumips64100.0%none0.0%none0.0%none100.0%
11554 11560 ADT: master branchqemuppc100.0%none0.0%none0.0%none100.0%
11556 ADT: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11566 Kernel: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11563 Eclipse-Plugin: master branchNeon - Fedora 24100.0%none0.0%none0.0%none100.0%
11562 Eclipse-Plugin: master branchOxygen - Fedora26100.0%none0.0%none0.0%none100.0%
11545 Build-Appliance: master branchVMWare Player on Ubuntu50.0%none50.0%12991 0.0%none100.0%
11546 11547 Toaster: master branchUbuntu 16.04 x86_6496.8%none3.2%13191 0.0%none100.0%
11537 OE-Core: master branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
11538 OE-Core: master branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
11539 OE-Core: master branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
11569 OE-Core: master branchFedora 28 x86_64100.0%none0.0%none0.0%none100.0%
11541 OE-Core: master branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
11542 11544 OE-Core: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11570 OE-Core: master branchUbuntu 18.04 x86_64100.0%none0.0%none0.0%none100.0%
11496 BitBake: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11499 11520 BSP/QEMU: master branchBeaglebone Black88.7%13153 4.8%13178 6.5%13178 100.0%
11500 11521 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
11516 BSP/QEMU: master branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
11498 11517 BSP/QEMU: master branchgenericx86-64 on MTURBOT64100.0%none0.0%none0.0%none100.0%
11518 BSP/QEMU: master branchgenericx86-64 on NUC6100.0%none0.0%none0.0%none100.0%
11497 11519 BSP/QEMU: master branchgenericx86-64 on NUC7100.0%none0.0%none0.0%none100.0%
11524 BSP/QEMU: master branchgenericx86-64-WIC on MTURBOT6497.8%none0.0%none2.2%none100.0%
11525 BSP/QEMU: master branchgenericx86-64-WIC on NUC697.8%none0.0%none2.2%none100.0%
11526 BSP/QEMU: master branchgenericx86-64-WIC on NUC797.8%none0.0%none2.2%none100.0%
11523 BSP/QEMU: master branchgenericx86-WIC on MTURBOT3297.8%none0.0%none2.2%none100.0%
11501 11522 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
11502 11509 11529 11536 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
11503 11510 11530 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
11528 BSP/QEMU: master branchqemu-x86-64-WIC93.8%none0.0%none0.0%none93.8%
11527 BSP/QEMU: master branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
11504 11511 11531 BSP/QEMU: master branchqemuarm96.3%none3.7%12499 0.0%none100.0%
11505 11512 11532 BSP/QEMU: master branchqemuarm64100.0%none0.0%none0.0%none100.0%
11506 11513 11533 BSP/QEMU: master branchqemumips100.0%none0.0%none0.0%none100.0%
11507 11514 11534 BSP/QEMU: master branchqemumips64100.0%none0.0%none0.0%none100.0%
11508 11515 11535 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
11567 Runtime: master branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
11568 Package-Management-Issues: master branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 46


Bug Status


Test Case Status Report
StatusCount
BLOCKED8
FAILED9
IDLE3
PASSED3607
Total: 3627

Bugs Found during QA Test

New issues Found during QA Test & Community

Toaster
13191[Test Case 1439] Build Failure after adding or removing packages with and without dependenciesMediumDavid ReynaToaster default assignee3.2ACCEPTED---2019-02-21


BSPs
13178[2.7 M2 RC2] X server and matchbox desktop don't start up properly on beagleboneHighKevin HaoYi Zhao2.7 M4RESOLVEDFIXEDRegression (Used to work)2019-02-14


High and M+ issuesFound during QA Test (NOT NEW)

BSPs
13153[2.7 M2 RC1] Systemtap doesn't work on beagleboneMedium+Richard PurdieYi Zhao2.7 M4RESOLVEDFIXEDNew (Never tested)2019-01-29

Runtime
12991[2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk packageMedium+Richard Purdie 2.8 M1RESOLVEDFIXED---2018-11-09

Other Bugs found during QA Test (NOT NEW)

---
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureRESOLVEDWONTFIX---2018-01-18

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results shown below are both taken from the yocto-perf mailing list.


WW08 2k19 - table 2.7 M2.rc2 ML.PNG

pTest for genericx86-64 on NUC

open bugs

OE-Core
13193[2.7 M2 RC2] nettle ptest failureUndecidedRoss Burton (Intel) ---RESOLVEDDUPLICATE---2019-02-22
OE-Core
13194[2.7 M2 RC2] perl ptest failureMedium+Chen Qi 2.7 M4RESOLVEDFIXED---2019-02-22

results

< Archive


Ran on a NUC and compared with 2.7_M1.rc1

< FULL_LOG


Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 97.47
bluez5 25 25 0 100.0 100.0
busybox 527 527 0 100.0 100.0
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 321 321 0 100.0 100.0
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 30 30 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 263 261 2 99.24 99.24
gstreamer1.0 106 104 2 98.11 98.11
gzip 21 21 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libusb1 4 4 0 100.0 100.0
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 134 134 0 100.0 100.0
lttng-tools 3754 3740 14 99.63 99.63
lzo 5 5 0 100.0 100.0
nettle 97 96 1 98.97 100.0 Down rate.png
openssh 53 53 0 100.0 100.0
openssl 0 0 0 0 0 No rate.png
pango 12 12 0 100.0 100.0
perl 2459 2439 20 99.19 100.0 Down rate.png
python 16641 16612 29 99.83 99.81 Up rate.png
python3 30577 30564 13 99.96 99.97 Down rate.png
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 486 468 18 96.3 96.11 Up rate.png
tcl 149 149 0 100.0 99.33 Up rate.png
util-linux 480 467 13 97.29 97.29
valgrind 567 316 251 55.73 55.73
zlib 2 2 0 100.0 100.0

Detailed Report

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda