WW07 - 2018-02-14- Full Test Cycle - 2.5 M2 rc1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: master
 Build name: yocto-2.5_M2.rc1
 poky commit: 385944254d0ef88bd6450a221a54cbcb40020b42 
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.5_M2.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
9100 9101 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9097 CROPS: master branchUbuntu 16.0483.3%none16.7%none0.0%none100.0%
9091 9095 ADT: master branchFedora 26 i68674.2%none23.3%12545 2.5%none100.0%
9092 9096 ADT: master branchUbuntu 16.04 x86_6474.2%none23.3%12545 2.5%none100.0%
9102 Kernel: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9099 Eclipse-Plugin: master branchNeon - Fedora 2414.3%none71.4%12545 0.0%none85.7%
9098 Eclipse-Plugin: master branchOxygen - Fedora2614.3%none71.4%12545 0.0%none85.7%
9109 Meta-yocto: master branchUbuntu 16.04 x86_6491.7%none8.3%none0.0%none100.0%
9088 Build-Appliance: master branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
9089 9090 Toaster: master branchUbuntu 16.04 x86_6496.8%none3.2%none0.0%none100.0%
9081 OE-Core: master branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
9082 OE-Core: master branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
9083 OE-Core: master branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
9084 OE-Core: master branchFedora 27 x86_64100.0%none0.0%none0.0%none100.0%
9085 OE-Core: master branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
9086 OE-Core: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
9087 OE-Core: master branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
9108 BitBake: master branchUbuntu 16.04 x86_6471.4%none14.3%none14.3%none100.0%
9053 9107 BSP/QEMU: master branchBeaglebone Black98.6%none1.4%12131 0.0%none100.0%
9054 9106 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
9070 BSP/QEMU: master branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
9052 9071 9075 BSP/QEMU: master branchgenericx86-64 on MTURBOT6495.7%none3.6%none0.7%none100.0%
9072 BSP/QEMU: master branchgenericx86-64 on NUC6100.0%none0.0%none0.0%none100.0%
9051 9073 BSP/QEMU: master branchgenericx86-64 on NUC798.9%none1.1%none0.0%none100.0%
9076 BSP/QEMU: master branchgenericx86-64-WIC on NUC695.8%none2.1%none2.1%none100.0%
9077 BSP/QEMU: master branchgenericx86-64-WIC on NUC795.8%none2.1%none2.1%none100.0%
9074 BSP/QEMU: master branchgenericx86-WIC on MTURBOT3297.9%none0.0%none2.1%none100.0%
9055 9105 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
9056 9063 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
9057 9064 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
9079 BSP/QEMU: master branchqemu-x86-64-WIC97.9%none0.0%none0.0%none97.9%
9078 BSP/QEMU: master branchqemu-x86-WIC97.9%none0.0%none0.0%none97.9%
9058 9065 BSP/QEMU: master branchqemuarm96.4%none3.6%12499 0.0%none100.0%
9059 9066 BSP/QEMU: master branchqemuarm6498.2%none1.8%11288 0.0%none100.0%
9060 9067 BSP/QEMU: master branchqemumips100.0%none0.0%none0.0%none100.0%
9061 9068 BSP/QEMU: master branchqemumips6494.6%none0.0%none0.0%none94.6%
9062 9069 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
9103 Runtime: master branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
9104 Package-Management-Issues: master branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 39


Bug Status


Test Case Status Report
StatusCount
BLOCKED11
FAILED84
IDLE7
PASSED3373
Total: 3475

Bugs Found during QA Test

New issues Found during QA Test & Community

OE-Core
12545[2.5 M2 RC1] SDK runqemu failed with python import loggingUndecidedAlexander Kanavin 2.1.4RESOLVEDFIXED---2018-02-13


High and M+ issuesFound during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12131Kernel traceback when reboot beaglebone blackMedium+Kevin HaoYi Zhao2.5 M3VERIFIEDFIXEDRegression (Used to work)2017-09-27
Sato
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03

Other Bugs found during QA Test (NOT NEW)

---
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results in below are both executed from the same machines in Linux Foundation.

Ww08-2k18 - table.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.5_M1_rc3

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 76 3 96.2 96.2
bluez5 7 7 0 100.0 100.0
busybox 524 514 10 98.09 98.47 Down rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 309 265 44 85.76 85.76
flex 114 114 0 100.0 100.0
gawk 339 339 0 100.0 100.0
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 253 253 0 100.0 100.0
gzip 21 21 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 2 1 66.67 66.67
libxml2 134 134 0 100.0 0 Up rate.png
lttng-tools 2057 1988 69 96.65 96.65
lzo 5 5 0 100.0 0 Up rate.png
nettle 93 93 0 100.0 100.0
openssh 60 60 0 100.0 100.0
openssl 52 52 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2287 2287 0 100.0 99.96 Up rate.png
python 30558 30358 200 99.35 99.59 Down rate.png
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 0 Up rate.png
slang 97 97 0 100.0 100.0
strace 370 369 1 99.73 99.73
tcl 148 147 1 99.32 100.0 Down rate.png
util-linux 376 364 12 96.81 96.81
valgrind 559 299 260 53.49 53.49
zlib 2 2 0 100.0 100.0

Detailed Report

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda