WW03 - 2018-1-18- Full Test Cycle - 2.5 M1 rc3

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: master 
 Build name: yocto-2.5_M1.rc3
 poky commit: f2b03953b28755277437641645669396f285919a
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.5_M1.rc3
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
9028 9029 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9021 9023 ADT: master branchFedora 26 i68696.7%none0.8%none2.5%none100.0%
9022 9024 ADT: master branchUbuntu 16.04 x86_6496.7%none0.8%none2.5%none100.0%
9018 Build-Appliance: master branchVMWare Player on Ubuntu100.0%12497 0.0%none0.0%none100.0%
9019 9020 Toaster: master branchUbuntu 16.04 x86_6496.8%none3.2%none0.0%none100.0%
9010 OE-Core: master branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
9011 OE-Core: master branchDebian 9 x86_6496.7%none0.7%none0.0%none97.4%
9012 OE-Core: master branchFedora 26 x86_6499.6%none0.4%none0.0%none100.0%
9013 OE-Core: master branchFedora 27 x86_64100.0%none0.0%none0.0%none100.0%
9015 OE-Core: master branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
9016 OE-Core: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
9017 OE-Core: master branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
8979 BitBake: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
8982 9033 BSP/QEMU: master branchBeaglebone Black98.6%none1.4%12131 0.0%none100.0%
8983 9034 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
8981 8999 BSP/QEMU: master branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
9000 9004 BSP/QEMU: master branchgenericx86-64 on MTURBOT64100.0%none0.0%none0.0%none100.0%
9001 BSP/QEMU: master branchgenericx86-64 on NUC697.9%none2.1%none0.0%none100.0%
8980 9002 BSP/QEMU: master branchgenericx86-64 on NUC795.5%none1.1%none3.4%none100.0%
9005 BSP/QEMU: master branchgenericx86-64-WIC on NUC697.9%none2.1%none0.0%none100.0%
9006 BSP/QEMU: master branchgenericx86-64-WIC on NUC7100.0%none0.0%none0.0%none100.0%
9003 BSP/QEMU: master branchgenericx86-WIC on MTURBOT32100.0%none0.0%none0.0%none100.0%
8984 9035 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
8985 8992 BSP/QEMU: master branchqemu-x8696.4%none0.0%none0.0%none96.4%
8986 8993 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
9008 BSP/QEMU: master branchqemu-x86-64-WIC95.8%none0.0%none0.0%none95.8%
9007 BSP/QEMU: master branchqemu-x86-WIC95.8%none0.0%none0.0%none95.8%
8987 8994 BSP/QEMU: master branchqemuarm96.4%none3.6%12499 0.0%none100.0%
8988 8995 BSP/QEMU: master branchqemuarm6496.4%none1.8%none0.0%none98.2%
8989 8996 BSP/QEMU: master branchqemumips94.6%none0.0%none0.0%none94.6%
8990 8997 BSP/QEMU: master branchqemumips6494.6%none0.0%none0.0%none94.6%
8991 8998 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
9031 Runtime: master branchuser-preference (any supported environment)77.8%none22.2%12240 12504 0.0%none100.0%
Total: 33


Bug Status


Test Case Status Report
StatusCount
BLOCKED9
ERROR6
FAILED17
IDLE20
PASSED3379
Total: 3431

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummary (3 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
OE-Core
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18
Runtime
12497[2.5 M1 RC3] Build Appliance : failed to build core-image-sato image & build-appliance-imageMediumRichard Purdie 2.5RESOLVEDFIXED---2018-01-18
Runtime Testing
12504[2.5 M1 RC3] LTP Test: LTP tests hung up on NUC7 and not able to complete full runMediumAnuj Mittal 2.5 M4RESOLVEDWONTFIX---2018-01-19


High and M+ issuesFound during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12131Kernel traceback when reboot beaglebone blackMedium+Kevin HaoYi Zhao2.5 M3VERIFIEDFIXEDRegression (Used to work)2017-09-27
Sato
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03

Other Bugs found during QA Test (NOT NEW)

"None"

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.5 M1 rc1 to 2.5 M1 rc3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 2.1 to 2.4 in GDC and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Results

Ww03-2k18 - table.png


pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.5_M1_rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 76 3 96.2 96.2
bluez5 7 7 0 100.0 100.0
busybox 524 516 8 98.47 98.47
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 309 265 44 85.76 85.76
flex 114 114 0 100.0 100.0
gawk 339 339 0 100.0 100.0
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 253 253 0 100.0 100.0
gzip 18 18 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 2 1 66.67 66.67
libxml2 0 0 0 0 0 No rate.png
lttng-tools 2057 1988 69 96.65 96.65
nettle 93 93 0 100.0 100.0
openssh 60 60 0 100.0 100.0
openssl 52 52 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2287 2286 1 99.96 99.96
python 32486 32354 132 99.59 99.59
quilt 57 57 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 370 369 1 99.73 99.46 Up rate.png
tcl 148 148 0 100.0 100.0
util-linux 376 364 12 96.81 96.29 Up rate.png
valgrind 559 299 260 53.49 53.49
zlib 2 2 0 100.0 100.0

Detailed Report

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Meta-yocto

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda