WW02 - 2018-1-8- Full Test Cycle - 2.5 M1 rc1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: master
 Build name: yocto-2.5_M1.rc1
 poky commit: b73e96e7f3f5d1ba3a221d99792a7a3c7ef42c21 
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.5_M1.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Tumbleweed
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
8728 8729 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
8727 8747 CROPS: master branchUbuntu 16.0477.8%none22.2%none0.0%none100.0%
8682 8683 ADT: master branchFedora 25 i68697.5%none0.0%none2.5%none100.0%
8684 8685 ADT: master branchUbuntu 16.04 x86_6497.5%none0.0%none2.5%none100.0%
8731 Kernel: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
8924 Eclipse-Plugin: master branchNeon on Ubuntu 16.0428.6%none0.0%none0.0%none28.6%
8923 Eclipse-Plugin: master branchOxygen on Ubuntu 160428.6%none0.0%none0.0%none28.6%
8732 Meta-yocto: master branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
8905 Build-Appliance: master branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
8742 8743 Toaster: master branchDebian 4.3.0-0.bpo.1-amd6496.8%none3.2%none0.0%none100.0%
8911 OE-Core: master branchCentOS 7 x86_6499.6%none0.4%none0.0%none100.0%
8912 OE-Core: master branchDebian 9 x86_6496.7%none0.0%none0.0%none96.7%
8913 OE-Core: master branchFedora 26 x86_640.0%none0.0%none0.0%none0.0%
8914 OE-Core: master branchFedora 27 x86_640.0%none0.0%none0.0%none0.0%
8916 OE-Core: master branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
8915 OE-Core: master branchTumbleweed0.0%none0.0%none0.0%none0.0%
8739 OE-Core: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
8918 OE-Core: master branchUbuntu 17.10 x86_6499.6%none0.4%none0.0%none100.0%
8686 BitBake: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
8694 8722 BSP/QEMU: master branchBeaglebone Black98.5%none1.5%12131 0.0%none100.0%
8695 8723 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
8887 8900 BSP/QEMU: master branchgenericx86 on MTURBOT32100.0%12457 0.0%none0.0%none100.0%
8888 8896 BSP/QEMU: master branchgenericx86-64 on MTURBOT6497.9%none1.0%none1.0%none100.0%
8891 BSP/QEMU: master branchgenericx86-64 on NUC693.5%none6.5%none0.0%none100.0%
8892 8899 BSP/QEMU: master branchgenericx86-64 on NUC793.2%none3.4%none3.4%none100.0%
8897 BSP/QEMU: master branchgenericx86-64-WIC on NUC693.5%none6.5%none0.0%none100.0%
8898 BSP/QEMU: master branchgenericx86-64-WIC on NUC793.5%none6.5%none0.0%none100.0%
8895 BSP/QEMU: master branchgenericx86-WIC on MTURBOT32100.0%none0.0%none0.0%none100.0%
8696 8721 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
8697 8704 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
8906 8907 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
8909 BSP/QEMU: master branchqemu-x86-64-WIC100.0%none0.0%none0.0%none100.0%
8908 BSP/QEMU: master branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
8698 8705 BSP/QEMU: master branchqemuarm96.3%none3.7%none0.0%none100.0%
8699 8706 BSP/QEMU: master branchqemuarm6498.1%none1.9%11288 0.0%none100.0%
8700 8707 BSP/QEMU: master branchqemumips100.0%none0.0%none0.0%none100.0%
8701 8708 BSP/QEMU: master branchqemumips64100.0%none0.0%none0.0%none100.0%
8702 8709 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
8703 8710 BSP/QEMU: master branchqemux86-64100.0%none0.0%none0.0%none100.0%
8730 Runtime: master branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
8744 Package-Management-Issues: master branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 41


Bug Status


Test Case Status Report
StatusCount
BLOCKED10
ERROR9
FAILED24
IDLE844
PASSED2907
Total: 3794

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12457[QA 2.5 M1 rc1] Minnow Turbot with igb ethernet controller failed for network functional testing after boot up with core-image-sato-sdk imageUndecidedCalifornia SullivanAshwin Soman---VERIFIEDFIXED---2017-12-28
OE-Core
12481[QA 2.5 M1 rc1] ptest-runner libxml2 failed to executeUndecidedAnuj Mittal ---RESOLVEDFIXEDRegression (Found by QA test)2018-01-15


High and M+ issuesFound during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12131Kernel traceback when reboot beaglebone blackMedium+Kevin HaoYi Zhao2.5 M3VERIFIEDFIXEDRegression (Used to work)2017-09-27
Sato
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03

Other Bugs found during QA Test (NOT NEW)

"None"

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.4.1.rc1 to 2.5 M1 rc1. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Results

Ww02-2k18 - table.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.4.1_rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 76 3 96.2 96.2
bluez5 7 7 0 100.0 100.0
busybox 524 516 8 98.47 98.26 Up rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 19 19 0 100.0 100.0
e2fsprogs 309 265 44 85.76 85.76
flex 114 114 0 100.0 100.0
gawk 339 339 0 100.0 100.0
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 253 253 0 100.0 100.0
gzip 18 18 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 2 1 66.67 66.67
libxml2 0 0 0 0 100.0 Down rate.png
lttng-tools 2057 1988 69 96.65 96.65
nettle 93 93 0 100.0 100.0
openssh 60 60 0 100.0 100.0
openssl 52 52 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2287 2286 1 99.96 99.96
perl5 2287 2286 1 99.96 99.96
python 32486 32354 132 99.59 99.59
quilt 57 57 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 370 368 2 99.46 99.72 Down rate.png
tcl 45 45 0 100.0 100.0
util-linux 377 363 14 96.29 96.88 Down rate.png
valgrind 559 299 260 53.49 53.49
zlib 2 2 0 100.0 100.0

Detailed Report

ADT

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

CROPS

Status

Bugs

**No results**

Agenda

eSDK

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

General Runtime

Status

Bugs

**No results**

Agenda

Kernel

Status

Bugs

**No results**

Agenda

Meta-yocto

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Toaster

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Package Management Issues

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Runtime

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda