WW44 - 2018-10-30 - Full Test Cycle 2.6 M4 RC1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: Master
 Build name: Yocto-2.6_M4.rc1
 poky commit: 84eecb017ef92ef36b4df730908828e54aeff85c
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.6.rc1/
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
10725 10726 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10722 CROPS: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10716 ADT: master branchFedora 26 i686100.0%none0.0%none0.0%none100.0%
10709 10718 ADT: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
10710 ADT: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
10711 10719 ADT: master branchqemuarm100.0%none0.0%none0.0%none100.0%
10712 ADT: master branchqemuarm64100.0%none0.0%none0.0%none100.0%
10713 10720 ADT: master branchqemumips100.0%none0.0%none0.0%none100.0%
10714 ADT: master branchqemumips64100.0%none0.0%none0.0%none100.0%
10715 10721 ADT: master branchqemuppc100.0%none0.0%none0.0%none100.0%
10717 ADT: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
10727 Kernel: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10724 Eclipse-Plugin: master branchNeon on Ubuntu 16.04100.0%none0.0%none0.0%none100.0%
10723 Eclipse-Plugin: master branchOxygen on Ubuntu 1604100.0%none0.0%none0.0%none100.0%
10706 Build-Appliance: master branchVMWare Player on Ubuntu75.0%none25.0%12991 0.0%none100.0%
10707 10708 Toaster: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
10698 OE-Core: master branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
10699 OE-Core: master branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
10700 OE-Core: master branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
10701 OE-Core: master branchFedora 27 x86_6499.3%none0.7%12992 12979 0.0%none100.0%
10702 OE-Core: master branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
10703 10705 OE-Core: master branchUbuntu 16.04 x86_6499.7%none0.3%12974 0.0%none100.0%
10704 OE-Core: master branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
10657 BitBake: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
10660 10681 BSP/QEMU: master branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
10661 10682 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
10677 BSP/QEMU: master branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
10659 10678 BSP/QEMU: master branchgenericx86-64 on MTURBOT64100.0%none0.0%none0.0%none100.0%
10679 BSP/QEMU: master branchgenericx86-64 on NUC6100.0%none0.0%none0.0%none100.0%
10658 10680 BSP/QEMU: master branchgenericx86-64 on NUC7100.0%none0.0%none0.0%none100.0%
10685 BSP/QEMU: master branchgenericx86-64-WIC on MTURBOT6497.8%none0.0%none2.2%none100.0%
10686 BSP/QEMU: master branchgenericx86-64-WIC on NUC697.8%none0.0%none2.2%none100.0%
10687 BSP/QEMU: master branchgenericx86-64-WIC on NUC797.8%none0.0%none2.2%none100.0%
10684 BSP/QEMU: master branchgenericx86-WIC on MTURBOT3297.8%none0.0%none2.2%none100.0%
10662 10683 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
10663 10670 10690 10697 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
10664 10671 10691 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
10689 BSP/QEMU: master branchqemu-x86-64-WIC100.0%none0.0%none0.0%none100.0%
10688 BSP/QEMU: master branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
10665 10672 10692 BSP/QEMU: master branchqemuarm96.1%none3.9%12499 0.0%none100.0%
10666 10673 10693 BSP/QEMU: master branchqemuarm6498.0%none2.0%11288 0.0%none100.0%
10667 10674 10694 BSP/QEMU: master branchqemumips100.0%none0.0%none0.0%none100.0%
10668 10675 10695 BSP/QEMU: master branchqemumips64100.0%none0.0%none0.0%none100.0%
10669 10676 10696 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
10644 Runtime: master branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
10645 Package-Management-Issues: master branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 46


Bug Status


Test Case Status Report
StatusCount
BLOCKED4
FAILED7
PASSED3328
Total: 3339

Bugs Found during QA Test

New issues Found during QA Test & Community

Runtime
12991[2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk packageMedium+Richard Purdie 2.7 M3ACCEPTED---2018-11-09
Runtime Testing
12979[2.6 M4 rc1] test_recipetool_create_cmake failed on Fedora 27Medium+Richard PurdieMohamad Noor Alim2.6 M4RESOLVEDFIXED---2018-11-05
OE-Core
12974[2.6 M4 RC1] [OE-Core] Crosstap doesn't work on 2.6 M4 RC1MediumVictor Kamensky 2.7RESOLVEDINVALID---2018-11-01
Runtime Testing
12992[2.6 M4 rc1] test_devtool_add_fetch_git failed on Fedora 27Medium+Mark HatleMohamad Noor Alim2.7 M2RESOLVEDWORKSFORME---2018-11-09



High and M+ issuesFound during QA Test (NOT NEW)

"None"

Other Bugs found during QA Test (NOT NEW)

---
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18
---
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results shown below are both taken from the yocto-perf mailing list.

WW45 2k18 - table 2.6.4.rc1 ML.PNG

pTest for genericx86-64 on NUC

open bugs

OE-Core
12990[2.6 M4 RC1] gstreamer 1.0 ptest failureUndecidedRoss Burton ---RESOLVEDNOTABUG---2018-11-09

results

< Archive


Ran on a NUC and compared with 2.6_M3.rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 97.47
bluez5 25 25 0 100.0 100.0
busybox 544 533 11 97.98 98.24 Down rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 321 321 0 100.0 77.84 Up rate.png
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 30 26 4 86.67 86.67
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 262 261 1 99.62 96.56 Up rate.png
gstreamer1.0 106 103 3 97.17 98.11 Down rate.png
gzip 21 21 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libusb1 4 4 0 100.0 100.0
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 134 134 0 100.0 95.0 Up rate.png
lttng-tools 2089 2020 69 96.7 96.7
lzo 5 5 0 100.0 100.0
nettle 93 93 0 100.0 100.0
openssh 53 53 0 100.0 100.0
openssl 0 0 0 0 0 No rate.png
pango 12 12 0 100.0 25.0 Up rate.png
perl 2300 2300 0 100.0 99.96 Up rate.png
python 16641 16609 32 99.81 99.36 Up rate.png
python3 26953 26944 9 99.97 0 Up rate.png
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 457 439 18 96.06 92.34 Up rate.png
tcl 148 148 0 100.0 100.0
util-linux 480 467 13 97.29 97.29
valgrind 567 304 263 53.62 38.53 Up rate.png
zlib 2 2 0 100.0 100.0

Detailed Report

General Runtime

Status

Bugs

**No results**

Agenda

Package Management Issues

Status

Bugs

**No results**

Agenda

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda