WW32 - 2018-08-07 - Full Test Cycle 2.6 M2 rc1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: master
 Build name: yocto-2.6_M2.rc1
 poky commit: b0f2f690a3513e4c9fa30fee1b8d7ac2d7140657 
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.6_M2.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
9846 9847 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9843 CROPS: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9837 ADT: master branchFedora 26 i686100.0%none0.0%none0.0%none100.0%
9830 9839 ADT: master branchqemu-x8690.0%none0.0%none0.0%none90.0%
9831 ADT: master branchqemu-x86-6485.7%none0.0%none0.0%none85.7%
9832 9840 ADT: master branchqemuarm90.0%none0.0%none0.0%none90.0%
9833 ADT: master branchqemuarm6485.7%none0.0%none0.0%none85.7%
9834 9841 ADT: master branchqemumips90.0%none0.0%none0.0%none90.0%
9835 ADT: master branchqemumips6485.7%none0.0%none0.0%none85.7%
9836 9842 ADT: master branchqemuppc90.0%none0.0%none0.0%none90.0%
9838 ADT: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
9848 Kernel: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9845 Eclipse-Plugin: master branchNeon - Fedora 24100.0%none0.0%none0.0%none100.0%
9844 Eclipse-Plugin: master branchOxygen - Fedora26100.0%none0.0%none0.0%none100.0%
9819 Meta-yocto: master branchUbuntu 16.04 x86_6488.9%none11.1%12802 0.0%none100.0%
9827 Build-Appliance: master branchVMWare Player on Ubuntu0.0%none100.0%12804 0.0%none100.0%
9828 9829 Toaster: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
9820 OE-Core: master branchCentOS 7 x86_6499.3%none0.3%12864 0.0%none99.7%
9821 OE-Core: master branchDebian 9 x86_6499.0%none0.7%12864 0.0%none99.7%
9822 OE-Core: master branchFedora 26 x86_6499.3%none0.3%12864 0.0%none99.7%
9823 OE-Core: master branchFedora 27 x86_6499.3%none0.3%12864 0.0%none99.7%
9824 OE-Core: master branchOpenSuse 42.3 x86_6499.0%none0.7%12864 12866 0.0%none99.7%
9825 OE-Core: master branchUbuntu 16.04 x86_6499.3%none0.3%12864 0.0%none99.7%
9826 OE-Core: master branchUbuntu 17.10 x86_6499.3%none0.3%12864 0.0%none99.7%
9779 BitBake: master branchUbuntu 16.04 x86_6466.7%none33.3%12670 0.0%none100.0%
9782 9803 BSP/QEMU: master branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
9783 9804 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
9799 BSP/QEMU: master branchgenericx86 on MTURBOT3297.9%none2.1%12861 0.0%none100.0%
9781 9800 BSP/QEMU: master branchgenericx86-64 on MTURBOT64100.0%none0.0%none0.0%none100.0%
9801 BSP/QEMU: master branchgenericx86-64 on NUC697.9%none2.1%12861 0.0%none100.0%
9780 9802 BSP/QEMU: master branchgenericx86-64 on NUC798.9%none1.1%12861 0.0%none100.0%
9807 BSP/QEMU: master branchgenericx86-64-WIC on MTURBOT6497.9%none0.0%none2.1%none100.0%
9808 BSP/QEMU: master branchgenericx86-64-WIC on NUC697.9%none0.0%none2.1%none100.0%
9809 BSP/QEMU: master branchgenericx86-64-WIC on NUC797.9%none0.0%none2.1%none100.0%
9806 BSP/QEMU: master branchgenericx86-WIC on MTURBOT3297.9%none0.0%none2.1%none100.0%
9784 9805 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
9785 9792 9812 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
9786 9793 9813 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
9811 BSP/QEMU: master branchqemu-x86-64-WIC97.8%none0.0%none0.0%none97.8%
9810 BSP/QEMU: master branchqemu-x86-WIC97.8%none0.0%none0.0%none97.8%
9787 9794 9814 BSP/QEMU: master branchqemuarm96.2%none3.8%12499 0.0%none100.0%
9788 9795 9815 BSP/QEMU: master branchqemuarm6496.2%none1.9%11288 0.0%none98.1%
9789 9796 9816 BSP/QEMU: master branchqemumips94.3%none0.0%none0.0%none94.3%
9790 9797 9817 BSP/QEMU: master branchqemumips6494.3%none0.0%none0.0%none94.3%
9791 9798 9818 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
9849 Runtime: master branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
9850 Package-Management-Issues: master branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 47


Bug Status


Test Case Status Report
StatusCount
BLOCKED4
FAILED22
IDLE23
PASSED3344
Total: 3393

Bugs Found during QA Test

New issues found during QA Test & Community

IDSummary (4 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
OE-Core
12869[2.6 M2 rc1] libxml test cases failedUndecidedRoss Burton ---RESOLVEDFIXED---2018-07-31
Runtime Testing
12864[2.6 M2 rc1] buildhistorydifftest failedUndecidedApoorvMohamad Noor Alim---RESOLVEDFIXED---2018-07-26
12866[2.6 M2 rc1] wic test_fix_size failedMediumRichard PurdieMohamad Noor Alim2.6 M2RESOLVEDFIXED---2018-07-27
12875[2.6 M2 rc1] eSDK devtool automated tests were skipped due to unexpected error on dependency logicMedium+Richard Purdie 2.6 M3RESOLVEDFIXED---2018-08-09


High and M+ issues found during QA Test (NOT NEW)

Runtime
12804[QA 2.6 M1 rc1 ][Build Appliance]: proxy issue in VM wareMedium+Anuj Mittal 2.6 M3RESOLVEDFIXEDRegression (Used to work)2018-06-20

Other Bugs found during QA Test (NOT NEW)

IDSummary (5 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
12670[2.5 M3 RC1]MANUAL_BitBake:test dependancy explorer is launched with failed logsUndecidedStephano Cetola 2.6RESOLVEDFIXED---2018-04-10
BSPs
12861[2.6 M2RC1] [Meta-Intel][ corei7-64_WIC_MTURBOT64][MTURBOT64] [test_parselogs] inotify_add_watch(6, /dev/loop0, 10) failed: No such file or directoryMediumAnuj Mittal 2.6RESOLVEDFIXED---2018-07-23
Meta-yocto
12802[Yocto-2.6_M1.RC1] Crosstap doesn't work on 2.6 M1 RC1MediumManish Das 2.7RESOLVEDFIXED---2018-06-20
OE-Core
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18
Sato
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.3 M3. Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results in below are both executed from the same machines in Linux Foundation.

Ww32-2k18 - table.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.6.m1.rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 96.2 Up rate.png
bluez5 7 7 0 100.0 100.0
busybox 524 510 14 97.33 97.33
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 317 317 0 100.0 100.0
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 256 256 0 100.0 100.0
gstreamer1.0 106 104 2 98.11 0 Up rate.png
gzip 21 21 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 40 38 2 95.0 100.0 Down rate.png
lttng-tools 2089 2020 69 96.7 96.7
lzo 5 5 0 100.0 100.0
nettle 93 93 0 100.0 100.0
openssh 50 50 0 100.0 100.0
openssl 53 53 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2299 2299 0 100.0 100.0
python 30668 30480 188 99.39 99.39
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 389 375 14 96.4 96.4
tcl 148 147 1 99.32 100.0 Down rate.png
util-linux 479 466 13 97.29 97.29
valgrind 558 274 284 49.1 49.1
zlib 2 2 0 100.0 100.0

Detailed Report

BitBake

Status

Bugs

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Meta-yocto

Status

Bugs

Agenda

OE-Core

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda