WW06 - 2018-02-08 - Full Point Release Test Cycle 2.2.3 rc2

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: morty
 Build name: 2.2.3 RC2
 poky commit: e6626951501cdf8c5516ad42fd585894f19c2327 
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.2.3.rc2
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
8855 8856 eSDK: morty branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
8813 8814 ADT: morty branchFedora 25 i686100.0%none0.0%none0.0%none100.0%
8815 8816 ADT: morty branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
8854 Eclipse-Plugin: morty branchNeon on Ubuntu 160428.6%none0.0%none0.0%none28.6%
8853 Eclipse-Plugin: morty branchOxygen on Ubuntu 160428.6%none0.0%none0.0%none28.6%
8858 Meta-yocto: morty branchUbuntu 14.04 x86_64100.0%none0.0%none0.0%none100.0%
8868 Build-Appliance: morty branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
8870 9036 Toaster: morty branchUbuntu 16.04 x86_6496.3%none3.8%none0.0%none100.0%
8954 OE-Core:morty branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
8955 OE-Core:morty branchDebian 9 x86_6498.9%none1.1%12521 0.0%none100.0%
8956 OE-Core:morty branchFedora 26 x86_6485.9%none14.1%12519 12520 0.0%none100.0%
8957 OE-Core:morty branchFedora 27 x86_6485.9%none14.1%12519 12520 0.0%none100.0%
8959 OE-Core:morty branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
8960 OE-Core:morty branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
8961 OE-Core:morty branchUbuntu 17.10 x86_6481.3%none14.4%12533 0.0%none95.7%
8925 BitBake: morty branchUbuntu 16.04 x86_6466.7%none33.3%none0.0%none100.0%
8820 8848 BSP/QEMU: morty branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
8821 8849 BSP/QEMU: morty branchEdgeRouter100.0%none0.0%none0.0%none100.0%
8818 8841 BSP/QEMU: morty branchgenericx86 - on MMAX32bit89.9%none6.7%none3.4%none100.0%
8842 BSP/QEMU: morty branchgenericx86-64 on MMAX6483.0%none11.3%none5.7%none100.0%
8819 8843 BSP/QEMU: morty branchgenericx86-64 on NUC89.2%none6.5%none4.3%none100.0%
8851 BSP/QEMU: morty branchgenericx86-64-lsb on MMAX64100.0%none0.0%none0.0%none100.0%
8850 BSP/QEMU: morty branchgenericx86-64-WIC on NUC84.3%none11.8%none3.9%none100.0%
8852 BSP/QEMU: morty branchgenericx86-WIC on MMAX3286.5%none9.6%none3.8%none100.0%
8822 8847 BSP/QEMU: morty branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
8823 8830 BSP/QEMU: morty branchqemu-x8698.4%none0.0%none1.6%none100.0%
8824 8831 BSP/QEMU: morty branchqemuarm100.0%none0.0%none0.0%none100.0%
8825 8832 BSP/QEMU: morty branchqemuarm64100.0%none0.0%none0.0%none100.0%
8826 8833 BSP/QEMU: morty branchqemumips100.0%none0.0%none0.0%none100.0%
8827 8834 BSP/QEMU: morty branchqemumips64100.0%none0.0%none0.0%none100.0%
8828 8835 BSP/QEMU: morty branchqemuppc100.0%none0.0%none0.0%none100.0%
8829 BSP/QEMU: morty branchqemux86-6488.9%none0.0%none11.1%none100.0%
8836 BSP/QEMU: morty branchqemux86-64,100.0%none0.0%none0.0%none100.0%
8839 BSP/QEMU: morty branchqemux86-WIC100.0%none0.0%none0.0%none100.0%
8840 BSP/QEMU: morty branchqemux86_64-WIC100.0%none0.0%none0.0%none100.0%
8857 Runtime: morty branchuser-preference (any supported environment)88.9%none11.1%12240 0.0%none100.0%
Total: 36


Bug Status


Test Case Status Report
StatusCount
BLOCKED16
ERROR23
FAILED115
IDLE18
PASSED2651
RUNNING1
Total: 2824

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummaryPAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
OE-Core
12520[2.2.3 rc2] grub-efi-native-2.00-r3 oe_runmake failedMediumArmin KusterAaron Chan2.2.4RESOLVEDFIXEDRegression (Found by QA test)2018-02-01


High and M+ issuesFound during QA Test (NOT NEW)

"None"

Other Bugs found during QA Test (NOT NEW)

"None"

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from from 2.1 to 2.5 m1 rc3 in GDC and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: Longer than expected eSDK time on Fedora machine were identified to be related to the machine itself.

     Will rerun performance tests on new machines from Linux Foundation. 

Ww06-2k18 - table.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.2.2.rc2

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 354 26 93.16 93.16
attr 143 143 0 100.0 100.0
bash 76 72 4 94.74 94.74
bluez5 25 25 0 100.0 100.0
busybox 518 509 9 98.26 98.26
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 16 16 0 100.0 100.0
e2fsprogs 1 0 1 0.0 0.0
gawk 284 283 1 99.65 99.65
gdbm 22 22 0 100.0 100.0
gdk-pixbuf 17 17 0 100.0 100.0
glib-2.0 249 247 2 99.2 99.2
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libxml2 85 82 3 96.47 96.47
lttng-tools 2467 2462 5 99.8 99.8
nettle 87 86 1 98.85 98.85
openssh 56 56 0 100.0 100.0
openssl 52 52 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2263 2262 1 99.96 99.96
perl5 2263 2262 1 99.96 99.96
python 32066 31923 143 99.55 99.61 Down rate.png
quilt 55 54 1 98.18 98.18
strace 264 263 1 99.62 99.62
tcl 148 146 2 98.65 100.0 Down rate.png
util-linux 131 129 2 98.47 98.46 Up rate.png
valgrind 553 2 551 0.36 0.36
zlib 2 2 0 100.0 100.0


Detailed Report

ADT

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Eclipse Plugin

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

eSDK

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

General Runtime

Status

Bugs

Agenda

Meta-yocto

Status

Bugs

**No results**

Agenda

Runtime

Status

Bugs

**No results**

Agenda

Toaster

Status

Bugs

**No results**

Agenda

BitBake

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda