WW01 - 2019-01-02 - Full Test Cycle 2.7 M1 RC1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: Master
 Build name: yocto-2.7_M1.rc1
 poky commit: fe43e599327f26b399c1883205e988236a5e51bd
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.7_M1.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
11215 11216 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11212 CROPS: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11206 ADT: master branchFedora 26 i686100.0%none0.0%none0.0%none100.0%
11199 11208 ADT: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
11200 ADT: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
11201 11209 ADT: master branchqemuarm100.0%none0.0%none0.0%none100.0%
11202 ADT: master branchqemuarm64100.0%none0.0%none0.0%none100.0%
11203 11210 ADT: master branchqemumips100.0%none0.0%none0.0%none100.0%
11204 ADT: master branchqemumips64100.0%none0.0%none0.0%none100.0%
11205 11211 ADT: master branchqemuppc100.0%none0.0%none0.0%none100.0%
11207 ADT: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11217 Kernel: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11214 Eclipse-Plugin: master branchNeon - Fedora 24100.0%none0.0%none0.0%none100.0%
11213 Eclipse-Plugin: master branchOxygen - Fedora26100.0%none0.0%none0.0%none100.0%
11196 Build-Appliance: master branchVMWare Player on Ubuntu50.0%none50.0%12991 0.0%none100.0%
11197 11198 Toaster: master branchUbuntu 16.04 x86_6487.1%none12.9%13102 13104 13103 0.0%none100.0%
11188 OE-Core: master branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
11189 OE-Core: master branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
11190 OE-Core: master branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
11191 OE-Core: master branchFedora 27 x86_64100.0%none0.0%none0.0%none100.0%
11192 OE-Core: master branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
11193 11195 OE-Core: master branchUbuntu 16.04 x86_6499.4%none0.6%12974 0.0%none100.0%
11194 OE-Core: master branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
11147 BitBake: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11150 11171 BSP/QEMU: master branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
11151 11172 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
11167 BSP/QEMU: master branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
11149 11168 BSP/QEMU: master branchgenericx86-64 on MTURBOT64100.0%none0.0%none0.0%none100.0%
11169 BSP/QEMU: master branchgenericx86-64 on NUC6100.0%none0.0%none0.0%none100.0%
11148 11170 BSP/QEMU: master branchgenericx86-64 on NUC7100.0%none0.0%none0.0%none100.0%
11175 BSP/QEMU: master branchgenericx86-64-WIC on MTURBOT6497.9%none0.0%none2.1%none100.0%
11176 BSP/QEMU: master branchgenericx86-64-WIC on NUC6100.0%none0.0%none0.0%none100.0%
11177 BSP/QEMU: master branchgenericx86-64-WIC on NUC797.9%none0.0%none2.1%none100.0%
11174 BSP/QEMU: master branchgenericx86-WIC on MTURBOT3297.9%none0.0%none2.1%none100.0%
11152 11173 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
11153 11160 11180 11187 BSP/QEMU: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
11154 11161 11181 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
11179 BSP/QEMU: master branchqemu-x86-64-WIC100.0%none0.0%none0.0%none100.0%
11178 BSP/QEMU: master branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
11155 11162 11182 BSP/QEMU: master branchqemuarm96.3%none3.7%12499 0.0%none100.0%
11156 11163 11183 BSP/QEMU: master branchqemuarm6498.1%none1.9%11288 0.0%none100.0%
11157 11164 11184 BSP/QEMU: master branchqemumips100.0%none0.0%none0.0%none100.0%
11158 11165 11185 BSP/QEMU: master branchqemumips64100.0%none0.0%none0.0%none100.0%
11159 11166 11186 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
11218 Runtime: master branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
11219 Package-Management-Issues: master branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 46


Bug Status


Test Case Status Report
StatusCount
BLOCKED3
FAILED18
PASSED3638
Total: 3659

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummary (3 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Toaster
13102[Bug][QA 2.7 M1 rc1][Toaster] All layers are not getting populated after clicking "View compatible layers" on project pageMedium+David ReynaToaster default assignee2.7 M3NEW---2018-12-24
13103[Bug][QA 2.7 M1 rc1][Toaster] "Recipes" table  and  "machines" table are not getting populated after clicking on imported layer as well as after clicking Machines Tab on project pageMedium+David ReynaToaster default assignee2.7 M3NEW---2018-12-24
13104[Bug][QA 2.7 M1 rc1][Toaster] All "Image Recipes" are not getting populated after clicking  "Image Recipes"  on project pageMedium+David ReynaToaster default assignee2.7 M3NEW---2018-12-24


High and M+ issuesFound during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Runtime
12991[2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk packageMedium+Richard Purdie 2.7 M3ACCEPTED---2018-11-09
Sato
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03

Other Bugs found during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18
OE-Core
12974[2.6 M4 RC1] [OE-Core] Crosstap doesn't work on 2.6 M4 RC1MediumVictor Kamensky 2.7RESOLVEDINVALID---2018-11-01

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results shown below are both taken from the yocto-perf mailing list.

WW51 2k18 - table 2.7 M1 rc1 ML.PNG

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.6.m4.rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 97.47
bluez5 25 25 0 100.0 100.0
busybox 544 533 11 97.98 100.0 Down rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 321 321 0 100.0 100.0
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 30 26 4 86.67 100.0 Down rate.png
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 262 261 1 99.62 99.24 Up rate.png
gstreamer1.0 106 103 3 97.17 98.11 Down rate.png
gzip 21 21 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libusb1 4 4 0 100.0 100.0
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 134 134 0 100.0 100.0
lttng-tools 2089 2020 69 96.7 99.63 Down rate.png
lzo 5 5 0 100.0 100.0
nettle 93 93 0 100.0 100.0
openssh 53 53 0 100.0 100.0
openssl 0 0 0 0 0 No rate.png
pango 12 12 0 100.0 100.0
perl 2300 2300 0 100.0 100.0
python 16641 16609 32 99.81 99.81
python3 26953 26944 9 99.97 99.97
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 457 439 18 96.06 96.11 Down rate.png
tcl 148 148 0 100.0 99.33 Up rate.png
util-linux 480 467 13 97.29 97.29
valgrind 567 304 263 53.62 55.73 Down rate.png
zlib 2 2 0 100.0 100.0

Detailed Report

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda