WW02 - 2019-01-09 - Full Test Cycle 2.6.1 RC1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Test Cycle
 Branch: Thud
 Build name: yocto_2.6.1_rc1
 poky commit: 1cab405d88149fd63322a867c6adb4a80ba68db3
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.6.1.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10   
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
11289 11290 eSDK: thud branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11286 CROPS: thud branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11280 ADT: thud branchFedora 26 i686100.0%none0.0%none0.0%none100.0%
11273 11282 ADT: thud branchqemu-x8692.3%none0.0%none0.0%none92.3%
11274 ADT: thud branchqemu-x86-6490.0%none0.0%none0.0%none90.0%
11275 11283 ADT: thud branchqemuarm92.3%none0.0%none0.0%none92.3%
11276 ADT: thud branchqemuarm6490.0%none0.0%none0.0%none90.0%
11277 11284 ADT: thud branchqemumips92.3%none0.0%none0.0%none92.3%
11278 ADT: thud branchqemumips6490.0%none0.0%none0.0%none90.0%
11279 11285 ADT: thud branchqemuppc92.3%none0.0%none0.0%none92.3%
11281 ADT: thud branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11291 Kernel: thud branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
11288 Eclipse-Plugin: thud branchNeon - Fedora 24100.0%none0.0%none0.0%none100.0%
11287 Eclipse-Plugin: thud branchOxygen - Fedora26100.0%none0.0%none0.0%none100.0%
11270 Build-Appliance: thud branchVMWare Player on Ubuntu50.0%none50.0%12991 0.0%none100.0%
11271 11272 Toaster: thud branchUbuntu 16.04 x86_6487.1%none12.9%13102 13104 13103 0.0%none100.0%
11262 OE-Core: thud branchCentOS 7 x86_6468.8%none29.4%13143 1.8%13143 100.0%
11263 OE-Core: thud branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
11264 OE-Core: thud branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
11265 OE-Core: thud branchFedora 27 x86_64100.0%none0.0%none0.0%none100.0%
11266 OE-Core: thud branchOpenSuse 42.3 x86_6468.8%none29.4%13143 1.8%13143 100.0%
11267 11269 OE-Core: thud branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11268 OE-Core: thud branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
11221 BitBake: thud branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
11224 11245 BSP/QEMU: thud branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
11225 11246 BSP/QEMU: thud branchEdgeRouter100.0%none0.0%none0.0%none100.0%
11241 BSP/QEMU: thud branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
11223 11242 BSP/QEMU: thud branchgenericx86-64 on MTURBOT64100.0%none0.0%none0.0%none100.0%
11243 BSP/QEMU: thud branchgenericx86-64 on NUC6100.0%none0.0%none0.0%none100.0%
11222 11244 BSP/QEMU: thud branchgenericx86-64 on NUC798.9%none1.1%none0.0%none100.0%
11249 BSP/QEMU: thud branchgenericx86-64-WIC on MTURBOT64100.0%none0.0%none0.0%none100.0%
11250 BSP/QEMU: thud branchgenericx86-64-WIC on NUC6100.0%none0.0%none0.0%none100.0%
11251 BSP/QEMU: thud branchgenericx86-64-WIC on NUC7100.0%none0.0%none0.0%none100.0%
11248 BSP/QEMU: thud branchgenericx86-WIC on MTURBOT32100.0%none0.0%none0.0%none100.0%
11226 11247 BSP/QEMU: thud branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
11227 11234 11254 11261 BSP/QEMU: thud branchqemu-x86100.0%none0.0%none0.0%none100.0%
11228 11235 11255 BSP/QEMU: thud branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
11253 BSP/QEMU: thud branchqemu-x86-64-WIC100.0%none0.0%none0.0%none100.0%
11252 BSP/QEMU: thud branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
11229 11236 11256 BSP/QEMU: thud branchqemuarm96.3%none3.7%12499 0.0%none100.0%
11230 11237 11257 BSP/QEMU: thud branchqemuarm64100.0%none0.0%none0.0%none100.0%
11231 11238 11258 BSP/QEMU: thud branchqemumips100.0%none0.0%none0.0%none100.0%
11232 11239 11259 BSP/QEMU: thud branchqemumips64100.0%none0.0%none0.0%none100.0%
11233 11240 11260 BSP/QEMU: thud branchqemuppc100.0%none0.0%none0.0%none100.0%
11292 Runtime: thud branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
11220 Package-Management-Issues: thud branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 46


Bug Status


Test Case Status Report
StatusCount
BLOCKED12
FAILED210
IDLE7
PASSED3428
Total: 3657

Bugs Found during QA Test

New issues Found during QA Test & Community

Functional (self) Testing
13143[2.6.1 rc1] bitbake core-image-minimal failed because no module named 'gpg' on CentOS 7 and OpenSuse 42.3Medium+Anuj MittalMohamad Noor Alim2.6.2NEW---2019-01-17


High and M+ issuesFound during QA Test (NOT NEW)

Runtime
12991[2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk packageMedium+Richard Purdie 2.7 M3ACCEPTED---2018-11-09

Toaster
13102[Bug][QA 2.7 M1 rc1][Toaster] All layers are not getting populated after clicking "View compatible layers" on project pageMedium+David ReynaToaster default assignee2.7 M3NEW---2018-12-24

Toaster
13103[Bug][QA 2.7 M1 rc1][Toaster] "Recipes" table  and  "machines" table are not getting populated after clicking on imported layer as well as after clicking Machines Tab on project pageMedium+David ReynaToaster default assignee2.7 M3NEW---2018-12-24

Toaster
13104[Bug][QA 2.7 M1 rc1][Toaster] All "Image Recipes" are not getting populated after clicking  "Image Recipes"  on project pageMedium+David ReynaToaster default assignee2.7 M3NEW---2018-12-24

Other Bugs found during QA Test (NOT NEW)

---
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

WW03-2k19 - table 2.6.1.rc1.PNG

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.6.m4.rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 97.47
bluez5 25 25 0 100.0 100.0
busybox 544 533 11 97.98 97.98
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 321 321 0 100.0 100.0
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 30 30 0 100.0 86.67 Up rate.png
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 262 261 1 99.62 99.62
gstreamer1.0 106 104 2 98.11 97.17 Up rate.png
gzip 21 21 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libusb1 4 4 0 100.0 100.0
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 134 134 0 100.0 100.0
lttng-tools 2089 2020 69 96.7 96.7
lzo 5 5 0 100.0 100.0
nettle 93 93 0 100.0 100.0
openssh 53 53 0 100.0 100.0
openssl 0 0 0 0 0 No rate.png
pango 12 12 0 100.0 100.0
perl 2300 2300 0 100.0 100.0
python 16643 16611 32 99.81 99.81
python3 26953 26944 9 99.97 99.97
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 457 439 18 96.06 96.06
tcl 148 148 0 100.0 100.0
util-linux 480 467 13 97.29 97.29
valgrind 567 316 251 55.73 53.62 Up rate.png
zlib 2 2 0 100.0 100.0

Detailed Report

Package Management Issues

Status

Bugs

**No results**

Agenda

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda