WW41 - 2018-10-03 - Full Test Cycle 2.6 M3 RC1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: master
 Build name: yocto-2.6_M3.rc1
 poky commit: c6edf2f8bc5778b267e3a7f4e8875d22f359fb8d
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.6_M3.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
10568 10569 eSDK: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10565 CROPS: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10559 ADT: master branchFedora 26 i686100.0%none0.0%none0.0%none100.0%
10552 10561 ADT: master branchqemu-x86100.0%none0.0%none0.0%none100.0%
10553 ADT: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
10554 10562 ADT: master branchqemuarm100.0%none0.0%none0.0%none100.0%
10555 ADT: master branchqemuarm64100.0%none0.0%none0.0%none100.0%
10556 10563 ADT: master branchqemumips100.0%none0.0%none0.0%none100.0%
10557 ADT: master branchqemumips64100.0%none0.0%none0.0%none100.0%
10558 10564 ADT: master branchqemuppc100.0%none0.0%none0.0%none100.0%
10560 ADT: master branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
10570 Kernel: master branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10567 Eclipse-Plugin: master branchNeon - Fedora 24100.0%none0.0%none0.0%none100.0%
10566 Eclipse-Plugin: master branchOxygen - Fedora26100.0%none0.0%none0.0%none100.0%
10549 Build-Appliance: master branchVMWare Player on Ubuntu0.0%none100.0%12894 0.0%none100.0%
10550 10551 Toaster: master branchUbuntu 16.04 x86_6497.8%none2.2%12813 0.0%none100.0%
10541 OE-Core: master branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
10542 OE-Core: master branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
10543 OE-Core: master branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
10544 OE-Core: master branchFedora 27 x86_64100.0%none0.0%none0.0%none100.0%
10545 OE-Core: master branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
10546 10548 OE-Core: master branchUbuntu 16.04 x86_6499.7%none0.3%12950 0.0%none100.0%
10547 OE-Core: master branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
10500 BitBake: master branchUbuntu 16.04 x86_6480.0%none20.0%12670 0.0%none100.0%
10503 10524 BSP/QEMU: master branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
10504 10525 BSP/QEMU: master branchEdgeRouter100.0%none0.0%none0.0%none100.0%
10520 BSP/QEMU: master branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
10502 10521 BSP/QEMU: master branchgenericx86-64 on MTURBOT6493.4%none6.6%12914 12952 0.0%none100.0%
10522 BSP/QEMU: master branchgenericx86-64 on NUC6100.0%none0.0%none0.0%none100.0%
10501 10523 BSP/QEMU: master branchgenericx86-64 on NUC798.9%none1.1%12914 0.0%none100.0%
10528 BSP/QEMU: master branchgenericx86-64-WIC on MTURBOT6497.9%none0.0%none2.1%none100.0%
10529 BSP/QEMU: master branchgenericx86-64-WIC on NUC697.9%none0.0%none2.1%none100.0%
10530 BSP/QEMU: master branchgenericx86-64-WIC on NUC797.9%none0.0%none2.1%none100.0%
10527 BSP/QEMU: master branchgenericx86-WIC on MTURBOT3297.9%none0.0%none2.1%none100.0%
10505 10526 BSP/QEMU: master branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
10506 10513 10533 10540 BSP/QEMU: master branchqemu-x86100.0%12951 0.0%none0.0%none100.0%
10507 10514 10534 BSP/QEMU: master branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
10532 BSP/QEMU: master branchqemu-x86-64-WIC97.7%none0.0%none2.3%none100.0%
10531 BSP/QEMU: master branchqemu-x86-WIC97.7%none0.0%none2.3%none100.0%
10508 10515 10535 BSP/QEMU: master branchqemuarm96.1%none3.9%12499 0.0%none100.0%
10509 10516 10536 BSP/QEMU: master branchqemuarm6496.1%none3.9%11288 0.0%none100.0%
10510 10517 10537 BSP/QEMU: master branchqemumips100.0%none0.0%none0.0%none100.0%
10511 10518 10538 BSP/QEMU: master branchqemumips64100.0%none0.0%none0.0%none100.0%
10512 10519 10539 BSP/QEMU: master branchqemuppc100.0%none0.0%none0.0%none100.0%
10571 Runtime: master branchuser-preference (any supported environment)100.0%none0.0%none0.0%none100.0%
10572 Package-Management-Issues: master branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 46


Bug Status


Test Case Status Report
StatusCount
BLOCKED6
FAILED19
PASSED3333
Total: 3358

Bugs Found during QA Test

New issues Found during QA Test & Community

BSPs
12952[QA 2.6.M3 rc1 ][BSP/Mturbot] Not able to see login prompt when using serialMedium+Anuj Mittal 2.6 M4RESOLVEDWONTFIX---2018-10-05


OE-Core
12950[Yocto-2.6_M3.rc1] [MANUAL_SCRIPTS_OE-Core] [Case 2021] [Cross_tap]semantic error: while resolving probe point: identifier 'syscall' at trace_open.stpMediumVictor Kamensky 2.7RESOLVEDFIXED---2018-10-04


High and M+ issuesFound during QA Test (NOT NEW)

"None"

Other Bugs found during QA Test (NOT NEW)

---
12813[QA 2.6 M1 rc1 ][Toaster]:Build stopped without error, to terminate by ctrl+cMediumDavid ReynaToaster default assignee2.6 M4RESOLVEDFIXED---2018-06-25
---
12894[Bug][QA 2.5 rc1 ][Build Appliance]:bitbake stuck at parsingMedium+Armin Kuster 2.5.2CLOSEDFIXED---2018-08-17
---
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18
---
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03
---
12670[2.5 M3 RC1]MANUAL_BitBake:test dependancy explorer is launched with failed logsUndecidedStephano Cetola 2.6RESOLVEDFIXED---2018-04-10

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results in below are both executed from the same machines in Linux Foundation.

Ww41-2k18 - table.png

pTest for genericx86-64 on NUC

open bugs

OE-Core
12837[2.6 M1 RC1] valgrind ptest failedMedium+Randy MacLeod 2.6 M4RESOLVEDFIXEDRegression (Found by QA test)2018-07-02
OE-Core
12948[2.6 M3 RC1] strace ptest failedMediumAnuj Mittal 2.6 M4RESOLVEDFIXED---2018-10-03
OE-Core
12946[2.6 M3 RC1] e2fsprogs ptest failedMedium+Changqing Li 2.6 M4RESOLVEDFIXED---2018-10-03
"None"
OE-Core
12788[2.4.3.rc2] python ptest failedMedium+Anuj Mittal 2.6 M4RESOLVEDFIXEDRegression (Found by QA test)2018-06-14
OE-Core
12954[2.6 M3 RC1] gdbm ptest failuresMediumChangqing Li 2.7RESOLVEDFIXED---2018-10-09

results

< Archive


Ran on a NUC and compared with 2.6_M2.rc1

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 97.47
bluez5 25 25 0 100.0 100.0
busybox 511 502 9 98.24 97.33 Up rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 20 20 0 100.0 100.0
e2fsprogs 185 144 41 77.84 100.0 Down rate.png
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 30 26 4 86.67 100.0 Down rate.png
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 262 253 9 96.56 100.0 Down rate.png
gstreamer1.0 106 104 2 98.11 98.11
gzip 21 21 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libusb1 4 4 0 100.0 0 Up rate.png
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 40 38 2 95.0 95.0
lttng-tools 2089 2020 69 96.7 96.7
lzo 5 5 0 100.0 100.0
nettle 93 93 0 100.0 100.0
openssh 53 53 0 100.0 100.0
openssl 0 0 0 0 100.0 Down rate.png
pango 12 3 9 25.0 100.0 Down rate.png
perl 2301 2300 1 99.96 100.0 Down rate.png
python 30686 30490 196 99.36 99.39 Down rate.png
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 457 422 35 92.34 96.4 Down rate.png
tcl 148 148 0 100.0 99.32 Up rate.png
util-linux 480 467 13 97.29 97.29
valgrind 558 215 343 38.53 49.1 Down rate.png
zlib 2 2 0 100.0 100.0

Detailed Report

BitBake

Status

Bugs

Agenda

BSPs

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda