WW28 - 2018-07-13 - Full Test Cycle 2.2.4 rc1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: morty
 Build name: yocto-2.2.4.rc1
 poky commit: df76669bdd70aa0d903c4211dde731221c7e756d 
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.2.4.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
9608 9609 eSDK: morty branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
9602 9604 ADT: morty branchFedora 26 i68694.2%none2.5%12695 3.3%none100.0%
9603 9605 ADT: morty branchUbuntu 16.04 x86_6494.2%none2.5%12695 3.3%none100.0%
9607 Eclipse-Plugin: morty branchNeon on Ubuntu 1604100.0%none0.0%none0.0%none100.0%
9606 Eclipse-Plugin: morty branchOxygen on Ubuntu 1604100.0%none0.0%none0.0%none100.0%
9592 Meta-yocto: morty branchUbuntu 16.04 x86_6487.0%none13.0%12846 0.0%none100.0%
9600 Build-Appliance: morty branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
9601 Toaster: morty branchUbuntu 16.04 x86_6498.0%none2.0%12591 0.0%none100.0%
9593 OE-Core:morty branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
9594 OE-Core:morty branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
9595 OE-Core:morty branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
9596 OE-Core:morty branchFedora 27 x86_64100.0%none0.0%none0.0%none100.0%
9597 OE-Core:morty branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
9598 OE-Core:morty branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
9599 OE-Core:morty branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
9561 BitBake: morty branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
9564 9584 BSP/QEMU: morty branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
9565 9585 BSP/QEMU: morty branchEdgeRouter100.0%none0.0%none0.0%none100.0%
9563 9581 BSP/QEMU: morty branchgenericx86 on MMAX32bit98.9%none1.1%none0.0%none100.0%
9582 BSP/QEMU: morty branchgenericx86-64 on MMAX64bit98.1%none1.9%12854 0.0%none100.0%
9562 9583 BSP/QEMU: morty branchgenericx86-64 on NUC697.9%none2.1%12590 12853 0.0%none100.0%
9588 BSP/QEMU: morty branchgenericx86-64-WIC on MMAX64bit100.0%none0.0%none0.0%none100.0%
9589 BSP/QEMU: morty branchgenericx86-64-WIC on NUC698.1%none1.9%12852 0.0%none100.0%
9587 BSP/QEMU: morty branchgenericx86-WIC on MMAX32bit100.0%none0.0%none0.0%none100.0%
9566 9586 BSP/QEMU: morty branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
9567 9574 BSP/QEMU: morty branchqemu-x86100.0%none0.0%none0.0%none100.0%
9568 9575 BSP/QEMU: morty branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
9591 BSP/QEMU: morty branchqemu-x86-64-WIC0.0%none100.0%12838 0.0%none100.0%
9590 BSP/QEMU: morty branchqemu-x86-WIC0.0%none100.0%12838 0.0%none100.0%
9569 9576 BSP/QEMU: morty branchqemuarm96.7%none3.3%11288 12499 0.0%none100.0%
9570 9577 BSP/QEMU: morty branchqemuarm6496.7%none1.6%11288 0.0%none98.4%
9571 9578 BSP/QEMU: morty branchqemumips100.0%none0.0%none0.0%none100.0%
9572 9579 BSP/QEMU: morty branchqemumips64100.0%none0.0%none0.0%none100.0%
9573 9580 BSP/QEMU: morty branchqemuppc100.0%none0.0%none0.0%none100.0%
9610 Runtime: morty branchuser-preference (any supported environment)85.7%none14.3%12240 0.0%none100.0%
Total: 35


Bug Status


Test Case Status Report
StatusCount
BLOCKED8
FAILED125
IDLE1
PASSED2637
Total: 2771

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12854[2.2.4.rc1][BSP Auto] [genericx86-64 on MMAX64bit] [test_parselogs] blk_update_request: I/O error, dev loop0UndecidedBruce Ashfield ---RESOLVEDWONTFIX---2018-07-12
Build Testing
12838[2.2.4 rc1] wic-tools failed bitbakeUndecidedRoss BurtonAaron Chan2.2.4RESOLVEDNOTABUGRegression (Found by QA test)2018-07-02


High and M+ issuesFound during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12590[2.4.2 rc2] No. of Chars/sec For Yocto Image is very Low To that of UbuntuMedium+Ross BurtonAshwin Soman2.4.4RESOLVEDFIXED---2018-03-08
Sato
11288X Server fails to start on qemuarm64 (need CONFIG_FB?)Medium+Jon Mason 2.7 M3ACCEPTED---2017-04-03

Other Bugs found during QA Test (NOT NEW)

IDSummary (3 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
12846Runqemu MACHINE values need better error reportingMediumJagadeesh Krishnanjanappa 2.6RESOLVEDFIXED---2018-07-09
OE-Core
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureNEW---2018-01-18
Toaster
12591[2.4.2 rc2] Run again button from all builds page must run the specified taskMediumDavid ReynaToaster default assignee2.99NEW---2018-03-08

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run can be found on the Performance Test wiki. The below charts are displaying the build performance trend for 2.1 M4 to 2.3 M3. Performance execution has had 3 stages, one executed from 1.6 to 2.1 in RO, second executed from 2.1 to 2.5 m1 rc3 in GDC, third executed from 2.5 m2 rc1 onward in Linux Foundation, there are differences between HW used in all locations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results in below are both executed from the same machines in Linux Foundation.

     Performance test result for 2.2.3.rc2 not available as tests failed with distcc error. 

Ww29-2k18 - table.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.2.3.rc2

< FULL_LOG


Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 354 26 93.16 93.16
attr 143 143 0 100.0 100.0
bash 76 72 4 94.74 94.74
bluez5 25 25 0 100.0 100.0
busybox 487 480 7 98.56 98.26 Up rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 16 16 0 100.0 100.0
e2fsprogs 1 0 1 0.0 0.0
gawk 284 283 1 99.65 99.65
gdbm 22 22 0 100.0 100.0
gdk-pixbuf 17 17 0 100.0 100.0
glib-2.0 280 272 8 97.14 99.2 Down rate.png
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libxml2 85 82 3 96.47 96.47
lttng-tools 2499 2494 5 99.8 99.8
nettle 87 86 1 98.85 98.85
openssh 56 56 0 100.0 100.0
openssl 52 52 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2263 2262 1 99.96 99.96
perl5 2263 2262 1 99.96 99.96
python 32055 31937 118 99.63 99.55 Up rate.png
quilt 55 54 1 98.18 98.18
strace 264 263 1 99.62 99.62
tcl 148 148 0 100.0 98.65 Up rate.png
util-linux 130 128 2 98.46 98.47 Down rate.png
valgrind 553 2 551 0.36 0.36
zlib 2 2 0 100.0 100.0


Detailed Report

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Meta-yocto

Status

Bugs

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda