WW51 - 2017-12-21- Full Test Cycle - 2.4.1 rc1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 
 Test type: Full Pass Test
 Branch: rocko
 Build name: yocto-2.4.1.rc1
 poky commit: c2b641c8a0c4fd71fcb477d788a740c2c26cddce 
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.4.1.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Tumbleweed
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
8659 8660 eSDK: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
8656 8681 CROPS: rocko branchUbuntu 16.0477.8%none22.2%11015 12357 0.0%none100.0%
8616 8617 ADT: rocko branchFedora 26 i68697.5%none0.0%none2.5%none100.0%
8618 8619 ADT: rocko branchUbuntu 16.04 x86_6497.5%none0.0%none2.5%none100.0%
8662 Kernel: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
8658 Eclipse-Plugin: rocko branchNeon - Fedora 2485.7%12416 12417 14.3%none0.0%none100.0%
8657 Eclipse-Plugin: rocko branchOxygen - Fedora2685.7%none14.3%none0.0%none100.0%
8663 Meta-yocto: rocko branchUbuntu 16.04 x86_6478.3%none21.7%12443 12445 0.0%none100.0%
8677 Build-Appliance: rocko branchuser-preference100.0%none0.0%none0.0%none100.0%
8672 8673 Toaster: rocko branchUbuntu 16.04 x86_6495.7%none4.3%none0.0%none100.0%
8664 OE-Core: rocko branchCentOS 7 x86_6499.6%none0.4%none0.0%none100.0%
8665 OE-Core: rocko branchDebian 9 x86_6496.8%none0.0%none0.0%none96.8%
8666 OE-Core: rocko branchFedora 26 x86_6495.7%none0.0%none0.0%none95.7%
8667 OE-Core: rocko branchFedora 27 x86_6496.0%none0.0%none0.0%none96.0%
8669 OE-Core: rocko branchOpenSuse 42.3 x86_6499.6%none0.4%none0.0%none100.0%
8668 OE-Core: rocko branchTumbleweed95.3%none0.0%none0.0%none95.3%
8670 OE-Core: rocko branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
8671 OE-Core: rocko branchUbuntu 17.10 x86-64100.0%none0.0%none0.0%none100.0%
9252 BitBake: rocko branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
8651 BSP/QEMU: rocko branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
8623 BSP/QEMU: rocko branchBeaglebone-Black95.5%none4.5%12131 0.0%none100.0%
8652 8679 BSP/QEMU: rocko branchEdgeRouter100.0%none0.0%none0.0%none100.0%
8644 BSP/QEMU: rocko branchgenericx86 - on MMAX32bit95.5%none4.5%none0.0%none100.0%
8645 BSP/QEMU: rocko branchgenericx86-64 on MMAX6482.6%none2.2%12214 0.0%none84.8%
8646 BSP/QEMU: rocko branchgenericx86-64 on NUC97.8%none2.2%12214 0.0%none100.0%
8812 BSP/QEMU: rocko branchgenericx86-64-lsb on MMAX6493.8%none4.2%12214 12444 0.0%none97.9%
8810 BSP/QEMU: rocko branchgenericx86-64-lsb on NUC100.0%none0.0%none0.0%none100.0%
8647 BSP/QEMU: rocko branchgenericx86-64-WIC on MMAX64100.0%none0.0%none0.0%none100.0%
8648 BSP/QEMU: rocko branchgenericx86-64-WIC on NUC97.8%none2.2%12214 0.0%none100.0%
8622 BSP/QEMU: rocko branchGenericx86-64_NUC92.9%none0.0%none7.1%none100.0%
8811 BSP/QEMU: rocko branchgenericx86-lsb on MMAX32bit95.6%none4.4%none0.0%none100.0%
8649 BSP/QEMU: rocko branchgenericx86-WIC on MMAX3295.5%none4.5%none0.0%none100.0%
8621 BSP/QEMU: rocko branchGenericx86_MMAX3290.7%none7.0%none2.3%none100.0%
8625 8650 BSP/QEMU: rocko branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
8626 8633 BSP/QEMU: rocko branchqemu-x86100.0%none0.0%none0.0%none100.0%
8627 8634 BSP/QEMU: rocko branchqemuarm100.0%none0.0%none0.0%none100.0%
8628 8635 BSP/QEMU: rocko branchqemuarm64100.0%none0.0%none0.0%none100.0%
8629 8636 BSP/QEMU: rocko branchqemumips100.0%none0.0%none0.0%none100.0%
8630 8637 BSP/QEMU: rocko branchqemumips64100.0%none0.0%none0.0%none100.0%
8631 8638 BSP/QEMU: rocko branchqemuppc100.0%none0.0%none0.0%none100.0%
8632 8639 BSP/QEMU: rocko branchqemux86-64100.0%none0.0%none0.0%none100.0%
8640 BSP/QEMU: rocko branchqemux86-64-WIC,100.0%none0.0%none0.0%none100.0%
8642 BSP/QEMU: rocko branchqemux86-lsb100.0%none0.0%none0.0%none100.0%
8641 BSP/QEMU: rocko branchqemux86-WIC100.0%none0.0%none0.0%none100.0%
8643 BSP/QEMU: rocko branchqemux86_64-lsb100.0%none0.0%none0.0%none100.0%
8661 Runtime: rocko branchuser-preference (any supported environment)87.5%none0.0%none0.0%none87.5%
8676 Package-Management-Issues: rocko branchAny Supported Distro100.0%none0.0%none0.0%none100.0%
Total: 47


Bug Status


Test Case Status Report
StatusCount
BLOCKED10
ERROR8
FAILED30
IDLE54
PASSED3799
RUNNING1
Total: 3902

Bugs Found during QA Test

New issues Found during QA Test & Community

IDSummary (5 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
12444[Test Case 1542] test_2_logrotate fails in MinnowMax with core-image-lsb-sdk-genericx86-64 imageMedium+yeoh ee peng 2.5 M2RESOLVEDINVALID---2017-12-21
Development Manual
12417Eclipse installer steps only apply to latest Eclipse releaseMedium+Kristi 2.6 M4RESOLVEDFIXED---2017-12-12
Infrastructure General
12416autobuilder.yocto.io directory index does not display the full long filenameMediumMichael Halstead ---RESOLVEDFIXED---2017-12-12
OE-Core
12443[Test Case 312,313] Bitbake failed after using yocto-kernel add patchUndecidedStephano Cetola ---RESOLVEDWONTFIX---2017-12-21
12445[Test Case 309,310,311] Bitbake fails after add layer with yocto-bsp createUndecidedStephano Cetola ---RESOLVEDWONTFIX---2017-12-21


High and M+ issuesFound during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
AutoBuilder
12357devtool sdk-install unable to add componentMedium+Joshua Lock 2.5 M2RESOLVEDFIXED---2017-11-16
BSPs
12131Kernel traceback when reboot beaglebone blackMedium+Kevin HaoYi Zhao2.5 M3VERIFIEDFIXEDRegression (Used to work)2017-09-27

Other Bugs found during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
12214[TC 1059] [test_parselogs] failed on MMAX64 (Turbot, WIC image) : usb 1-3: device descriptor read/64, error -71Mediumnagarajagopalpravin4.99RESOLVEDFIXED---2017-10-10
OE-Core
11015devtool: fails to add node.js project that has local dependencyMediumUnassigned FutureNEW---2017-02-04

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.4 M4 rc3 to 2.4.1.rc1. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 2.1 to 2.4 in GDC and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Results

Ww50-2k17 - table.png

For Bitbake core-image-sato withrm_work

Ww50-2k17 - rmwork.png

Building the Virtual kernel

Ww50-2k17 - kernel.png

Building the rootfs

Ww50-2k17 - rootfs.png

Building core-image-sato

Ww50-2k17 - sato.png

eSDK Deploy time

Ww50-2k17 - esdk.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Archive


Ran on a NUC and compared with 2.4_M4_rc3

FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 76 3 96.2 96.2
bluez5 7 7 0 100.0 100.0
busybox 518 509 9 98.26 98.26
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 19 19 0 100.0 100.0
e2fsprogs 309 265 44 85.76 85.76
flex 114 114 0 100.0 100.0
gawk 298 298 0 100.0 99.66 Up rate.png
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 253 253 0 100.0 100.0
gzip 18 18 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 2 1 66.67 66.67
libxml2 133 133 0 100.0 100.0
lttng-tools 2057 1988 69 96.65 96.65
nettle 88 88 0 100.0 98.86 Up rate.png
openssh 58 58 0 100.0 100.0
openssl 52 52 0 100.0 100.0
pango 12 12 0 100.0 100.0
perl 2287 2286 1 99.96 99.96
perl5 2287 2286 1 99.96 99.96
python 32486 32354 132 99.59 99.61 Down rate.png
quilt 57 57 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 356 355 1 99.72 99.72
tcl 45 45 0 100.0 98.65 Up rate.png
util-linux 352 341 11 96.88 82.93 Up rate.png
valgrind 559 299 260 53.49 53.49
zlib 2 2 0 100.0 100.0

Detailed Report

ADT

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

BitBake

Status

Bugs

**No results**

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

CROPS

Status

Bugs

**No results**

Agenda

Eclipse Plugin

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

eSDK

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

General Runtime

Status

Bugs

**No results**

Agenda

Kernel

Status

Bugs

**No results**

Agenda

Meta-yocto

Status

Bugs

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda