WW46 - 2018-11-14 - Full Test Cycle 2.4.4 RC1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

  
 Test type: Full Pass Test
 Branch: Master
 Build name: Yocto-2.4.4.rc1
 poky commit: 940da2e688cc6ae3cc3d95842033c3e51bd9fe29
 Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.4.4.rc1
 Distributions tested: 
      CentOs 7
      Debian 9
      Fedora 26
      Fedora 27
      OpenSuse 42.3
      Ubuntu 16.04
      Ubuntu 17.10
  
Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
10873 10874 eSDK: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10869 10870 CROPS: rocko branchUbuntu 16.0488.9%none11.1%11431 0.0%none100.0%
10878 10879 ADT: rocko branchFedora 26 i686100.0%none0.0%none0.0%none100.0%
10877 10880 ADT: rocko branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
10875 Kernel: rocko branchUbuntu 16.04100.0%none0.0%none0.0%none100.0%
10872 Eclipse-Plugin: rocko branchNeon - Fedora 24100.0%none0.0%none0.0%none100.0%
10871 Eclipse-Plugin: rocko branchOxygen - Fedora26100.0%none0.0%none0.0%none100.0%
10867 Build-Appliance: rocko branchVMWare Player on Ubuntu66.7%none33.3%12991 0.0%none100.0%
10868 Toaster: rocko branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
10860 OE-Core: rocko branchCentOS 7 x86_64100.0%none0.0%none0.0%none100.0%
10861 OE-Core: rocko branchDebian 9 x86_64100.0%none0.0%none0.0%none100.0%
10862 OE-Core: rocko branchFedora 26 x86_64100.0%none0.0%none0.0%none100.0%
10863 OE-Core: rocko branchFedora 27 x86_64100.0%none0.0%none0.0%none100.0%
10864 OE-Core: rocko branchOpenSuse 42.3 x86_64100.0%none0.0%none0.0%none100.0%
10865 OE-Core: rocko branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
10866 OE-Core: rocko branchUbuntu 17.10 x86_64100.0%none0.0%none0.0%none100.0%
10828 BitBake: rocko branchUbuntu 16.04 x86_6471.4%none28.6%12670 13033 0.0%none100.0%
10830 10851 BSP/QEMU: rocko branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
10852 BSP/QEMU: rocko branchEdgeRouter100.0%none0.0%none0.0%none100.0%
10847 BSP/QEMU: rocko branchgenericx86 on MTURBOT32100.0%none0.0%none0.0%none100.0%
10848 BSP/QEMU: rocko branchgenericx86-64 on MTURBOT64100.0%none0.0%none0.0%none100.0%
10849 BSP/QEMU: rocko branchgenericx86-64 on NUC6100.0%none0.0%none0.0%none100.0%
10829 10850 BSP/QEMU: rocko branchgenericx86-64 on NUC7100.0%none0.0%none0.0%none100.0%
10855 BSP/QEMU: rocko branchgenericx86-64-WIC on MTURBOT6497.9%none0.0%none2.1%none100.0%
10856 BSP/QEMU: rocko branchgenericx86-64-WIC on NUC697.9%none0.0%none2.1%none100.0%
10857 BSP/QEMU: rocko branchgenericx86-64-WIC on NUC797.9%none0.0%none2.1%none100.0%
10854 BSP/QEMU: rocko branchgenericx86-WIC on MTURBOT3297.9%none0.0%none2.1%none100.0%
10832 10853 BSP/QEMU: rocko branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
10833 10840 BSP/QEMU: rocko branchqemu-x86100.0%none0.0%none0.0%none100.0%
10834 10841 BSP/QEMU: rocko branchqemu-x86-64100.0%none0.0%none0.0%none100.0%
10859 BSP/QEMU: rocko branchqemu-x86-64-WIC100.0%none0.0%none0.0%none100.0%
10858 BSP/QEMU: rocko branchqemu-x86-WIC100.0%none0.0%none0.0%none100.0%
10835 10842 BSP/QEMU: rocko branchqemuarm96.3%none3.7%12499 0.0%none100.0%
10836 10843 BSP/QEMU: rocko branchqemuarm64100.0%none0.0%none0.0%none100.0%
10837 10844 BSP/QEMU: rocko branchqemumips100.0%none0.0%none0.0%none100.0%
10838 10845 BSP/QEMU: rocko branchqemumips64100.0%none0.0%none0.0%none100.0%
10839 10846 BSP/QEMU: rocko branchqemuppc100.0%none0.0%none0.0%none100.0%
10876 Runtime: rocko branchuser-preference (any supported environment)88.9%none11.1%12240 0.0%none100.0%
10882 Package-Management-Issues: rocko branchAny Supported Distro66.7%none33.3%13038 0.0%none100.0%
Total: 39


Bug Status


Test Case Status Report
StatusCount
BLOCKED4
FAILED8
PASSED3318
Total: 3330

Bugs Found during QA Test

New issues Found during QA Test & Community

BitBake
13033[2.4.4RC1] [Bitbake] [Case 142] PR number is not getting increased with remote server/local client modeMediumpankaj yadav 2.4.5RESOLVEDNOTABUG---2018-11-21
Package Management Issues
13038[2.4.4RC1][Package Management][Getting Error Message "Failed to synchronize cache for repo 'repository'"]UndecidedRoss Burton ---RESOLVEDNOTABUG---2018-11-22


High and M+ issuesFound during QA Test (NOT NEW)

"None"
Runtime
12991[2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk packageMedium+Richard Purdie 2.8 M1RESOLVEDFIXED---2018-11-09

Other Bugs found during QA Test (NOT NEW)

---
11431Crops-ESDK: devtool is unable to add recipe for nodejs-native recipeMediumAnuj Mittalnagarajagopal2.7RESOLVEDNOTABUG---2017-04-27
---
12670[2.5 M3 RC1]MANUAL_BitBake:test dependancy explorer is launched with failed logsUndecidedStephano Cetola 2.6RESOLVEDFIXED---2018-04-10
---
12499[2.5 M1 RC3] qemuarm: failed to shutdownLowJon Mason FutureRESOLVEDWONTFIX---2018-01-18

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

Note: performance test results in below are both executed from the same machines in Linux Foundation.

WW46 2k18 - table 2.4.4.rc1.PNG

pTest for genericx86-64 on NUC

< Archive


Ran on a NUC and compared with 2.4.3.rc2

< FULL_LOG

Failures
 % increased
 % decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 76 3 96.2 96.2
bluez5 7 7 0 100.0 100.0
busybox 518 509 9 98.26 98.26
bzip2 6 6 0 100.0 100.0
dbus-test 15 4 11 26.67 26.67
diffstat 440 440 0 100.0 100.0
diffutils 19 19 0 100.0 100.0
e2fsprogs 309 265 44 85.76 85.44 Up rate.png
flex 114 114 0 100.0 100.0
gawk 298 298 0 100.0 100.0
gdbm 25 25 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 253 253 0 100.0 100.0
gzip 18 18 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libxml2 134 134 0 100.0 0 Up rate.png
lttng-tools 2089 2020 69 96.7 96.7
lzo 5 5 0 100.0 100.0
nettle 88 88 0 100.0 100.0
openssh 58 58 0 100.0 100.0
openssl 53 53 0 100.0 96.23 Up rate.png
pango 12 12 0 100.0 100.0
perl 2286 2286 0 100.0 99.87 Up rate.png
perl5 2286 2286 0 100.0 99.87 Up rate.png
python 33118 32984 134 99.6 99.44 Up rate.png
quilt 57 57 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 356 355 1 99.72 99.72
tcl 148 148 0 100.0 98.65 Up rate.png
util-linux 351 340 11 96.87 96.87
valgrind 559 300 259 53.67 53.67
zlib 2 2 0 100.0 100.0

open bugs

"None"

results

{{:Ptest <ADD HERE THE PROOPER COMMIT>}}

Detailed Report

BitBake

Status

Bugs

Agenda

BSPs

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

**No results**

Bugs

**No results**

Agenda

**No results**

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

OE-Core

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status

Bugs

**No results**

Agenda

Status