WW22 - 2017-06-05 - Full Point Release Test Cycle 2.2.2 rc1

From Yocto Project
Jump to: navigation, search

Contents

Testing data

 Test type:   Full Point Release Test Cycle 
 Branch: morty
 Build name: 2.2.2 rc1
 poky commit: d05941ae4567def4a288894717e5f550da246107
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.2.2.rc1/
 Distributions tested: 
 -Ubuntu 16.04
 -Ubuntu 14 04 
 -OpenSuse 421
 -Opensuse 13.2  
 -Debian 8
 -Centos 7
 -Fedora 23
 -Fedora 24 

Test Run Summary Report

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
7388 7389 eSDK: morty branchCentos 7.1100.0%none0.0%none0.0%none100.0%
7347 7348 ADT: morty branchFedora 25 i686100.0%none0.0%none0.0%none100.0%
7349 7350 ADT: morty branchUbuntu 16.04 x86_64100.0%none0.0%none0.0%none100.0%
7386 Eclipse-Plugin: morty branchMars on Fedora 22 x86_64,100.0%none0.0%none0.0%none100.0%
7387 Eclipse-Plugin: morty branchNeon on Fedora 22 x86_64100.0%none0.0%none0.0%none100.0%
7391 Meta-yocto: morty branchUbuntu 14.04 x86_6483.3%none16.7%11064 11604 0.0%none100.0%
7400 Build-Appliance: morty branchuser-preference100.0%none0.0%none0.0%none100.0%
7392 OE-Core:morty branchCentOS 7.1 x86_64100.0%none0.0%none0.0%none100.0%
7393 OE-Core:morty branchDebian 8 x86_64100.0%none0.0%none0.0%none100.0%
7395 OE-Core:morty branchFedora 24 x86_64100.0%none0.0%none0.0%none100.0%
7394 OE-Core:morty branchFedora 25 x86_64100.0%none0.0%none0.0%none100.0%
7396 OE-Core:morty branchOpenSuse 13.2 x86_64100.0%none0.0%none0.0%none100.0%
7397 OE-Core:morty branchOpenSuse421 x86_64100.0%none0.0%none0.0%none100.0%
7398 OE-Core:morty branchUbuntu 16.04 x86_6499.5%none0.5%11606 0.0%none100.0%
7399 OE-Core:morty branchUbuntu 16.10 x86-6499.5%none0.5%11565 0.0%none100.0%
7352 BitBake: morty branchFedora 24 x86_64100.0%none0.0%none0.0%none100.0%
7381 BSP/QEMU: morty branchBeaglebone Black100.0%none0.0%none0.0%none100.0%
7355 BSP/QEMU: morty branchBeaglebone-Black100.0%none0.0%none0.0%none100.0%
7356 7382 BSP/QEMU: morty branchEdgeRouter100.0%none0.0%none0.0%none100.0%
7374 BSP/QEMU: morty branchgenericx86 - on MMAX32bit98.1%none1.9%10455 9271 0.0%none100.0%
7375 BSP/QEMU: morty branchgenericx86-64 on MMAX6498.1%none1.9%10455 0.0%none100.0%
7376 BSP/QEMU: morty branchgenericx86-64 on NUC98.1%none1.9%10455 0.0%none100.0%
7384 BSP/QEMU: morty branchgenericx86-64-lsb on MMAX64100.0%none0.0%none0.0%none100.0%
7383 BSP/QEMU: morty branchgenericx86-64-lsb on NUC100.0%none0.0%none0.0%none100.0%
7377 BSP/QEMU: morty branchgenericx86-64-WIC on MMAX64100.0%none0.0%none0.0%none100.0%
7378 BSP/QEMU: morty branchgenericx86-64-WIC on NUC100.0%none0.0%none0.0%none100.0%
7354 BSP/QEMU: morty branchGenericx86-64_NUC100.0%none0.0%none0.0%none100.0%
7385 BSP/QEMU: morty branchgenericx86-lsb on MMAX32bit96.2%none3.8%11607 0.0%none100.0%
7379 BSP/QEMU: morty branchgenericx86-WIC on MMAX32100.0%9271 0.0%none0.0%none100.0%
7353 BSP/QEMU: morty branchGenericx86_MMAX32100.0%none0.0%none0.0%none100.0%
7357 7380 BSP/QEMU: morty branchMPC8315e-rdb100.0%none0.0%none0.0%none100.0%
7358 7365 BSP/QEMU: morty branchqemu-x86100.0%none0.0%none0.0%none100.0%
7359 7366 BSP/QEMU: morty branchqemuarm100.0%none0.0%none0.0%none100.0%
7360 7367 BSP/QEMU: morty branchqemuarm64100.0%none0.0%none0.0%none100.0%
7361 7368 BSP/QEMU: morty branchqemumips100.0%10025 0.0%none0.0%none100.0%
7362 7369 BSP/QEMU: morty branchqemumips6498.4%none1.6%10456 0.0%none100.0%
7363 7370 BSP/QEMU: morty branchqemuppc100.0%none0.0%none0.0%none100.0%
7364 7371 BSP/QEMU: morty branchqemux86-64100.0%none0.0%none0.0%none100.0%
7372 BSP/QEMU: morty branchqemux86-lsb98.0%none2.0%11598 0.0%none100.0%
7373 BSP/QEMU: morty branchqemux86_64-lsb98.1%none1.9%11598 0.0%none100.0%
7390 Runtime: morty branchVMWare Player on Ubuntu100.0%11611 0.0%none0.0%none100.0%
Total: 41


Bug Status


Test Case Status Report
StatusCount
FAILED14
PASSED3087
RUNNING15
Total: 3116



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (6 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
11598[morty]testimage quemux86-64 lsb genericx86-64 getty[1309]: tcgetattr: Input/output error^MMedium+Choong Yin Thongoscar lopez arandas2.2.2VERIFIEDFIXED---2017-05-31
11607[morty] Testimage lsb image trow multiple smart errorsMedium+Juan Ramos 2.2.2VERIFIEDNOTABUG---2017-06-02
General Runtime
11611[morty] Compliance test lsb-setup-4.1.0-1.noarch.rpm download failMedium+Richard Purdie 2.2.2RESOLVEDFIXED---2017-06-05
OE-Core
11565morty self-test errorsMedium+Ross Burton 2.2.2RESOLVEDFIXED---2017-05-22
11604[Yocto 2.2.2] crosstap doesn't workMedium+Armin KusterYi Zhao2.2.2VERIFIEDFIXEDRegression (Used to work)2017-06-02
11606[morty] OE-Core test_recipetool_create (oeqa.selftest.recipetool.RecipetoolTests)Medium+Ross Burton 2.2.2VERIFIEDFIXED---2017-06-02


High and M+ issues Found during QA Test (NOT NEW)

IDSummary (2 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
BSPs
10456X can not launch on qemumips64Medium+Armin KusterYi Zhao2.2.2VERIFIEDFIXEDRegression (Used to work)2016-10-19
Meta-yocto
11064[Yocto 2.2.1] kernel version mismatched when using yocto-bsp to create custom qemu bspMedium+Armin KusterYi Zhao2.2.2RESOLVEDFIXEDRegression (Used to work)2017-02-17


Other Bugs found during QA Test (NOT NEW)

IDSummary (3 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
10455[morty][Test Case 1059] Parselogs is failing on genericx86 (32 and 64 bits) giving error: blk_update_request: I/O error, dev loop0MediumCalifornia Sullivanyeoh ee peng2.5 M3RESOLVEDFIXED---2016-10-18
Regression (Found by QA test)
9271dmi firmware registration failed, ioremap error on 32 bit MinnowBoardMediumCalifornia SullivanJuan Ramos2.2RESOLVEDWONTFIXRegression (Found by QA test)2016-03-16
Regression (Used to work)
10025Missing 'Connection Manager' icon for qemumips and qemumips64MediumJussi KukkonenYi Zhao2.4RESOLVEDWORKSFORMERegression (Used to work)2016-07-26


Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. Performance execution can be divided in 2 stages, the first was executed form 1.6 to 2.1 by the Rumania (RO) team and the latest started on 2.1 executed by the Guadalajara (GDC) team. There are differences between HW used in both location hence the numbers are different. For more details click on the following links:


Below charts show the build performance trend for 2.1 M4 to 2.3 rc4 and the latest performance results taken from 2.2.2 point release.

Performance Charts

For Bitbake core-image-sato with rm_work

Ww22-2k17 - rmwork.png

Building the Virtual kernel

Ww22-2k17 - kernel.png

Building the rootfs

Ww22-2k17 - rootfs.png

Building core-image-sato

Ww22-2k17 - sato.png

Ww22-2k17 - esdk.png


Detailed Report

Distro Testing

Core Build System

Bitbake

Status

Bugs

**No results**

Agenda

Meta-Yocyo

Status

Bugs

Agenda

OE-Core

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

eSDK

Status

Test Case Status Report

Bugs

**No results**

Agenda

Test Run Agenda

BSP

genericx86: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda

genericx86_64: core-image-sato-sdk

Status

Test Case Status Report

Bugs

Bug Status Report

Agenda

Test Run Agenda