WW26 - 2017-30-06 - Full Pass 2.1.3 rc2: Difference between revisions

From Yocto Project
Jump to navigationJump to search
No edit summary
Line 13: Line 13:
=Testing data=  
=Testing data=  
  <nowiki>  
  <nowiki>  
  Test type:  
  Test type: Full Pass Test
  Branch:  
  Branch: krogoth
  Build name:  
  Build name: yocto-2.1.3.rc2
  poky commit:  
  poky commit: 3cf0e093481ea260d4f41bed24336ea7f0102bde
  Autobuilder images repository:  
  Autobuilder images repository: https://autobuilder.yocto.io/srv/autobuilder/autobuilder.yoctoproject.org/pub/releases/yocto-2.1.3.rc2/
  Distributions tested:  
  Distributions tested:
      Ubuntu
  </nowiki>  
  </nowiki>  
{|
{|
Line 44: Line 45:
|report_id=status}}
|report_id=status}}
|}
|}
= Bugs Found during QA Test =
= Bugs Found during QA Test =
== <span style="color:blue; "> New issues Found during QA Test & Community </span>==
== <span style="color:blue; "> New issues Found during QA Test & Community </span>==

Revision as of 19:45, 30 June 2017

{{#vardefine:1_ADT_Fedora_25_i686| 7627}} {{#vardefine:2_ADT_Fedora_25_i686| 7628}} {{#vardefine:3_ADT_Ubuntu_16.04_x86_64| 7629}} {{#vardefine:4_ADT_Ubuntu_16.04_x86_64| 7630}} {{#vardefine:5_BSPs_Genericx86_MMAX32| 7632}} {{#vardefine:6_BSPs_genericx86_-_on_MMAX32bit| 7653}} {{#vardefine:7_BSPs_genericx86-64-lsb_on_NUC| 7662}} {{#vardefine:8_Meta-yocto_Ubuntu_14.04_x86_64| 7668}} {{#vardefine:9_OE-Core_Ubuntu_16.10_x86-64| 7676}}

Testing data

 
 Test type: Full Pass Test
 Branch: krogoth
 Build name: yocto-2.1.3.rc2
 poky commit: 3cf0e093481ea260d4f41bed24336ea7f0102bde
 Autobuilder images repository: https://autobuilder.yocto.io/srv/autobuilder/autobuilder.yoctoproject.org/pub/releases/yocto-2.1.3.rc2/
 Distributions tested:
      Ubuntu 
  
{{#testopia: run_id=0, {{#var:1_ADT_Fedora_25_i686}}, {{#var:2_ADT_Fedora_25_i686}}, {{#var:3_ADT_Ubuntu_16.04_x86_64}}, {{#var:4_ADT_Ubuntu_16.04_x86_64}}, {{#var:5_BSPs_Genericx86_MMAX32}}, {{#var:6_BSPs_genericx86_-_on_MMAX32bit}}, {{#var:7_BSPs_genericx86-64-lsb_on_NUC}}, {{#var:8_Meta-yocto_Ubuntu_14.04_x86_64}}, {{#var:9_OE-Core_Ubuntu_16.10_x86-64}} report_id=concatstats}}


{{#testopia: run_id=0, {{#var:1_ADT_Fedora_25_i686}}, {{#var:2_ADT_Fedora_25_i686}}, {{#var:3_ADT_Ubuntu_16.04_x86_64}}, {{#var:4_ADT_Ubuntu_16.04_x86_64}}, {{#var:5_BSPs_Genericx86_MMAX32}}, {{#var:6_BSPs_genericx86_-_on_MMAX32bit}}, {{#var:7_BSPs_genericx86-64-lsb_on_NUC}}, {{#var:8_Meta-yocto_Ubuntu_14.04_x86_64}}, {{#var:9_OE-Core_Ubuntu_16.10_x86-64}} chart=bstatus report_id=bugs charttype=bar sortable=true nudechart=true chartpos=top

}}


{{#testopia: run_id=0, {{#var:1_ADT_Fedora_25_i686}}, {{#var:2_ADT_Fedora_25_i686}}, {{#var:3_ADT_Ubuntu_16.04_x86_64}}, {{#var:4_ADT_Ubuntu_16.04_x86_64}}, {{#var:5_BSPs_Genericx86_MMAX32}}, {{#var:6_BSPs_genericx86_-_on_MMAX32bit}}, {{#var:7_BSPs_genericx86-64-lsb_on_NUC}}, {{#var:8_Meta-yocto_Ubuntu_14.04_x86_64}}, {{#var:9_OE-Core_Ubuntu_16.10_x86-64}} charttype=bar report_id=status}}

Bugs Found during QA Test

New issues Found during QA Test & Community

"None"


High and M+ issuesFound during QA Test (NOT NEW)

"None"

Other Bugs found during QA Test (NOT NEW)

"None"

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestoneor release which are Medium+ or High and are not targetedfor the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      

Bug Trend

An overview of thisweek's Yocto Bug Trend charts can be accessed on thefollowing [1]

Build Performance Test

Detailed description on how performance test is run canbe found on the Performance Test wiki. The belowcharts are displaying the build performance trend for 2.1M4 to 2.3 M3. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1.6 to 2.1in RO and are differences between HW used in bothlocations, hence the numbers are different.

Below chars are showing the latestperformance results taken from the current milestone.

Performance Charts

For Bitbake core-image-sato withrm_work

Ww19-2k17 - rmwork.png

Building the Virtual kernel

Ww19-2k17 - kernel.png

Building the rootfs

Ww19-2k17 - rootfs.png

Building core-image-sato

Ww19-2k17 - sato.png

eSDK Deploy time

Ww19-2k17 - esdk.png

pTest for genericx86-64 on NUC

open bugs

"None"

results

< Back
Ran on a NUC and compared with commit Ptest 7a0e795373653886452a7a2992ced10080711c26

FULL LOG


Failures
% increased
% decreased


Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.00% 100.00%
attr 143 143 0 100.00% 100.00%
bash 76 72 4 94.70% 94.70%
bluez5 25 25 0 100.00% 100.00%
busybox 486 478 8 98.40% 98.40%
bzip2 6 6 0 100.00% 100.00%
dbus-test 15 4 11 26.70% 26.70%
diffstat 440 440 0 100.00% 100.00%
diffutils 17 17 0 100.00% 100.00%
e2fsprogs 1 1 0 100.00% 100.00%
flex 114 114 0 100.00% 100.00%
gawk 298 297 1 99.70% 99.70%
gdbm 22 22 0 100.00% 100.00%
gdk-pixbuf 20 20 0 100.00% 100.00%
glib-2.0 284 277 7 97.50% 97.50%
kbd 7 7 0 100.00% 100.00%
libpcre 3 3 0 100.00% 100.00%
libxml2 85 82 3 96.50% 96.50%
lttng-tools 2057 1988 69 96.60% 96.60%
nettle 88 87 1 98.90% 98.90%
openssh 34 33 1 97.10% 97.10%
openssl 52 52 0 100.00% 100.00%
pango 12 12 0 100.00% 100.00%
perl 2286 2285 1 100.00% 100.00%
perl5 2286 2285 1 100.00% 100.00%
python 32230 32212 118 99.60% 99.60%
quilt 57 57 0 100.00 100.00%
strace 335 334 1 99.70% 99.70%
tcl 148 147 1 99.30% 98.60%
util-linux 108 106 2 98.10% 98.10%
valgrind 553 296 257 53.50% 53.50%
zlib 2 2 0 100.00% 100.00%

Detailed Report

ADT

Status {{#testopia:

run_id={{#var:1_ADT_Fedora_25_i686}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:1_ADT_Fedora_25_i686}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:1_ADT_Fedora_25_i686}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Status {{#testopia:

run_id={{#var:2_ADT_Fedora_25_i686}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:2_ADT_Fedora_25_i686}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:2_ADT_Fedora_25_i686}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Status {{#testopia:

run_id={{#var:3_ADT_Ubuntu_16.04_x86_64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:3_ADT_Ubuntu_16.04_x86_64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:3_ADT_Ubuntu_16.04_x86_64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Status {{#testopia:

run_id={{#var:4_ADT_Ubuntu_16.04_x86_64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:4_ADT_Ubuntu_16.04_x86_64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:4_ADT_Ubuntu_16.04_x86_64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

BSPs

Status {{#testopia:

run_id={{#var:5_BSPs_Genericx86_MMAX32}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:5_BSPs_Genericx86_MMAX32}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:5_BSPs_Genericx86_MMAX32}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Status {{#testopia:

run_id={{#var:6_BSPs_genericx86_-_on_MMAX32bit}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:6_BSPs_genericx86_-_on_MMAX32bit}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:6_BSPs_genericx86_-_on_MMAX32bit}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Status {{#testopia:

run_id={{#var:7_BSPs_genericx86-64-lsb_on_NUC}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:7_BSPs_genericx86-64-lsb_on_NUC}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:7_BSPs_genericx86-64-lsb_on_NUC}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

Meta-yocto

Status {{#testopia:

run_id={{#var:8_Meta-yocto_Ubuntu_14.04_x86_64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:8_Meta-yocto_Ubuntu_14.04_x86_64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:8_Meta-yocto_Ubuntu_14.04_x86_64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}

OE-Core

Status {{#testopia:

run_id={{#var:9_OE-Core_Ubuntu_16.10_x86-64}} showhide=true hidden=true report_id=status charttype=pie3}}

Bugs {{#testopia:

run_id={{#var:9_OE-Core_Ubuntu_16.10_x86-64}} report_id=bugs chart=bstatus,prio,severity charttype=pie,pie,pie showhide=true hidden=true}}

Agenda {{#testopia:

run_id={{#var:9_OE-Core_Ubuntu_16.10_x86-64}} report_id=agenda showhide=true hidden=true reportoptions=withdependency=false}}