WW29 - 2017-07-18- Full Test Cycle - 2.3.1 rc2: Difference between revisions
(12 intermediate revisions by 2 users not shown) | |||
Line 64: | Line 64: | ||
=Testing data= | =Testing data= | ||
<nowiki> | <nowiki> | ||
Test type: | Test type: Full Pass Test | ||
Branch: | Branch: pyro | ||
Build name: | Build name: yocto-2.3.1.rc2 | ||
poky commit: | poky commit: 6bd890d9e011014cf323e61267f8b256949d44aa | ||
Autobuilder images repository: | Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.3.1.rc2 | ||
Distributions tested: | Distributions tested: | ||
CentOS 7.1 | |||
Debian 8 | |||
Fedora 24 | |||
Fedora 25 | |||
Ubuntu 17.04 | |||
Ubuntu 16.04 | |||
OpenSuse 422 | |||
</nowiki> | </nowiki> | ||
{| | {| | ||
Line 95: | Line 102: | ||
|report_id=status}} | |report_id=status}} | ||
|} | |} | ||
= Bugs Found during QA Test = | = Bugs Found during QA Test = | ||
== <span style="color:blue; "> New issues Found during QA Test & Community </span>== | == <span style="color:blue; "> New issues Found during QA Test & Community </span>== | ||
Line 144: | Line 152: | ||
= Build Performance Test = | = Build Performance Test = | ||
Detailed description on how performance test is run can be found on the [[Performance Test]] wiki. | Detailed description on how performance test is run can be found on the [[Performance Test]] wiki. | ||
The below charts are displaying the build performance trend from 2.1 M4 to 2.3.1 rc2. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 1 | The below charts are displaying the build performance trend from 2.1 M4 to 2.3.1 rc2. Performance execution has had 2 stages, one executed from 1.6 to 2.1 in RO and executed from 2.1 to 2.3.1 rc2 in GDC. There are differences between HW used in both locations, hence the numbers are different. | ||
* [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | * [https://wiki.yoctoproject.org/charts/perf_milestone/performance_test.html RO Charts] | ||
* [https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html GDC Charts] | * [https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html GDC Charts] | ||
Below chars are showing the | Below chars are showing the latest performance results taken from the current milestone. | ||
== Performance Charts== | == Performance Charts== | ||
Line 155: | Line 163: | ||
[[File:Ww29-2k17 - table.png | border]] | [[File:Ww29-2k17 - table.png | border]] | ||
For Bitbake core-image-sato | For Bitbake core-image-sato with rm_work | ||
[[File:Ww29-2k17 - rmwork.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/bitbake-core-image-sato-rmwork.html ]] | [[File:Ww29-2k17 - rmwork.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/perf_milestone_GDC_snapshot/bitbake-core-image-sato-rmwork.html ]] | ||
Building the Virtual kernel | Building the Virtual kernel | ||
[[File:Ww29-2k17 - kernel.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/bitbake-virtual-kernel.html]] | [[File:Ww29-2k17 - kernel.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/perf_milestone_GDC_snapshot/bitbake-virtual-kernel.html]] | ||
Building the rootfs | Building the rootfs | ||
[[File:Ww29-2k17_-_rootfs.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/bitbake-core-image-sato-rootfs.html]] | [[File:Ww29-2k17_-_rootfs.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/perf_milestone_GDC_snapshot/bitbake-core-image-sato-rootfs.html]] | ||
Building core-image-sato | Building core-image-sato | ||
[[File:Ww29-2k17_-_sato.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/bitbake-core-image-sato.html]] | [[File:Ww29-2k17_-_sato.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/perf_milestone_GDC_snapshot/bitbake-core-image-sato.html]] | ||
eSDK Deploy time | eSDK Deploy time | ||
[[File:Ww29-2k17_-_esdk.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/bitbake-eSDK.html]] | [[File:Ww29-2k17_-_esdk.png | 1280px | link=https://wiki.yoctoproject.org/charts/perf_milestone_GDC/perf_milestone_GDC_snapshot/bitbake-eSDK.html]] | ||
=pTest for genericx86-64 on NUC= | =pTest for genericx86-64 on NUC= | ||
Line 184: | Line 192: | ||
|sort=status | |sort=status | ||
|group=product | |group=product | ||
|id= | |id=11596, 5695, 8064, 4437, 11674, 6707, 8832, 10841, 11666, 5698, 8650, 11547, 5605, 11024, 4436, 11668, 8828, 11602, 5697, 8471, 6737, 9042, 10953, 11667, 10266 | ||
}} | }} | ||
== results == | == results == | ||
{{:Ptest | [[Ptest 6bd890d9e011014cf323e61267f8b256949d44aa| Results]] | ||
{{:Ptest 6bd890d9e011014cf323e61267f8b256949d44aa}} | |||
=Detailed Report= | =Detailed Report= | ||
Latest revision as of 23:45, 21 September 2017
Testing data
Test type: Full Pass Test Branch: pyro Build name: yocto-2.3.1.rc2 poky commit: 6bd890d9e011014cf323e61267f8b256949d44aa Autobuilder images repository: https://autobuilder.yocto.io/pub/releases/yocto-2.3.1.rc2 Distributions tested: CentOS 7.1 Debian 8 Fedora 24 Fedora 25 Ubuntu 17.04 Ubuntu 16.04 OpenSuse 422
{{#testopia: | run_id=0, {{#var:1_ADT_Fedora_25_i686}}, {{#var:2_ADT_Fedora_25_i686}}, {{#var:3_ADT_Ubuntu_16.04_x86_64}}, {{#var:4_ADT_Ubuntu_16.04_x86_64}}, {{#var:5_BitBake_Fedora_24_x86_64}}, {{#var:6_BSPs_Genericx86_MMAX32}}, {{#var:7_BSPs_Genericx86-64_NUC}}, {{#var:8_BSPs_Beaglebone-Black}}, {{#var:9_BSPs_EdgeRouter}}, {{#var:10_BSPs_MPC8315e-rdb}}, {{#var:11_BSPs_qemu-x86}}, {{#var:12_BSPs_qemuarm}}, {{#var:13_BSPs_qemuarm64}}, {{#var:14_BSPs_qemumips}}, {{#var:15_BSPs_qemumips64}}, {{#var:16_BSPs_qemuppc}}, {{#var:17_BSPs_qemux86-64}}, {{#var:18_BSPs_qemu-x86}}, {{#var:19_BSPs_qemuarm}}, {{#var:20_BSPs_qemuarm64}}, {{#var:21_BSPs_qemumips}}, {{#var:22_BSPs_qemumips64}}, {{#var:23_BSPs_qemuppc}}, {{#var:24_BSPs_qemux86-64,}}, {{#var:25_BSPs_qemux86-64-WIC,}}, {{#var:26_BSPs_qemux86-WIC}}, {{#var:27_BSPs_qemux86-lsb}}, {{#var:28_BSPs_qemux86_64-lsb}}, {{#var:29_BSPs_genericx86_-_on_MMAX32bit}}, {{#var:30_BSPs_genericx86-64_on_MMAX64}}, {{#var:31_BSPs_genericx86-64_on_NUC}}, {{#var:32_BSPs_genericx86-64-WIC_on_MMAX64}}, {{#var:33_BSPs_genericx86-64-WIC_on_NUC}}, {{#var:34_BSPs_genericx86-WIC_on_MMAX32}}, {{#var:35_BSPs_MPC8315e-rdb}}, {{#var:36_BSPs_Beaglebone_Black}}, {{#var:37_BSPs_EdgeRouter}}, {{#var:38_BSPs_genericx86-64-lsb_on_NUC}}, {{#var:39_BSPs_genericx86-64-lsb_on_MMAX64}}, {{#var:40_BSPs_genericx86-lsb_on_MMAX32bit}}, {{#var:41_CROPS_Centos_7.1}}, {{#var:42_Eclipse Plugin_Mars_on_Fedora_22_x86_64,}}, {{#var:43_Eclipse Plugin_Neon_on_Fedora_22_x86_64}}, {{#var:44_eSDK_Centos_7.1}}, {{#var:45_eSDK_Centos_7.1}}, {{#var:46_General Runtime_VMWare_Player_on_Ubuntu}}, {{#var:47_Kernel_Centos_7}}, {{#var:48_Meta-yocto_Ubuntu_14.04_x86_64}}, {{#var:49_OE-Core_CentOS_7.1_x86_64}}, {{#var:50_OE-Core_Debian_8_x86_64}}, {{#var:51_OE-Core_Fedora_25_x86_64}}, {{#var:52_OE-Core_Fedora_24_x86_64}}, {{#var:53_OE-Core_OpenSuse_42.3_x86_64}}, {{#var:54_OE-Core_OpenSuse421_x86_64}}, {{#var:55_OE-Core_ubuntu_16.04_x86_64}}, {{#var:56_OE-Core_Ubuntu_17.04_x86-64}}, {{#var:57_OE-Core_Fedora_26_x86_64}}, {{#var:58_Runtime_user-preference}}, {{#var:59_Toaster_Debian_4.3.0-0.bpo.1-amd64}}, {{#var:60_Toaster_Debian_4.3.0-0.bpo.1-amd64}} | report_id=concatstats}}
|