WW15 - 2019-04-10 - Full Test Cycle 2.6.2 RC3: Difference between revisions
No edit summary |
No edit summary |
||
(One intermediate revision by the same user not shown) | |||
Line 1: | Line 1: | ||
Test Result Status Summary (Counts/Percentages sorted by testseries, ID) | Test Result Status Summary (Counts/Percentages sorted by testseries, ID) | ||
-------------------------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------------------------------- | ||
Test Series | ID | Passed | Failed | Skipped | Test Series | ID | Passed | Failed | Skipped | ||
Line 195: | Line 195: | ||
QA cycle report for 2.6.2 RC3: | QA cycle report for 2.6.2 RC3: | ||
1. No high milestone defects. | 1. No high milestone defects. | ||
2. Test results are available at following location: | 2. Test results are available at following location: | ||
• For results of all automated tests, refer to results at public AB [1]. | • For results of all automated tests, refer to results at public AB [1]. | ||
• For other test results, refer to attachment [2]. | • For other test results, refer to attachment [2]. | ||
• For test report for test cases run by Intel and WR team, refer attachment [3] | • For test report for test cases run by Intel and WR team, refer attachment [3] | ||
• For full test report, refer attachment [4] | • For full test report, refer attachment [4] | ||
• For ptest results, please refer to results at public AB [5] | • For ptest results, please refer to results at public AB [5] | ||
• For ptest report, refer to attachment [6] | • For ptest report, refer to attachment [6] | ||
3. 1 new defects are found in this cycle, Beaglebone [7]. | 3. 1 new defects are found in this cycle, Beaglebone [7]. | ||
QA hint: Similar issue for sysemtap failure (bug 13153) was found in 2.7 M2 RC1 which is now resolved for master. | QA hint: Similar issue for sysemtap failure (bug 13153) was found in 2.7 M2 RC1 which is now resolved for master. | ||
4. Number of existing issues observed in this release is 3- toaster [8], Build-appliance [9] and qemu-shutdown [10] | 4. Number of existing issues observed in this release is 3- toaster [8], Build-appliance [9] and qemu-shutdown [10] | ||
5. For ptest, regression data is not available for this release. 3 packages are facing timeout issues: lttng-tools [11], openssh [12] and strace [13]. | 5. For ptest, regression data is not available for this release. 3 packages are facing timeout issues: lttng-tools [11], openssh [12] and strace [13]. | ||
6. Test result report on Public AB shows following failures: | 6. Test result report on Public AB shows following failures: | ||
• buildgalculator.GalculatorTest.test_galculator | • buildgalculator.GalculatorTest.test_galculator | ||
QA Comment: Expected failure for hw limitation | QA Comment: Expected failure for hw limitation | ||
• python.PythonTest.test_python3 | • python.PythonTest.test_python3 | ||
QA Comment: Failure due to “python3” test case not backported to Thud. No bug filed as not real Yocto failure. | QA Comment: Failure due to “python3” test case not backported to Thud. No bug filed as not real Yocto failure. | ||
Latest revision as of 03:44, 24 April 2019
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
Test Series | ID | Passed | Failed | Skipped
beaglebone | manual_bsps-hw_20190404102855 | 21 (49%) | 0 (0%) | 22 (51%) beaglebone | manual_compliance-test_20190409090356 | 4 (67%) | 0 (0%) | 2 (33%) beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190404005930 | 46 (77%) | 2 (3%) | 12 (20%) bitbake | manual_oe-core_20190404101549 | 7 (100%) | 0 (0%) | 0 (0%) build-appliance | manual_build-appliance_20190408123135 | 1 (25%) | 1 (25%) | 2 (50%) crops | sdkext_core-image-sato-sdk_x86_64_qemux86_20190405093334 | 18 (95%) | 0 (0%) | 1 (5%) eclipse-plugin | manual_eclipse-plugin_20190405142927 | 6 (100%) | 0 (0%) | 0 (0%) eclipse-plugin | manual_eclipse-plugin_20190405145642 | 6 (100%) | 0 (0%) | 0 (0%) edgerouter | manual_bsps-hw_20190408154839 | 13 (30%) | 0 (0%) | 30 (70%) edgerouter | manual_compliance-test_20190408163351 | 2 (33%) | 0 (0%) | 4 (67%) edgerouter | runtime_core-image-sato-sdk_edgerouter_20190404001138 | 45 (75%) | 3 (5%) | 12 (20%) kernel-dev | manual_kernel-configuration_20190408105626 | 9 (100%) | 0 (0%) | 0 (0%) minnowboard | manual_bsps-hw_20190403135114 | 43 (100%) | 0 (0%) | 0 (0%) minnowboard | runtime_core-image-lsb-sdk_genericx86-64_20190403070200 | 47 (78%) | 0 (0%) | 13 (22%) minnowboard | runtime_core-image-lsb-sdk_genericx86_20190403032559 | 47 (78%) | 0 (0%) | 13 (22%) minnowboard | runtime_core-image-sato-sdk_genericx86-64_20190403052027 | 48 (80%) | 0 (0%) | 12 (20%) minnowboard | runtime_core-image-sato-sdk_genericx86_20190403013432 | 48 (80%) | 0 (0%) | 12 (20%) mpc8315e-rdb | manual_bsps-hw_20190408155803 | 14 (33%) | 0 (0%) | 29 (67%) mpc8315e-rdb | manual_compliance-test_20190408163026 | 2 (33%) | 0 (0%) | 4 (67%) mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190404004940 | 46 (77%) | 2 (3%) | 12 (20%) multilib | runtime_core-image-minimal_qemumips64_20190328003954 | 1 (2%) | 0 (0%) | 56 (98%) multilib | runtime_core-image-sato_qemux86-64_20190328002440 | 36 (58%) | 0 (0%) | 26 (42%) multilib | runtime_core-image-sato_qemux86-64_20190328002814 | 15 (24%) | 0 (0%) | 47 (76%) multilib | runtime_lib32-core-image-minimal_qemux86-64_20190328001747 | 1 (100%) | 0 (0%) | 0 (0%) multilib | runtime_lib32-core-image-minimal_qemux86-64_20190328001857 | 1 (100%) | 0 (0%) | 0 (0%) multilib | sdk_core-image-minimal_x86_64_qemumips64_20190328003954 | 8 (80%) | 2 (20%) | 0 (0%) musl-qemux86-64 | runtime_core-image-full-cmdline_qemux86-64_20190328003330 | 12 (20%) | 0 (0%) | 47 (80%) musl-qemux86-64 | runtime_core-image-minimal_qemux86-64_20190328003330 | 1 (2%) | 0 (0%) | 58 (98%) musl-qemux86-64 | runtime_core-image-sato-sdk_qemux86-64_20190328003330 | 46 (78%) | 0 (0%) | 13 (22%) musl-qemux86 | runtime_core-image-full-cmdline_qemux86_20190328003008 | 12 (20%) | 0 (0%) | 47 (80%) musl-qemux86 | runtime_core-image-minimal_qemux86_20190328003008 | 1 (2%) | 0 (0%) | 58 (98%) musl-qemux86 | runtime_core-image-sato-sdk_qemux86_20190328003008 | 46 (78%) | 0 (0%) | 13 (22%) no-x11 | runtime_core-image-full-cmdline_qemux86-64_20190328002538 | 12 (20%) | 0 (0%) | 48 (80%) no-x11 | runtime_core-image-weston_qemux86-64_20190328002538 | 32 (53%) | 0 (0%) | 28 (47%) nuc6 | manual_compliance-test_20190404115238 | 4 (67%) | 0 (0%) | 2 (33%) nuc6 | runtime_core-image-lsb-sdk_genericx86-64_20190402070453 | 47 (78%) | 0 (0%) | 13 (22%) nuc6 | runtime_core-image-sato-sdk_genericx86-64_20190402063708 | 48 (80%) | 0 (0%) | 12 (20%) nuc7 | manual_bsps-hw_20190404133456 | 43 (100%) | 0 (0%) | 0 (0%) nuc7 | manual_bsps-hw_20190404133456 | 43 (100%) | 0 (0%) | 0 (0%) nuc7 | runtime_core-image-lsb-sdk_genericx86-64_20190402054739 | 47 (78%) | 0 (0%) | 13 (22%) nuc7 | runtime_core-image-sato-sdk_genericx86-64_20190402022417 | 48 (80%) | 0 (0%) | 12 (20%) oe-selftest-centos | oeselftest_centos-7_qemux86-64_20190328001852 | 336 (100%) | 0 (0%) | 1 (0%) oe-selftest-debian | oeselftest_debian-8_qemux86-64_20190328001901 | 336 (100%) | 0 (0%) | 1 (0%) oe-selftest-fedora | oeselftest_fedora-28_qemux86-64_20190328001846 | 336 (100%) | 0 (0%) | 1 (0%) oe-selftest-ubuntu | oeselftest_ubuntu-18.04_qemux86-64_20190328001859 | 336 (100%) | 0 (0%) | 1 (0%) pkgman-deb-non-deb | runtime_core-image-minimal_qemux86_20190328003218 | 1 (2%) | 0 (0%) | 59 (98%) pkgman-deb-non-deb | runtime_core-image-sato-sdk_qemux86_20190328003218 | 29 (48%) | 0 (0%) | 31 (52%) pkgman-deb-non-deb | runtime_core-image-sato_qemux86_20190328003218 | 15 (25%) | 0 (0%) | 45 (75%) pkgman-non-rpm | runtime_core-image-minimal_qemux86_20190328002926 | 1 (2%) | 0 (0%) | 59 (98%) pkgman-non-rpm | runtime_core-image-minimal_qemux86_20190328004516 | 1 (2%) | 0 (0%) | 59 (98%) pkgman-non-rpm | runtime_core-image-sato-sdk_qemux86_20190328002926 | 30 (50%) | 0 (0%) | 30 (50%) pkgman-non-rpm | runtime_core-image-sato-sdk_qemux86_20190328004516 | 29 (48%) | 0 (0%) | 31 (52%) pkgman-non-rpm | runtime_core-image-sato_qemux86_20190328002926 | 14 (23%) | 0 (0%) | 46 (77%) pkgman-non-rpm | runtime_core-image-sato_qemux86_20190328004516 | 15 (25%) | 0 (0%) | 45 (75%) pkgman-rpm-non-rpm | runtime_core-image-minimal_qemux86_20190328002431 | 1 (2%) | 0 (0%) | 59 (98%) pkgman-rpm-non-rpm | runtime_core-image-sato-sdk_qemux86_20190328002431 | 48 (80%) | 0 (0%) | 12 (20%) pkgman-rpm-non-rpm | runtime_core-image-sato_qemux86_20190328002431 | 35 (58%) | 0 (0%) | 25 (42%) qa-extras2 | runtime_core-image-sato_qemux86-64_20190328002647 | 37 (62%) | 0 (0%) | 23 (38%) qa-extras2 | runtime_core-image-sato_qemux86-64_20190328003002 | 36 (60%) | 0 (0%) | 24 (40%) qa-extras2 | runtime_core-image-sato_qemux86-64_20190328003249 | 37 (60%) | 0 (0%) | 25 (40%) qa-extras2 | runtime_core-image-sato_qemux86-64_20190328003638 | 42 (70%) | 0 (0%) | 18 (30%) qa-extras2 | runtime_core-image-sato_qemux86-64_20190328003926 | 35 (58%) | 0 (0%) | 25 (42%) qa-extras2 | runtime_core-image-sato_qemux86-64_20190328004323 | 42 (70%) | 0 (0%) | 18 (30%) qa-extras2 | runtime_core-image-sato_qemux86-64_20190328004739 | 35 (58%) | 0 (0%) | 25 (42%) qemu-shutdown | oeselftest_ubuntu-16.04_qemuarm64_20190405130158 | 2 (100%) | 0 (0%) | 0 (0%) qemu-shutdown | oeselftest_ubuntu-16.04_qemuarm_20190405130827 | 0 (0%) | 2 (100%) | 0 (0%) qemu-shutdown | oeselftest_ubuntu-16.04_qemumips64_20190405104357 | 2 (100%) | 0 (0%) | 0 (0%) qemu-shutdown | oeselftest_ubuntu-16.04_qemumips_20190405105628 | 2 (100%) | 0 (0%) | 0 (0%) qemu-shutdown | oeselftest_ubuntu-16.04_qemuppc_20190408094026 | 2 (100%) | 0 (0%) | 0 (0%) qemu-shutdown | oeselftest_ubuntu-16.04_qemux86-64_20190405091245 | 2 (100%) | 0 (0%) | 0 (0%) qemu-shutdown | oeselftest_ubuntu-16.04_qemux86_20190405092022 | 2 (100%) | 0 (0%) | 0 (0%) qemuarm-lsb | runtime_core-image-lsb-sdk_qemuarm_20190328002513 | 47 (78%) | 0 (0%) | 13 (22%) qemuarm-lsb | runtime_core-image-lsb_qemuarm_20190328002513 | 35 (58%) | 0 (0%) | 25 (42%) qemuarm64 | manual_bsps-qemu_20190409101736 | 5 (62%) | 0 (0%) | 3 (38%) qemuarm64 | runtime_core-image-minimal_qemuarm64_20190328003435 | 1 (2%) | 0 (0%) | 58 (98%) qemuarm64 | runtime_core-image-sato-sdk_qemuarm64_20190328003435 | 47 (80%) | 0 (0%) | 12 (20%) qemuarm64 | runtime_core-image-sato_qemuarm64_20190328003435 | 34 (58%) | 0 (0%) | 25 (42%) qemuarm64 | sdk_core-image-sato_i686_qemuarm64_20190328003435 | 9 (90%) | 1 (10%) | 0 (0%) qemuarm64 | sdkext_core-image-minimal_x86_64_qemuarm64_20190328021523 | 16 (84%) | 0 (0%) | 3 (16%) qemuarm64 | sdkext_core-image-sato_x86_64_qemuarm64_20190328021523 | 16 (84%) | 0 (0%) | 3 (16%) qemuarm | manual_bsps-qemu_20190408154640 | 5 (62%) | 0 (0%) | 3 (38%) qemuarm | runtime_core-image-minimal_qemuarm_20190328004315 | 1 (2%) | 0 (0%) | 59 (98%) qemuarm | runtime_core-image-sato-sdk_qemuarm_20190328004315 | 48 (80%) | 0 (0%) | 12 (20%) qemuarm | runtime_core-image-sato_qemuarm_20190328004315 | 35 (58%) | 0 (0%) | 25 (42%) qemuarm | sdk_core-image-sato_i686_qemuarm_20190328004315 | 9 (90%) | 1 (10%) | 0 (0%) qemuarm | sdkext_core-image-minimal_x86_64_qemuarm_20190328021538 | 16 (84%) | 0 (0%) | 3 (16%) qemuarm | sdkext_core-image-sato_x86_64_qemuarm_20190328021538 | 16 (84%) | 0 (0%) | 3 (16%) qemumips-lsb | runtime_core-image-lsb-sdk_qemumips_20190328004839 | 44 (77%) | 0 (0%) | 13 (23%) qemumips-lsb | runtime_core-image-lsb_qemumips_20190328004839 | 35 (61%) | 0 (0%) | 22 (39%) qemumips64 | manual_bsps-qemu_20190409105052 | 5 (62%) | 0 (0%) | 3 (38%) qemumips64 | runtime_core-image-minimal_qemumips64_20190328003203 | 1 (2%) | 0 (0%) | 56 (98%) qemumips64 | runtime_core-image-sato-sdk_qemumips64_20190328003203 | 45 (79%) | 0 (0%) | 12 (21%) qemumips64 | runtime_core-image-sato_qemumips64_20190328003203 | 35 (61%) | 0 (0%) | 22 (39%) qemumips64 | sdk_core-image-sato_i686_qemumips64_20190328003203 | 9 (90%) | 1 (10%) | 0 (0%) qemumips64 | sdkext_core-image-minimal_x86_64_qemumips64_20190328015921 | 16 (84%) | 0 (0%) | 3 (16%) qemumips64 | sdkext_core-image-sato_x86_64_qemumips64_20190328015921 | 16 (84%) | 0 (0%) | 3 (16%) qemumips | manual_bsps-qemu_20190409104930 | 5 (62%) | 0 (0%) | 3 (38%) qemumips | runtime_core-image-minimal_qemumips_20190328002922 | 1 (2%) | 0 (0%) | 56 (98%) qemumips | runtime_core-image-sato-sdk_qemumips_20190328002922 | 45 (79%) | 0 (0%) | 12 (21%) qemumips | runtime_core-image-sato_qemumips_20190328002922 | 35 (61%) | 0 (0%) | 22 (39%) qemumips | sdk_core-image-sato_i686_qemumips_20190328002922 | 9 (90%) | 1 (10%) | 0 (0%) qemumips | sdkext_core-image-minimal_x86_64_qemumips_20190328025447 | 16 (84%) | 0 (0%) | 3 (16%) qemumips | sdkext_core-image-sato_x86_64_qemumips_20190328025447 | 16 (84%) | 0 (0%) | 3 (16%) qemuppc-lsb | runtime_core-image-lsb-sdk_qemuppc_20190328003325 | 47 (78%) | 0 (0%) | 13 (22%) qemuppc-lsb | runtime_core-image-lsb_qemuppc_20190328003325 | 35 (58%) | 0 (0%) | 25 (42%) qemuppc | manual_bsps-qemu_20190409101419 | 5 (62%) | 0 (0%) | 3 (38%) qemuppc | runtime_core-image-minimal_qemuppc_20190328003522 | 1 (2%) | 0 (0%) | 59 (98%) qemuppc | runtime_core-image-sato-sdk_qemuppc_20190328003522 | 48 (80%) | 0 (0%) | 12 (20%) qemuppc | runtime_core-image-sato_qemuppc_20190328003522 | 35 (58%) | 0 (0%) | 25 (42%) qemuppc | sdk_core-image-sato_i686_qemuppc_20190328003522 | 9 (90%) | 1 (10%) | 0 (0%) qemuppc | sdkext_core-image-minimal_x86_64_qemuppc_20190328015826 | 16 (84%) | 0 (0%) | 3 (16%) qemuppc | sdkext_core-image-sato_x86_64_qemuppc_20190328015826 | 16 (84%) | 0 (0%) | 3 (16%) qemux86-64-x32 | runtime_core-image-minimal_qemux86-64_20190328003241 | 1 (2%) | 0 (0%) | 59 (98%) qemux86-64 | manual_bsps-qemu_20190409103740 | 5 (62%) | 0 (0%) | 3 (38%) qemux86-64 | runtime_core-image-minimal_qemux86-64_20190328003340 | 1 (2%) | 0 (0%) | 59 (98%) qemux86-64 | runtime_core-image-sato-sdk_qemux86-64_20190328003340 | 48 (80%) | 0 (0%) | 12 (20%) qemux86-64 | runtime_core-image-sato_qemux86-64_20190328003340 | 35 (58%) | 0 (0%) | 25 (42%) qemux86-64 | sdk_core-image-sato_i686_qemux86-64_20190328003340 | 9 (90%) | 1 (10%) | 0 (0%) qemux86-64 | sdk_core-image-sato_x86_64_qemux86-64_20190328004546 | 9 (90%) | 1 (10%) | 0 (0%) qemux86-64 | sdkext_core-image-minimal_x86_64_qemux86-64_20190328004546 | 16 (84%) | 0 (0%) | 3 (16%) qemux86-64 | sdkext_core-image-sato_x86_64_qemux86-64_20190328004546 | 16 (84%) | 0 (0%) | 3 (16%) qemux86-lsb | runtime_core-image-lsb-sdk_qemux86_20190328004050 | 47 (78%) | 0 (0%) | 13 (22%) qemux86-lsb | runtime_core-image-lsb_qemux86_20190328004050 | 35 (58%) | 0 (0%) | 25 (42%) qemux86 | manual_bsps-qemu_20190409103539 | 8 (100%) | 0 (0%) | 0 (0%) qemux86 | runtime_core-image-minimal_qemux86_20190328003322 | 1 (2%) | 0 (0%) | 59 (98%) qemux86 | runtime_core-image-sato-sdk_qemux86_20190328003322 | 48 (80%) | 0 (0%) | 12 (20%) qemux86 | runtime_core-image-sato_qemux86_20190328003322 | 35 (58%) | 0 (0%) | 25 (42%) qemux86 | sdk_core-image-sato_i686_qemux86_20190328003322 | 9 (90%) | 1 (10%) | 0 (0%) qemux86 | sdk_core-image-sato_x86_64_qemux86_20190328004134 | 9 (90%) | 1 (10%) | 0 (0%) qemux86 | sdkext_core-image-minimal_x86_64_qemux86_20190328004134 | 16 (84%) | 0 (0%) | 3 (16%) qemux86 | sdkext_core-image-sato_x86_64_qemux86_20190328004134 | 16 (84%) | 0 (0%) | 3 (16%) sdk-extras | manual_sdk_20190405100903 | 1 (100%) | 0 (0%) | 0 (0%) sdk-extras | manual_sdk_20190405101101 | 1 (100%) | 0 (0%) | 0 (0%) sdk-extras | oeselftest_ubuntu-16.04_qemuarm_20190408124613 | 3 (100%) | 0 (0%) | 0 (0%) sdk-extras | oeselftest_ubuntu-16.04_qemumips_20190408140149 | 3 (100%) | 0 (0%) | 0 (0%) sdk-extras | oeselftest_ubuntu-16.04_qemuppc_20190408144435 | 3 (100%) | 0 (0%) | 0 (0%) sdk-extras | oeselftest_ubuntu-16.04_qemux86_20190408114124 | 3 (100%) | 0 (0%) | 0 (0%) toaster | manual_toaster-managed-mode_20190408102130 | 62 (95%) | 3 (5%) | 0 (0%) toaster | manual_toaster-unmanaged-mode_20190408101806 | 28 (100%) | 0 (0%) | 0 (0%)
There was no ptest data
==================================================================================================
Failed test cases (sorted by testseries, ID)
==================================================================================================
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190404005930
stap.StapTest.test_stap parselogs.ParseLogsTest.test_parselogs
testseries | result_id : build-appliance | manual_build-appliance_20190408123135
build-appliance.build-appliance.Bitbake_build-appliance-image
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190404001138
xorg.XorgTest.test_xorg_running buildcpio.BuildCpioTest.test_cpio parselogs.ParseLogsTest.test_parselogs
testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190404004940
xorg.XorgTest.test_xorg_running parselogs.ParseLogsTest.test_parselogs
testseries | result_id : multilib | sdk_core-image-minimal_x86_64_qemumips64_20190328003954
buildgalculator.GalculatorTest.test_galculator python.PythonTest.test_python3
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemuarm_20190405130827
runqemu.QemuTest.test_qemu_can_shutdown runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
testseries | result_id : qemuarm64 | sdk_core-image-sato_i686_qemuarm64_20190328003435
python.PythonTest.test_python3
testseries | result_id : qemuarm | sdk_core-image-sato_i686_qemuarm_20190328004315
python.PythonTest.test_python3
testseries | result_id : qemumips64 | sdk_core-image-sato_i686_qemumips64_20190328003203
python.PythonTest.test_python3
testseries | result_id : qemumips | sdk_core-image-sato_i686_qemumips_20190328002922
python.PythonTest.test_python3
testseries | result_id : qemuppc | sdk_core-image-sato_i686_qemuppc_20190328003522
python.PythonTest.test_python3
testseries | result_id : qemux86-64 | sdk_core-image-sato_i686_qemux86-64_20190328003340
python.PythonTest.test_python3
testseries | result_id : qemux86-64 | sdk_core-image-sato_x86_64_qemux86-64_20190328004546
python.PythonTest.test_python3
testseries | result_id : qemux86 | sdk_core-image-sato_i686_qemux86_20190328003322
python.PythonTest.test_python3
testseries | result_id : qemux86 | sdk_core-image-sato_x86_64_qemux86_20190328004134
python.PythonTest.test_python3
testseries | result_id : toaster | manual_toaster-managed-mode_20190408102130
toaster-managed-mode.toaster-managed.Adding_packages_with_dependencies toaster-managed-mode.toaster-managed.Adding_packages_without_dependencies_from_custom_images toaster-managed-mode.toaster-managed.Removing_packages_without_and_with_dependencies__from_custom_images
QA cycle report for 2.6.2 RC3:
1. No high milestone defects. 2. Test results are available at following location: • For results of all automated tests, refer to results at public AB [1]. • For other test results, refer to attachment [2]. • For test report for test cases run by Intel and WR team, refer attachment [3] • For full test report, refer attachment [4] • For ptest results, please refer to results at public AB [5] • For ptest report, refer to attachment [6] 3. 1 new defects are found in this cycle, Beaglebone [7]. QA hint: Similar issue for sysemtap failure (bug 13153) was found in 2.7 M2 RC1 which is now resolved for master. 4. Number of existing issues observed in this release is 3- toaster [8], Build-appliance [9] and qemu-shutdown [10] 5. For ptest, regression data is not available for this release. 3 packages are facing timeout issues: lttng-tools [11], openssh [12] and strace [13]. 6. Test result report on Public AB shows following failures: • buildgalculator.GalculatorTest.test_galculator QA Comment: Expected failure for hw limitation • python.PythonTest.test_python3 QA Comment: Failure due to “python3” test case not backported to Thud. No bug filed as not real Yocto failure.
= Links ==
Link to testresults:
[1] - https://autobuilder.yocto.io/pub/releases/yocto-2.6.2.rc3/testresults/
[2] - 2.6.2_RC3_results_merged.zip
[3] - 2.6.2_rc3_intel_wr_merged_report
[4] - 2.6.2_rc3_full_report
[5] - https://autobuilder.yocto.io/pub/non-release/20190328-8/testresults/qemux86-64-ptest/
[6] – 2.6.2_rc3_ptest_report
New Bugs :
[7] Bug 13273 - [2.6.2 RC3] Systemtap doesn't work on beaglebone https://bugzilla.yoctoproject.org/show_bug.cgi?id=13273
Previous Bugs observed in this release:
[8] Bug 13191 – [Test Case 1439] Build Failure after adding or removing packages with and without dependencies https://bugzilla.yoctoproject.org/show_bug.cgi?id=13191
[9] Bug 12991 - [Bug] [2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk package. https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991
[10] Bug 13234 - [2.7 M3 RC1] qemumips & qemumips64: failed to shutdown https://bugzilla.yoctoproject.org/show_bug.cgi?id=13234
ptest Bugs:
[11] Bug 13255 - [2.7 M3 rc1] lttng-tools ptest facing timeout issue https://bugzilla.yoctoproject.org/show_bug.cgi?id=13255
[12] Bug 13256 - [2.7 M3 rc1] openssh ptest facing timeout issue https://bugzilla.yoctoproject.org/show_bug.cgi?id=13256
[13] Bug 13274 - [2.6.2 RC3] strace ptest facing timeout issue https://bugzilla.yoctoproject.org/show_bug.cgi?id=13274