WW17 - 2019-04-26 - Full Test Cycle 2.7 RC2: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(Created page with "============================================================================================================== Test Result Status Summary (Counts/Percentages sorted by testser...")
 
No edit summary
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
==============================================================================================================
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
==============================================================================================================
 
--------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------------------------
Test Series    | ID                                                          | Passed   | Failed | Skipped  
Test Series    | ID                                                          | Passed   | Failed | Skipped  
--------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------------------------
beaglebone      | manual_bsps-hw_20190415101630                              | 22 (48%) | 0 (0%) | 24 (52%)
<!-- Adding a leading space in following line makes the test results displayed in separate lines on a wiki page -->
beaglebone      | manual_compliance-test_20190415102409                       | 4 (67%)   | 0 (0%) | 2 (33%)  
beaglebone      | manual_bsp-hw_20190423084040                                | 22 (48%) | 0 (0%) | 24 (52%)
beaglebone      | runtime_core-image-sato-sdk_beaglebone-yocto_20190410043531 | 48 (79%) | 1 (2%) | 12 (20%)
beaglebone      | manual_compliance-test_20190423090419                       | 4 (67%) | 0 (0%) | 2 (33%)  
bitbake        | manual_oe-core_20190411155828                               | 7 (100%) | 0 (0%) | 0 (0%)   
beaglebone      | runtime_core-image-sato-sdk_beaglebone-yocto_20190418020210 | 47 (78%) | 1 (2%) | 12 (20%)
build-appliance | manual_build-appliance_20190412091610                       | 3 (75%)   | 1 (25%) | 0 (0%)   
bitbake        | manual_oe-core_20190422122908                               | 7 (100%) | 0 (0%) | 0 (0%)   
crops          | sdkext_core-image-sato-sdk_x86_64_qemux86_20190417070541   | 20 (100%) | 0 (0%) | 0 (0%) 
build-appliance | manual_build-appliance_20190419091523                       | 3 (100%) | 0 (0%) | 0 (0%)   
eclipse-plugin  | manual_eclipse-plugin_20190417104509                        | 6 (100%)  | 0 (0%) | 0 (0%) 
crops          | sdkext_core-image-sato-sdk_x86_64_qemux86_20190418060423   | 17 (81%) | 0 (0%) | 4 (19%)  
eclipse-plugin | manual_eclipse-plugin_20190417132839                        | 6 (100%)  | 0 (0%)  | 0 (0%) 
  edgerouter      | manual_bsp-hw_20190423075104                                | 11 (24%) | 0 (0%) | 35 (76%)
edgerouter      | manual_bsps-hw_20190415105842                              | 11 (24%) | 0 (0%) | 35 (76%)
edgerouter      | manual_compliance-test_20190423090048                       | 2 (33%) | 0 (0%) | 4 (67%)  
edgerouter      | manual_compliance-test_20190415110648                       | 2 (33%)   | 0 (0%) | 4 (67%)  
edgerouter      | runtime_core-image-sato-sdk_edgerouter_20190422005001       | 46 (77%) | 2 (3%) | 12 (20%)
edgerouter      | runtime_core-image-sato-sdk_edgerouter_20190411013527       | 47 (77%) | 2 (3%) | 12 (20%)
  minnowboard    | runtime_core-image-lsb-sdk_genericx86_20190422055513        | 47 (78%) | 0 (0%) | 13 (22%)
kernel-dev      | manual_kernel-configuration_20190416165928                  | 9 (100%)  | 0 (0%)  | 0 (0%)  
  minnowboard    | runtime_core-image-sato-sdk_genericx86-64_20190423054516   | 48 (80%) | 0 (0%) | 12 (20%)
minnowboard    | manual_bsps-hw_20190416094344                              | 43 (100%) | 0 (0%)  | 0 (0%) 
minnowboard    | runtime_core-image-sato-sdk_genericx86_20190422043211       | 48 (80%) | 0 (0%) | 12 (20%)
minnowboard    | runtime_core-image-lsb-sdk_genericx86-64_20190416030314    | 48 (79%) | 0 (0%) | 13 (21%)
mpc8315e-rdb    | manual_bsp-hw_20190423080426                                | 15 (33%) | 0 (0%) | 31 (67%)
minnowboard    | runtime_core-image-lsb-sdk_genericx86_20190416094619        | 48 (79%)  | 0 (0%) | 13 (21%)
mpc8315e-rdb    | manual_compliance-test_20190423090215                       | 2 (33%) | 0 (0%) | 4 (67%)  
minnowboard    | runtime_core-image-sato-sdk_genericx86-64_20190416012138   | 49 (80%) | 0 (0%) | 12 (20%)
mpc8315e-rdb    | runtime_core-image-sato-sdk_mpc8315e-rdb_20190418064750     | 47 (78%) | 1 (2%) | 12 (20%)
minnowboard    | runtime_core-image-sato-sdk_genericx86_20190416072759       | 49 (80%) | 0 (0%) | 12 (20%)
nuc6            | manual_compliance-test_20190423161117                       | 4 (67%) | 0 (0%) | 2 (33%)  
mpc8315e-rdb    | manual_bsps-hw_20190415102615                              | 15 (33%) | 0 (0%) | 31 (67%)
nuc6            | runtime_core-image-lsb-sdk_genericx86-64_20190424015234     | 47 (78%) | 0 (0%) | 13 (22%)
mpc8315e-rdb    | manual_compliance-test_20190415103232                       | 2 (33%)   | 0 (0%) | 4 (67%)  
nuc6            | runtime_core-image-sato-sdk_genericx86-64_20190423055720   | 48 (80%) | 0 (0%) | 12 (20%)
mpc8315e-rdb    | runtime_core-image-sato-sdk_mpc8315e-rdb_20190410070846     | 47 (77%) | 2 (3%) | 12 (20%)
  qemuarm64      | manual_bsp-qemu_20190423163124                              | 5 (62%) | 0 (0%) | 3 (38%)  
nuc6            | manual_compliance-test_20190416170925                       | 4 (67%)   | 0 (0%) | 2 (33%)  
qemuarm        | manual_bsp-qemu_20190423162843                              | 5 (62%) | 0 (0%) | 3 (38%)  
nuc6            | runtime_core-image-lsb-sdk_genericx86-64_20190415062722     | 48 (79%) | 0 (0%) | 13 (21%)
qemumips64      | manual_bsp-qemu_20190423163305                              | 5 (62%) | 0 (0%) | 3 (38%)  
nuc6            | runtime_core-image-sato-sdk_genericx86-64_20190415051153   | 49 (80%) | 0 (0%) | 12 (20%)
qemumips        | manual_bsp-qemu_20190423163221                              | 5 (62%) | 0 (0%) | 3 (38%)  
nuc7            | manual_bsps-hw_20190415085927                              | 43 (100%) | 0 (0%)  | 0 (0%) 
qemuppc        | manual_bsp-qemu_20190423163348                              | 5 (62%)  | 0 (0%) | 3 (38%)  
nuc7            | runtime_core-image-lsb-sdk_genericx86-64_20190416070445    | 48 (79%)  | 0 (0%)  | 13 (21%)
  sdk-extras      | manual_sdk_20190422132512                                   | 1 (100%) | 0 (0%) | 0 (0%)   
nuc7            | runtime_core-image-sato-sdk_genericx86-64_20190412085847    | 49 (80%)  | 0 (0%) | 12 (20%)
sdk-extras      | manual_sdk_20190424091204                                   | 1 (100%) | 0 (0%) | 0 (0%)   
qemuarm64      | manual_bsps-qemu_20190416173043                            | 5 (62%)   | 0 (0%) | 3 (38%)  
qemuarm        | manual_bsps-qemu_20190416172910                            | 5 (62%)   | 0 (0%) | 3 (38%)  
qemumips64      | manual_bsps-qemu_20190416172522                            | 5 (62%)   | 0 (0%) | 3 (38%)  
qemumips        | manual_bsps-qemu_20190416172259                            | 5 (62%)   | 0 (0%) | 3 (38%)  
qemuppc        | manual_bsps-qemu_20190416172725                            | 5 (62%)  | 0 (0%)  | 3 (38%)
qemux86-64      | manual_bsps-qemu_20190416172006                            | 5 (62%)  | 0 (0%) | 3 (38%)  
qemux86        | manual_bsps-qemu_20190416171331                            | 8 (100%) | 0 (0%)  | 0 (0%) 
sdk-extras      | manual_sdk_20190411165245                                   | 1 (100%) | 0 (0%) | 0 (0%)   
sdk-extras      | manual_sdk_20190416175031                                   | 1 (100%) | 0 (0%) | 0 (0%) 
sdk-extras      | oeselftest_ubuntu-16.04_qemuarm_20190411094931              | 3 (100%)  | 0 (0%)  | 0 (0%) 
sdk-extras      | oeselftest_ubuntu-16.04_qemumips_20190411101805            | 3 (100%)  | 0 (0%)  | 0 (0%) 
sdk-extras      | oeselftest_ubuntu-16.04_qemuppc_20190411105505              | 3 (100%)  | 0 (0%)  | 0 (0%) 
sdk-extras      | oeselftest_ubuntu-16.04_qemux86_20190410105457              | 3 (100%)  | 0 (0%)  | 0 (0%) 
toaster        | manual_toaster-managed-mode_20190417143733                  | 62 (95%)  | 3 (5%)  | 0 (0%) 
toaster        | manual_toaster-unmanaged-mode_20190417110922                | 28 (100%) | 0 (0%)  | 0 (0%)   
--------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------------------------


Line 54: Line 38:
==============================================================================================================
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------------------------
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190410043531
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190418020210
     parselogs.ParseLogsTest.test_parselogs
     parselogs.ParseLogsTest.test_parselogs
##[QA comment]: WR team is investigating more on this issue. No bug filed as this is not a real Yocto bug.
    comment: WR working
testseries | result_id : build-appliance | manual_build-appliance_20190412091610
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190422005001
    build-appliance.build-appliance.Bitbake_build-appliance-image
##[QA comment]: Bug 12991
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190411013527
     xorg.XorgTest.test_xorg_running
     xorg.XorgTest.test_xorg_running
## [QA Comment]: This is an expected failure due to hw limitation.
     parselogs.ParseLogsTest.test_parselogs
     parselogs.ParseLogsTest.test_parselogs
##[QA comment]: WR team is investigating more on this issue. No bug filed as this is not a real Yocto bug.
testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190418064750
testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190410070846
     xorg.XorgTest.test_xorg_running
     xorg.XorgTest.test_xorg_running
## [QA Comment]: This is an expected failure due to hw limitation.
    parselogs.ParseLogsTest.test_parselogs
##[QA comment]: WR team is investigating more on this issue. No bug filed as this is not a real Yocto bug.
testseries | result_id : toaster | manual_toaster-managed-mode_20190417143733
    toaster-managed-mode.toaster-managed.Adding_packages_with_dependencies
    toaster-managed-mode.toaster-managed.Removing_packages_without_and_with_dependencies__from_custom_images
    toaster-managed-mode.toaster-managed.Adding_packages_without_dependencies_from_custom_images
## [QA Comment]: 3 failures - Bug 13191
--------------------------------------------------------------------------------------------------------------
--------------------------------------------------------------------------------------------------------------

Latest revision as of 05:58, 25 April 2019

Test Result Status Summary (Counts/Percentages sorted by testseries, ID)

Test Series | ID | Passed | Failed | Skipped 

beaglebone      | manual_bsp-hw_20190423084040                                | 22 (48%) | 0 (0%) | 24 (52%)
beaglebone      | manual_compliance-test_20190423090419                       | 4 (67%)  | 0 (0%) | 2 (33%) 
beaglebone      | runtime_core-image-sato-sdk_beaglebone-yocto_20190418020210 | 47 (78%) | 1 (2%) | 12 (20%)
bitbake         | manual_oe-core_20190422122908                               | 7 (100%) | 0 (0%) | 0 (0%)  
build-appliance | manual_build-appliance_20190419091523                       | 3 (100%) | 0 (0%) | 0 (0%)  
crops           | sdkext_core-image-sato-sdk_x86_64_qemux86_20190418060423    | 17 (81%) | 0 (0%) | 4 (19%) 
edgerouter      | manual_bsp-hw_20190423075104                                | 11 (24%) | 0 (0%) | 35 (76%)
edgerouter      | manual_compliance-test_20190423090048                       | 2 (33%)  | 0 (0%) | 4 (67%) 
edgerouter      | runtime_core-image-sato-sdk_edgerouter_20190422005001       | 46 (77%) | 2 (3%) | 12 (20%)
minnowboard     | runtime_core-image-lsb-sdk_genericx86_20190422055513        | 47 (78%) | 0 (0%) | 13 (22%)
minnowboard     | runtime_core-image-sato-sdk_genericx86-64_20190423054516    | 48 (80%) | 0 (0%) | 12 (20%)
minnowboard     | runtime_core-image-sato-sdk_genericx86_20190422043211       | 48 (80%) | 0 (0%) | 12 (20%)
mpc8315e-rdb    | manual_bsp-hw_20190423080426                                | 15 (33%) | 0 (0%) | 31 (67%)
mpc8315e-rdb    | manual_compliance-test_20190423090215                       | 2 (33%)  | 0 (0%) | 4 (67%) 
mpc8315e-rdb    | runtime_core-image-sato-sdk_mpc8315e-rdb_20190418064750     | 47 (78%) | 1 (2%) | 12 (20%)
nuc6            | manual_compliance-test_20190423161117                       | 4 (67%)  | 0 (0%) | 2 (33%) 
nuc6            | runtime_core-image-lsb-sdk_genericx86-64_20190424015234     | 47 (78%) | 0 (0%) | 13 (22%)
nuc6            | runtime_core-image-sato-sdk_genericx86-64_20190423055720    | 48 (80%) | 0 (0%) | 12 (20%)
qemuarm64       | manual_bsp-qemu_20190423163124                              | 5 (62%)  | 0 (0%) | 3 (38%) 
qemuarm         | manual_bsp-qemu_20190423162843                              | 5 (62%)  | 0 (0%) | 3 (38%) 
qemumips64      | manual_bsp-qemu_20190423163305                              | 5 (62%)  | 0 (0%) | 3 (38%) 
qemumips        | manual_bsp-qemu_20190423163221                              | 5 (62%)  | 0 (0%) | 3 (38%) 
qemuppc         | manual_bsp-qemu_20190423163348                              | 5 (62%)  | 0 (0%) | 3 (38%) 
sdk-extras      | manual_sdk_20190422132512                                   | 1 (100%) | 0 (0%) | 0 (0%)  
sdk-extras      | manual_sdk_20190424091204                                   | 1 (100%) | 0 (0%) | 0 (0%)

There was no ptest data

==================================================================================================

Failed test cases (sorted by testseries, ID)

==================================================================================================

testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190418020210 

   parselogs.ParseLogsTest.test_parselogs
   comment: WR working

testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190422005001 

   xorg.XorgTest.test_xorg_running
   parselogs.ParseLogsTest.test_parselogs

testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190418064750 

   xorg.XorgTest.test_xorg_running
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=WW17_-_2019-04-26_-_Full_Test_Cycle_2.7_RC2&oldid=51155"