Ptest 753e2a0ede4449917c75353b57f13bbafe70fac8: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(ptest regression results: 2.7 M3 RC1 and 2.7 M2 RC2)
No edit summary
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
[https://wiki.yoctoproject.org/wiki/Ptest/archive < Archive]
[https://wiki.yoctoproject.org/wiki/Ptest/archive < Archive]


<b> PTest Summary: Regression results 2.7 M3 RC1 ran on a NUC and compared with[[Ptest be52da152a4d9f9e798844f592ec9ae7e051c658| 2.7 M2 RC2 ]]</b>
<br />Ran on a NUC and compared with[[Ptest be52da152a4d9f9e798844f592ec9ae7e051c658| 2.7.m2.rc2]]


PTest Result Summary
[https://wiki.yoctoproject.org/wiki/images/e/e6/Ptest_27_m3_rc1.txt < FULL_LOG]


--------------------------------------------------------------------------------------------------------------
{| style="border-spacing:0;"
Recipe            | Passed      | Failed    | Skipped  | Time(s) 
| style="background-color:#ff8080;border:0.05pt solid #000000;padding:0.0382in;"| Failures
--------------------------------------------------------------------------------------------------------------
|-
acl                | 0          | 1        | 0        | 0
| style="background-color:#99ff66;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;"| % increased
attr              | 55          | 53        | 0         | 1
|-
bash              | 76          | 3        | 0         | 160
| style="background-color:#c5000b;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#ffffff"| % decreased
bluez5            | 25          | 0        | 0        | 6
|-
busybox            | 0           | 0         | 52        | 2
| style="background-color:gray;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#000000"| Module not executed
bzip2              | 0          | 0        | 0        | 0
|}
dbus-test          | 13          | 8        | 2        | 157
diffstat          | 438        | 0         | 0         | 6
diffutils          | 0          | 1        | 0        | 0
e2fsprogs          | 7          | 312      | 29        | 14
flex              | 0           | 0         | 0        | 0
gawk              | 341        | 1        | 0        | 4
gdbm              | 0          | 0        | 0        | 0
gdk-pixbuf        | 20          | 0         | 0        | 27
glib-2.0           | 0          | 0        | 0        | 0
gstreamer1.0      | 1          | 103      | 0        | 12
gzip              | 0          | 1        | 0        | 0
kbd                | 5          | 2        | 0        | 1
libpcre            | 1          | 0        | 0        | 0
libusb1            | 4          | 0        | 0        | 8
libxml-parser-perl | 4          | 11        | 0         | 0
libxml2            | 23          | 17        | 0        | 3
lttng-tools        | 287        | 5        | 71        | 70
lzo                | 5          | 0         | 0        | 31
nettle            | 97          | 0        | 2        | 7
openssh            | 0          | 1        | 0        | 55
openssl            | 123        | 1        | 8        | 53
pango              | 12          | 0        | 0        | 1
perl              | 1495        | 401      | 191      | -
python            | 16195      | 21        | 728      | 361
python3            | 30221      | 2        | 970      | 1051
quilt              | 0           | 57        | 0         | 2
sed                | 0          | 86        | 0        | 1
slang              | 47          | 50        | 0        | 11
strace            | 221        | 290      | 104      | 343 T
tcl                | 149        | 0        | 0        | 2
util-linux        | 0          | 425      | 48        | -
--------------------------------------------------------------------------------------------------------------


Ptest Regression:
{| class="wikitable"
Regression:
|+Results
runtime_core-image-sato-sdk-ptest_genericx86-64_20190327064915
|-
runtime_core-image-sato-sdk-ptest_genericx86-64_20190325102236
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Package Name'''
 
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Tests ran'''
    ptestresult.acl.dump_ext3.img: FAILED -> PASSED
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;padding:0.0201in;"| '''Passed'''
    ptestresult.attr.$_cd_d: FAILED -> PASSED
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;border-right:0.5ptsolid #000000;
    ptestresult.attr.$_getfattr_-L_-R_1/sub/link_|_./sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-L_-R_1_|_./sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-P_-R_1_|_./sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-R_-P_1/sub_|_./sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-R_1/sub/link_|_./sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-d_f_g_h_|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-d_f_l_|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-h_-L_-R_-m_'.'_-e_hex_1_|_grep_-v_selinux_|_./sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-h_-P_-R_-m_'.'_-e_hex_1/2_|_grep_-v_selinux_|_./sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-RLhd_._|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-RLhd_here_|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-RLhd_sub2_|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-RPhd_sub2: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-Rd_._|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-Rd_here_|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-Rhd_._|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_getfattr_-m-_-Rhd_sub2: FAILED -> PASSED
    ptestresult.attr.$_getfattr_f_g_h_|_../sort-getfattr-output: FAILED -> PASSED
    ptestresult.attr.$_ln_-s_../sub_sub2/to-sub: FAILED -> PASSED
    ptestresult.attr.$_ln_-s_.._sub/up: FAILED -> PASSED
    ptestresult.attr.$_ln_-s_`pwd`/1/link_1/sub/link: FAILED -> PASSED
    ptestresult.attr.$_ln_-s_f_l: FAILED -> PASSED
    ptestresult.attr.$_mkdir_-p_1/2/3: FAILED -> PASSED
    ptestresult.attr.$_mkdir_-p_1/sub: FAILED -> PASSED
    ptestresult.attr.$_mkdir_1/link: FAILED -> PASSED
    ptestresult.attr.$_mkdir_d: FAILED -> PASSED
    ptestresult.attr.$_mkdir_src: FAILED -> PASSED
    ptestresult.attr.$_mkdir_sub: FAILED -> PASSED
    ptestresult.attr.$_mkdir_sub2: FAILED -> PASSED
    ptestresult.attr.$_mv_f_l_sub: FAILED -> PASSED
    ptestresult.attr.$_rm_-R_1: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.9"_1: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.9"_1/2: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.9"_1/2/3: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.a"_1: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.a"_1/2: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.a"_1/2/3: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.a"_1/link: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.a"_1/link/link-file: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.a"_1/sub: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_"user.a"_1/sub/sub-file: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_user.color_-v_blue_src/target: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_user.longername_-v_longervalue_f: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_user.novalue-yet_-v_avalue-now_f: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_user.short_-v_value_f: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_user.xxxx_-v_xxxx_f: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-n_user.xxxx_-v_xxxxxxxx_f: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-x_user.longername_f: FAILED -> PASSED
    ptestresult.attr.$_setfattr_-x_user.short_f: FAILED -> PASSED
    ptestresult.attr.$_touch_1/link/link-file: FAILED -> PASSED
    ptestresult.attr.$_touch_1/sub/sub-file: FAILED -> PASSED
    ptestresult.attr.$_touch_src/target: FAILED -> PASSED
    ptestresult.busybox.ash__not_built_: SKIPPED -> None
    ptestresult.busybox.awk__not_built_: SKIPPED -> None
    ptestresult.busybox.bunzip2__not_built_: SKIPPED -> None
    ptestresult.busybox.busybox__not_built_: SKIPPED -> None
    ptestresult.busybox.bzcat__not_built_: SKIPPED -> None
    ptestresult.busybox.cat__not_built_: SKIPPED -> None
    ptestresult.busybox.cp__not_built_: SKIPPED -> None
    ptestresult.busybox.cpio__not_built_: SKIPPED -> None
    ptestresult.busybox.cut__not_built_: SKIPPED -> None
    ptestresult.busybox.dc__not_built_: SKIPPED -> None
    ptestresult.busybox.diff__not_built_: SKIPPED -> None
    ptestresult.busybox.find__not_built_: SKIPPED -> None
    ptestresult.busybox.grep__not_built_: SKIPPED -> None
    ptestresult.busybox.gunzip__not_built_: SKIPPED -> None
    ptestresult.busybox.head__not_built_: SKIPPED -> None
    ptestresult.busybox.hexdump__not_built_: SKIPPED -> None
    ptestresult.busybox.ls__not_built_: SKIPPED -> None
    ptestresult.busybox.md5sum__not_built_: SKIPPED -> None
    ptestresult.busybox.mount__not_built_: SKIPPED -> None
    ptestresult.busybox.od__not_built_: SKIPPED -> None
    ptestresult.busybox.patch__not_built_: SKIPPED -> None
    ptestresult.busybox.pidof__not_built_: SKIPPED -> None
    ptestresult.busybox.printf__not_built_: SKIPPED -> None
    ptestresult.busybox.readlink__not_built_: SKIPPED -> None
    ptestresult.busybox.sed__not_built_: SKIPPED -> None
    ptestresult.busybox.seq__not_built_: SKIPPED -> None
    ptestresult.busybox.sha1sum__not_built_: SKIPPED -> None
    ptestresult.busybox.sha256sum__not_built_: SKIPPED -> None
    ptestresult.busybox.sort__not_built_: SKIPPED -> None
    ptestresult.busybox.start-stop-daemon__not_built_: SKIPPED -> None
    ptestresult.busybox.tail__not_built_: SKIPPED -> None
    ptestresult.busybox.tar__not_built_: SKIPPED -> None
    ptestresult.busybox.test__not_built_: SKIPPED -> None
    ptestresult.busybox.tr__not_built_: SKIPPED -> None
    ptestresult.busybox.uniq__not_built_: SKIPPED -> None
    ptestresult.busybox.unzip__not_built_: SKIPPED -> None
    ptestresult.busybox.xargs-works: SKIPPED -> None
    ptestresult.busybox.xargs__not_built_: SKIPPED -> None
    ptestresult.dbus-test.test/test-corrupt: FAILED -> PASSED
    ptestresult.dbus-test.test/test-dbus: FAILED -> PASSED
    ptestresult.dbus-test.test/test-fdpass: FAILED -> PASSED
    ptestresult.dbus-test.test/test-loopback: FAILED -> PASSED
    ptestresult.dbus-test.test/test-relay: FAILED -> PASSED
    ptestresult.diffutils.basic: FAILED -> PASSED
    ptestresult.e2fsprogs.d_bad_ostype:_handle_bad__negative__os_type:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_corrupt_journal_nr_users:_Journal_superblock_corrupted,_nr_users_too_high:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_dumpe2fs_group_only:_dumpe2fs_group_only_mode:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_fallocate_blkmap:_fallocate_sparse_files_and_big_files_on_a_blockmap_fs:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_inline_dump:_debugfs_dump_inline_data_test:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_loaddump:_debugfs_load/dump_test:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_punch:_punch_sparse_files_and_big_files:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_punch_bigalloc:_punch_sparse_files_and_big_files_with_bigalloc:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_special_files:_create_special_files_in_debugfs:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_xattr_edits:_edit_extended_attributes_in_debugfs:_failed: FAILED -> None
    ptestresult.e2fsprogs.d_xattr_sorting:_sort_extended_attributes_in_debugfs:_failed: FAILED -> None
    ptestresult.e2fsprogs.e_icount_normal:_inode_counting_structure_optimized_for_low_counts:_failed: FAILED -> None
    ptestresult.e2fsprogs.e_icount_opt:_inode_counting_abstraction_optimized_for_counting:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_16384_block:_16384_byte_blocksize:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_8192_block:_8192_byte_blocksize:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_bad_bbitmap:_corrupt_block_bitmap__metadata_csum_:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_bad_bmap_csum:_bad_block/inode_bitmap_csum__metadata_csum_:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_bad_disconnected_inode:_Disconnected_inode_with_bad_fields:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_bad_gdt_csum:_bad_group_descriptor_csum__metadata_csum_:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_bad_ibitmap:_corrupt_inode_bitmap__metadata_csum_:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_bad_inode_csum:_inode_table_corruption__metadata_csum_:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_bad_local_jnl:_test_for_corrupt_local_journal__bad_V1->V2_journal_upgrade_:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_badbblocks:_illegal_blocks_in_bad_block_inode:_failed: FAILED -> None
    ptestresult.e2fsprogs.f_badcluster:_test_alignment_problems_with_bigalloc_clusters:_failed: FAILED ->

Latest revision as of 08:32, 29 March 2019

< Archive


Ran on a NUC and compared with 2.7.m2.rc2

< FULL_LOG

Failures
% increased
% decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 97.47
bluez5 25 25 0 100.0 100.0
busybox 535 533 2 99.63 100.0 Down rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 21 21 0 100.0 100.0
e2fsprogs 326 326 0 100.0 100.0
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 30 30 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 278 276 2 99.28 99.24 Up rate.png
gstreamer1.0 106 104 2 98.11 98.11
gzip 22 22 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libusb1 4 4 0 100.0 100.0
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 134 134 0 100.0 100.0
lttng-tools 4055 4050 5 99.88 99.63 Up rate.png
lzo 5 5 0 100.0 100.0
nettle 97 96 1 98.97 98.97
openssh 53 53 0 100.0 100.0
openssl 147 146 1 99.32 0 Up rate.png
pango 12 12 0 100.0 100.0
perl 2459 2441 18 99.27 99.19 Up rate.png
python 16647 16613 34 99.8 99.83 Down rate.png
python3 30616 30606 10 99.97 99.96 Up rate.png
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 484 466 18 96.28 96.3 Down rate.png
tcl 149 149 0 100.0 100.0
util-linux 509 497 12 97.64 97.29 Up rate.png
valgrind 567 316 251 55.73 55.73
zlib 2 2 0 100.0 100.0