Ptest 753e2a0ede4449917c75353b57f13bbafe70fac8: Difference between revisions

From Yocto Project
Jump to navigationJump to search
No edit summary
No edit summary
 
(4 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[https://wiki.yoctoproject.org/wiki/Ptest/archive < Archive]
[https://wiki.yoctoproject.org/wiki/Ptest/archive < Archive]


<b> PTest Summary: Regression results 2.7 M3 RC1 ran on a NUC and compared with[[Ptest be52da152a4d9f9e798844f592ec9ae7e051c658| 2.7 M2 RC2 ]]</b>
<br />Ran on a NUC and compared with[[Ptest be52da152a4d9f9e798844f592ec9ae7e051c658| 2.7.m2.rc2]]


==============================================================================================================
[https://wiki.yoctoproject.org/wiki/images/e/e6/Ptest_27_m3_rc1.txt < FULL_LOG]
PTest Result Summary
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Recipe            | Passed      | Failed  | Skipped  | Time(s) 
--------------------------------------------------------------------------------------------------------------
acl                | 222        | 0        | 0        | 1
attr              | 108        | 0        | 0        | 1
bash              | 76          | 3        | 0        | 159
bluez5            | 25          | 0        | 0        | 7
busybox            | 496        | 2        | 70        | 304 T
bzip2              | 6          | 0        | 0        | 0
dbus-test          | 18          | 3        | 2        | 32
diffstat          | 439        | 0        | 0        | 5
diffutils          | 21          | 0        | 0        | 4
e2fsprogs          | 358        | 4        | 32        | 969
flex              | 114        | 0        | 0        | 2
gawk              | 342        | 0        | 0        | 20
gdbm              | 24          | 0        | 0        | 3
gdk-pixbuf        | 20          | 0        | 0        | 27
glib-2.0          | 273        | 4        | 0        | 659
gstreamer1.0      | 100        | 4        | 0        | 93
gzip              | 22          | 0        | 0        | 4
kbd                | 7          | 0        | 0        | 0
libpcre            | 3          | 0        | 0        | 1
libusb1            | 4          | 0        | 0        | 8
libxml-parser-perl | 15          | 0        | 0        | 1
libxml2            | 134        | 0        | 0        | 11
lttng-tools        | 4050        | 5        | 0        | 697 T
lzo                | 5          | 0        | 0        | 30
nettle            | 96          | 1        | 2        | 7
openssh            | 53          | 0        | 3        | 653 T
openssl            | 146        | 1        | 8        | 61
pango              | 12          | 0        | 0        | 0
perl              | 2441        | 19      | 232      | 651
python            | 16220      | 20      | 725      | 321
python3            | 30251      | 2        | 968      | 1011
quilt              | 0          | 57      | 0        | 1
sed                | 86          | 0        | 0        | 3
slang              | 97          | 0        | 0        | 20
strace            | 227        | 282      | 106      | 344 T
tcl                | 149        | 0        | 0        | 2
util-linux        | 0          | 425      | 48        | -
--------------------------------------------------------------------------------------------------------------


==============================================================================================================
{| style="border-spacing:0;"
Ptest Regression:
| style="background-color:#ff8080;border:0.05pt solid #000000;padding:0.0382in;"| Failures
runtime_core-image-sato-sdk-ptest_genericx86-64_20190323094701
|-
runtime_core-image-sato-sdk-ptest_genericx86-64_20190325102236
| style="background-color:#99ff66;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;"| % increased
==============================================================================================================
|-
    ptestresult.busybox.cut_'-'__stdin__and_mdc:_syntax_error_at_'?2': PASSED -> None
| style="background-color:#c5000b;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#ffffff"| % decreased
    ptestresult.busybox.dc_'>a'__conditional_execute_string__1: SKIPPED -> None
|-
    ptestresult.busybox.dc_'>a'__conditional_execute_string__2: SKIPPED -> None
| style="background-color:gray;border-top:none;border-bottom:0.05ptsolid #000000;border-left:0.05pt solid #000000;border-right:0.05ptsolid #000000;padding:0.0201in;color:#000000"| Module not executed
    ptestresult.busybox.dc_'>aeb'__conditional_execute_string_with_else_: SKIPPED -> None
|}
    ptestresult.busybox.dc_-x_dcx_vars.dc: SKIPPED -> None
 
    ptestresult.busybox.dc_dc_add.dc: SKIPPED -> None
{| class="wikitable"
    ptestresult.busybox.dc_dc_boolean.dc: SKIPPED -> None
|+Results
    ptestresult.busybox.dc_dc_decimal.dc: SKIPPED -> None
|-
    ptestresult.busybox.dc_dc_divide.dc: SKIPPED -> None
| align=center style="background-color:#ccffff;border-top:0.05pt solid #000000;border-bottom:0.5pt solid#000000;border-left:0.05pt solid #000000;
    ptestresult.busybox.dc_dc_divmod.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_misc.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_modexp.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_modulus.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_multiply.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_power.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_sqrt.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_strings.dc: SKIPPED -> None
    ptestresult.busybox.dc_dc_subtract.dc: SKIPPED -> None
    ptestresult.busybox.dc_newline_can_be_a_register: SKIPPED -> None
    ptestresult.busybox.dc_read: FAILED -> None
    ptestresult.busybox.dc_read_string: FAILED -> None
    ptestresult.busybox.dc_space_can_be_a_register: SKIPPED -> None
    ptestresult.busybox.grep_-x_-v_-e_EXP1_-e_EXP2_finds_nothing_if_either_EXP_matches: PASSED -> None
    ptestresult.busybox.head_-n_<negative_number>: SKIPPED -> None
    ptestresult.busybox.head_-n_<positive_number>: PASSED -> None
    ptestresult.busybox.head__without_args_: PASSED -> None
    ptestresult.busybox.hexdump_-C_with_four_NULs: PASSED -> None
    ptestresult.busybox.printf_handles_positive_numbers_for_%d: PASSED -> None
    ptestresult.busybox.printf_handles_positive_numbers_for_%f: PASSED -> None
    ptestresult.busybox.printf_handles_positive_numbers_for_%i: PASSED -> None
    ptestresult.busybox.printf_handles_positive_numbers_for_%x: PASSED -> None
    ptestresult.diffutils.strip-trailing-cr: PASSED -> None
    ptestresult.e2fsprogs.d_corrupt_journal_nr_users:_Journal_superblock_corrupted,_nr_users_too_high:_ok: PASSED -> None
    ptestresult.e2fsprogs.f_inlinedata_flags:_check_incorrect_inline_data_flags:_ok: PASSED -> None
    ptestresult.e2fsprogs.f_resize_inode_meta_bg:_conflicting_features_resize_inode_and_meta_bg:_ok: PASSED -> None
    ptestresult.e2fsprogs.m_image_mmp:_create_image_for_partition_with_enabled_mmp_and_execute_fsck_on_image:_ok: PASSED -> None
    ptestresult.e2fsprogs.m_resize_inode_meta_bg:_resize_inode_and_meta_bg_enabled:_ok: PASSED -> None
    ptestresult.e2fsprogs.r_move_inode_int_extent:_move_inode_and_its_interior_extent_tree_block:_skipped__no_debugfs/resize2fs_: SKIPPED -> None
    ptestresult.e2fsprogs.tr_has_correct_xdigit_sequence: PASSED -> None
    ptestresult.e2fsprogs.true-is-silent: PASSED -> None
    ptestresult.e2fsprogs.true-returns-success: PASSED -> None
    ptestresult.e2fsprogs.uniq_-__specify_stdin_: PASSED -> None
    ptestresult.e2fsprogs.uniq_-c__occurrence_count_: PASSED -> None
    ptestresult.e2fsprogs.uniq_-d__dups_only_: PASSED -> None
    ptestresult.e2fsprogs.uniq_-f_-s__skip_fields_and_chars_: PASSED -> None
    ptestresult.e2fsprogs.uniq_-s_-w__skip_fields_and_compare_max_chars_: PASSED -> None
    ptestresult.e2fsprogs.uniq_-w__compare_max_characters_: PASSED -> None
    ptestresult.e2fsprogs.uniq__default_to_stdin_: PASSED -> None
    ptestresult.e2fsprogs.uniq__exit_success_: PASSED -> None
    ptestresult.e2fsprogs.uniq__exit_with_error_: PASSED -> None
    ptestresult.e2fsprogs.uniq__stdin__outfile: PASSED -> None
    ptestresult.e2fsprogs.uniq_input_-__specify_stdout_: PASSED -> None
    ptestresult.e2fsprogs.uniq_input__specify_file_: PASSED -> None
    ptestresult.e2fsprogs.uniq_input_outfile__two_files_: PASSED -> None
    ptestresult.glib-2.0.glib/autoptr-gio.test: PASSED -> None
    ptestresult.glib-2.0.glib/closures.test: PASSED -> None
    ptestresult.glib-2.0.glib/date.test: PASSED -> None
    ptestresult.glib-2.0.glib/flags.test: PASSED -> None
    ptestresult.glib-2.0.glib/gdatetime.test__Child_process_killed_by_signal_6_: FAILED -> None
    ptestresult.glib-2.0.glib/gdbus-connection-flush.test__Child_process_killed_by_signal_5_: FAILED -> None
    ptestresult.glib-2.0.glib/gdbus-non-socket.test__Child_process_killed_by_signal_9_: FAILED -> None
    ptestresult.glib-2.0.glib/gdbus-peer.test__Child_process_killed_by_signal_5_: FAILED -> None
    ptestresult.glib-2.0.glib/gobject-private.test: PASSED -> None
    ptestresult.glib-2.0.glib/objects.test: PASSED -> None
    ptestresult.glib-2.0.glib/objects2.test: PASSED -> None
    ptestresult.glib-2.0.glib/properties2.test: PASSED -> None
    ptestresult.glib-2.0.glib/properties3.test: PASSED -> None
    ptestresult.glib-2.0.glib/properties4.test: PASSED -> None
    ptestresult.glib-2.0.glib/refcount-macro.test: PASSED -> None
    ptestresult.glib-2.0.glib/refcount.test: PASSED -> None
    ptestresult.glib-2.0.glib/signal1.test: PASSED -> None
    ptestresult.glib-2.0.glib/signal2.test: PASSED -> None
    ptestresult.glib-2.0.glib/signal3.test: PASSED -> None
    ptestresult.glib-2.0.glib/signal4.test: PASSED -> None
    ptestresult.gstreamer1.0.gst/gstelement: FAILED -> PASSED
    ptestresult.gstreamer1.0.gst/gstsystemclock: FAILED -> PASSED
    ptestresult.gzip.reproducible: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_10_-_Expect_1_uid_registration_folder_got_1: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_11_-_Destroy_session_shm_path_per_uid: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_12_-_Full_cleanup: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_13_-_Kill_session_daemon: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_14_-_Start_session_daemon: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_15_-_Create_session_shm_path_per_pid_in_/tmp/tmp.sXQYkQworn: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_16_-_Enable_channel_channel_per_pid_for_session_shm_path_per_pid: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_17_-_Start_tracing_for_session_shm_path_per_pid: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_18_-_No_file_created_on_set-up: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_19_-_Start_application_to_trace: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_20_-_Path_/tmp/tmp.TAeoszruSe/shm_path_per_pid-20190326-053824_created_on_application_creation: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_21_-_Pid_path_exists:_/tmp/tmp.TAeoszruSe/shm_path_per_pid-20190326-053824/ust/pid/gen-ust-events-4525-20190326-053824: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_22_-_Expect_1_pid_registration_folder_got_1: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_23_-_Expect_>_0_buffer_and_metadata_files_got_9: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_24_-_Start_application_to_trace: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_25_-_Pid_path_exist_found_/tmp/tmp.TAeoszruSe/shm_path_per_pid-20190326-053824/ust/pid/gen-ust-events-4542-20190326-053825: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_26_-_Expect_2_pid_registration_folder_got_2: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_27_-_First_pid_cleanup: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_28_-_Full_cleanup: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_29_-_Destroy_session_shm_path_per_pid: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_2_-_Create_session_shm_path_per_uid_in_/tmp/tmp.sXQYkQworn: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_30_-_Kill_session_daemon: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_31_-_Start_session_daemon: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_32_-_Create_session_shm_path_per_pid_in_/tmp/tmp.sXQYkQworn: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_33_-_Enable_channel_channel_per_pid_for_session_shm_path_per_pid: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_34_-_Start_tracing_for_session_shm_path_per_pid: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_35_-_Start_application_to_trace: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_36_-_Start_application_to_trace: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_37_-_Kill_session_daemon: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_38_-_Full_cleanup_on_sigint: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_39_-_Start_session_daemon: PASSED -> None
    ptestresult.lttng-tools.tools/crash/test_crash_40_-_Create_session_shm_path_per_uid_sigint_in_

Latest revision as of 08:32, 29 March 2019

< Archive


Ran on a NUC and compared with 2.7.m2.rc2

< FULL_LOG

Failures
% increased
% decreased
Module not executed
Results
Package Name Tests ran Passed Failed Passrate Last Passrate
acl 380 380 0 100.0 100.0
attr 143 143 0 100.0 100.0
bash 79 77 2 97.47 97.47
bluez5 25 25 0 100.0 100.0
busybox 535 533 2 99.63 100.0 Down rate.png
bzip2 6 6 0 100.0 100.0
dbus-test 21 19 2 90.48 90.48
diffstat 440 440 0 100.0 100.0
diffutils 21 21 0 100.0 100.0
e2fsprogs 326 326 0 100.0 100.0
flex 114 114 0 100.0 100.0
gawk 344 344 0 100.0 100.0
gdbm 30 30 0 100.0 100.0
gdk-pixbuf 20 20 0 100.0 100.0
glib-2.0 278 276 2 99.28 99.24 Up rate.png
gstreamer1.0 106 104 2 98.11 98.11
gzip 22 22 0 100.0 100.0
kbd 7 7 0 100.0 100.0
libpcre 3 3 0 100.0 100.0
libusb1 4 4 0 100.0 100.0
libxml-parser-perl 15 15 0 100.0 100.0
libxml2 134 134 0 100.0 100.0
lttng-tools 4055 4050 5 99.88 99.63 Up rate.png
lzo 5 5 0 100.0 100.0
nettle 97 96 1 98.97 98.97
openssh 53 53 0 100.0 100.0
openssl 147 146 1 99.32 0 Up rate.png
pango 12 12 0 100.0 100.0
perl 2459 2441 18 99.27 99.19 Up rate.png
python 16647 16613 34 99.8 99.83 Down rate.png
python3 30616 30606 10 99.97 99.96 Up rate.png
quilt 57 57 0 100.0 100.0
sed 86 86 0 100.0 100.0
slang 97 97 0 100.0 100.0
strace 484 466 18 96.28 96.3 Down rate.png
tcl 149 149 0 100.0 100.0
util-linux 509 497 12 97.64 97.29 Up rate.png
valgrind 567 316 251 55.73 55.73
zlib 2 2 0 100.0 100.0