WW41 - 2015-10-02 - Full Pass 2.0.rc1

From Yocto Project
Jump to navigationJump to search
{{#vardefine:adt_fedora_i686| 4708, 4709 }} {{#vardefine:adt_fedora_x86-64| }} {{#vardefine:adt_ubuntu_x86-64| 4706, 4707 }} {{#vardefine:beaglebone_black| 4714, 4715 }} {{#vardefine:edgerouter| 4716, 4717 }} {{#vardefine:genericx86| 4471, 4468, 4439, 4437 }} {{#vardefine:genericx86_64| 4436, 4435, 4434 }} {{#vardefine:mpc8315e-rdb| 4718, 4719 }} {{#vardefine:p1022ds-rdb| 4711, 4710 }} {{#vardefine:qemux86| 4441, 4440 }} {{#vardefine:qemuarm| 4449, 4447, 4722, 4723 }} {{#vardefine:qemumips| 4453, 4450, 4720, 4721 }} {{#vardefine:qemuppc| 4456, 4454 }} {{#vardefine:qemux86-64| 4445, 4444 }} {{#vardefine:eclipseplugin| 4465, 4464, 4463 }} {{#vardefine:meta-yocto| 4472, 4725 }} {{#vardefine:hob| }} {{#vardefine:toaster| 4472, 4473, 4474, 4475 }} {{#vardefine:oe-core| 4457 }} {{#vardefine:distro| 4479, 4478, 4477, 4476 }} {{#vardefine:bitbake| 4469, 4460 }} {{#vardefine:runtime| 4480 }} {{#vardefine:build-appliance| 4461 }}

Testing data

 Test type:  Full Pass Release Test
 Branch: master
 Build name: 2.0.rc1
 poky commit: eac61f37e36099f74485dab398b57f3812826d17
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.0.rc1/
 Distributions tested: Ubuntu 15.04 64 bit, Ubuntu 14.04 64bit, Fedora 21 64bit, Fedora 22 64bit, Opensuse 13.2 64bit, CentOS 7 64 bit 

Test Run Summary Report

{{#testopia: run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:adt_ubuntu_1310_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} report_id=concatstats}}


{{#testopia:

chart=bstatus report_id=bugs charttype=bar sortable=true nudechart=true chartpos=top

}}


{{#testopia:

run_id=0, {{#var:bitbake}}, {{#var:oe-core}}, {{#var:meta-yocto}}, {{#var:hob}}, {{#var:nuc}}, {{#var:atom-pc}}, {{#var:genericx86}}, {{#var:genericx86_64}}, {{#var:beaglebone_black}}, {{#var:edgerouter}}, {{#var:mpc8315e-rdb}}, {{#var:p1022ds-rdb}}, {{#var:qemux86}}, {{#var:qemux86-64}}, {{#var:qemuarm}}, {{#var:qemumips}}, {{#var:qemuppc}}, {{#var:runtime}}, {{#var:build-appliance}}, {{#var:toaster}}, {{#var:adt_opensuse_123_x86-64}}, {{#var:adt_fedora18_i686}}, {{#var:adt_fedora19_x86-64}}, {{#var:adt_fedora19_i686}}, {{#var:adt_fedora_i686}}, {{#var:adt_ubuntu_x86-64}}, {{#var:eclipseplugin}}, {{#var:distro}} charttype=bar report_id=status}}



Bugs Found during QA Test

New and notable issues Found during QA Test & Community

IDSummary (4 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
ADT
8124Fail to install sdk ext on i686 hostMedium+Randy WittYi Zhao2.0.1VERIFIEDFIXEDNew (Never tested)2015-08-07
Kernel
8486Failed to do_patch for linux-yocto after add a patch by yocto-kernel toolMedium+Leonardo Sandoval GonzalezYi Zhao2.0.1VERIFIEDFIXEDRegression (Used to work)2015-10-12
OE-Core
8448Audio via HDMI doesn't workMediumJussi KukkonenCristina Agurida2.1VERIFIEDFIXEDNew (Never tested)2015-10-06
Toaster
8459Recipe details in build don't show tasksMediumMichael WoodAlexandru Roman2.0VERIFIEDFIXEDRegression (Used to work)2015-10-08


Other Bugs found during QA Test

IDSummary (11 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
---
8484Yocto 2.0 rc1: i2c eeprom cannot be probed on MPC8315e-rdbMediumKevin HaoKe Zou2.1VERIFIEDFIXED---2015-10-12
New (Never tested)
7897Dmesg error BAR 14 and BAR 15 failed to assign in Minnow MaxMediumSaul WoldCristina Agurida2.1 M3RESOLVEDFIXEDNew (Never tested)2015-06-17
Toaster
7880Toaster uses the same /tmp dir across releasesMedium+Ed BartoshAlexandru Roman2.1 M4VERIFIEDFIXEDNew (Never tested)2015-06-11
Regression (Found by QA test)
6584dmesg uvesafb: probe of uvesafb.0 failed with error -22 on genericx86/genericx86-64 on NUC and MinnowMaxMediumJianxun ZhangCristina Agurida2.1RESOLVEDFIXEDRegression (Found by QA test)2014-07-28
Regression (Used to work)
8308[ADT] Fail to install adt-installerMediumJuro BystrickyValentin Hangan2.0VERIFIEDFIXEDRegression (Used to work)2015-09-16
BSPs
8312Bad video quality during playback on media playerMediumSaul WoldCristina Agurida2.1RESOLVEDFIXEDRegression (Used to work)2015-09-16
Toaster
8125Filter does not work as expected after clearing the search resultsMediumMichael WoodCristina Agurida2.2RESOLVEDDUPLICATERegression (Used to work)2015-08-07
8148Sorting the content of the Layer/Machines table doesn't workMediumMichael WoodAlexandru Roman2.1VERIFIEDFIXEDRegression (Used to work)2015-08-11
7198Hiding a sorted column does not revert to default sortingMediumMichael WoodLibertad2.2RESOLVEDDUPLICATERegression (Used to work)2015-01-20
8131All builds page "Errors"/"Warnings" filters doesn't workMediumMichael WoodLibertad2.2RESOLVEDOBSOLETERegression (Used to work)2015-08-10
8126Messages are missing when "IMAGE_FSTYPES" field is not properly editedMediumDavid ReynaDavid Lopez Barriba2.4 M4RESOLVEDFIXEDRegression (Used to work)2015-08-07

pTest open bugs

IDSummary (5 tasks) PAssigneeQAMilestoneStatusResolutioncf_regression_typeCreated
Program Management
8064ptest fails tracker bugMediumRoss Burton 2.5RESOLVEDOBSOLETE---2015-07-28
Runtime Testing
8146ptest - some test cases are failing for aclMediumAjay KumarRoss Burton2.2RESOLVEDDUPLICATE---2015-08-11
8471ptest - some valgrind ptests fail on 2.4 M1.rc1MediumMaxin B. John 4.99RESOLVEDDUPLICATERegression (Used to work)2015-10-09
8171ptest: testxlate test case failed for apr-utilMediumMaxin B. JohnCristina Agurida2.1RESOLVEDFIXED---2015-08-17
8367ptest - perl tests fail for genericx86-64 on NUCMedium+Armin KusterLucian Musat2.0VERIFIEDFIXED---2015-09-22

Current community Open Bugs - Medium+/High

Overview of the open bugs opened against current milestone or release which are Medium+ or High and are not targeted for the next milestones

IDPSummaryAssigneeQAMilestoneStatuscf_regression_typeCreated
  0      
Runtime Testing
8307Medium+AttributeError: 'TestContext' object has no attribute 'sigterm'Mariano LopezAlexandru Georgescu2.0CLOSED---2015-09-16
  1      

Bug Trend

An overview of this week's Yocto Bug Trend charts can be accessed on the following page

pTest results for genericx86-64 on NUC

< Back

Results
Package Name Tests ran Passed Failed Passrate Last Passrate Run difference
valgrind 561 402 159 72.0 2.0
Yes

Results for sugarbay ptest valgrind 2015-10-05:
********************************

Tests that failed now and worked last time: 2

memcheck/tests/demangle
memcheck/tests/err_disable_arange1

Tests that passed now and and failed last time: 365

none/tests/amd64/clc
massif/tests/big-alloc
callgrind/tests/notpower2-hwpref
memcheck/tests/amd64/insn_sse
drd/tests/tc24_nonzero_sem
massif/tests/basic2
memcheck/tests/reach_thread_register
drd/tests/tc15_laog_lockdel
none/tests/amd64/fma
helgrind/tests/tc02_simple_tls
massif/tests/thresholds_10_0
callgrind/tests/simwork-branch
none/tests/amd64/pcmpstr64
callgrind/tests/notpower2-use
helgrind/tests/t2t_laog
none/tests/resolv
memcheck/tests/custom-overlap
callgrind/tests/simwork-both
none/tests/amd64/insn_sse2
helgrind/tests/tc17_sembar
memcheck/tests/vcpu_fbench
drd/tests/sem_as_mutex2
drd/tests/sem_as_mutex3
drd/tests/tc06_two_races
none/tests/nestedfns
memcheck/tests/leak-0
none/tests/amd64/insn_pclmulqdq
none/tests/amd64/bmi
none/tests/amd64/avx2-1
memcheck/tests/new_override
memcheck/tests/supp_unknown
none/tests/rlimit_nofile
memcheck/tests/amd64/bug132146
none/tests/amd64/loopnel
none/tests/amd64/fcmovnu
helgrind/tests/cond_init_destroy
drd/tests/pth_barrier
none/tests/exec-sigmask
none/tests/amd64/pcmpxstrx64
none/tests/amd64/rcl-amd64
memcheck/tests/sigprocmask
drd/tests/tc03_re_excl
none/tests/pth_atfork1
memcheck/tests/origin6-fp
memcheck/tests/thread_alloca
massif/tests/thresholds_5_10
drd/tests/sigaltstack
none/tests/empty-exe
memcheck/tests/sh-mem
drd/tests/annotate_spinlock
memcheck/tests/recursive-merge
memcheck/tests/amd64/bt_everything
memcheck/tests/linux/capget
drd/tests/pth_cond_race2
drd/tests/pth_cond_race3
drd/tests/matinv
helgrind/tests/hg06_readshared
none/tests/amd64/insn_ssse3
memcheck/tests/badloop
memcheck/tests/linux/syslog-syscall
helgrind/tests/tc24_nonzero_sem
memcheck/tests/addressable
memcheck/tests/supp2
drd/tests/annotate_ignore_read
memcheck/tests/supp1
none/tests/amd64/avx-1
massif/tests/long-names
memcheck/tests/str_tester
memcheck/tests/unit_oset
memcheck/tests/nanoleak2
drd/tests/sem_open_traced
massif/tests/culling2
massif/tests/culling1
none/tests/fdleak_socketpair
drd/tests/annotate_static
none/tests/readline1
drd/tests/monitor_example
callgrind/tests/clreq
memcheck/tests/long-supps
massif/tests/basic
none/tests/fdleak_open
none/tests/pth_once
memcheck/tests/sem
none/tests/args
drd/tests/annotate_trace_memory
memcheck/tests/writev1
drd/tests/sem_wait
memcheck/tests/file_locking
memcheck/tests/error_counts
none/tests/discard
memcheck/tests/clo_redzone_default
none/tests/amd64/slahf-amd64
drd/tests/new_delete
none/tests/allexec32
memcheck/tests/wcs
none/tests/fcntl_setown
drd/tests/sem_open
drd/tests/bug-235681
memcheck/tests/amd64/fxsave-amd64
none/tests/pth_empty
drd/tests/sem_as_mutex
memcheck/tests/execve1
drd/tests/linuxthreads_det
none/tests/amd64/insn_mmx
none/tests/munmap_exe
memcheck/tests/describe-block
none/tests/pth_rwlock
memcheck/tests/linux/timerfd-syscall
drd/tests/pth_spinlock
none/tests/pth_blockedsig
drd/tests/annotate_hb_race
memcheck/tests/pipe
none/tests/pending
none/tests/fdleak_pipe
memcheck/tests/brk2
memcheck/tests/unit_libcbase
drd/tests/custom_alloc
none/tests/bitfield1
memcheck/tests/signal2
none/tests/coolo_strlen
none/tests/mq
callgrind/tests/simwork1
callgrind/tests/simwork3
callgrind/tests/simwork2
none/tests/amd64/crc32
memcheck/tests/amd64/sse_memory
none/tests/rlimit64_nofile
massif/tests/long-time
drd/tests/unit_bitmap
none/tests/allexec64
none/tests/amd64/shrld
memcheck/tests/amd64/insn-pmovmskb
memcheck/tests/linux/sigqueue
none/tests/amd64/amd64locked
drd/tests/annotate_order_1
drd/tests/annotate_order_3
none/tests/rcrl
drd/tests/annotate_ignore_write2
memcheck/tests/new_nothrow
cachegrind/tests/wrap5
drd/tests/annotate_smart_pointer
callgrind/tests/simwork-cache
massif/tests/null
memcheck/tests/linux/getregset
none/tests/amd64/sbbmisc
massif/tests/ignored
massif/tests/peak2
none/tests/linux/mremap
none/tests/fdleak_fcntl
memcheck/tests/vbit-test/vbit-test
none/tests/amd64/jrcxz
none/tests/execve
massif/tests/insig
helgrind/tests/rwlock_test
none/tests/amd64/fxtract
massif/tests/alloc-fns-B
massif/tests/alloc-fns-A
memcheck/tests/linux/brk
none/tests/amd64/smc1
memcheck/tests/sh-mem-random
memcheck/tests/badjump2
memcheck/tests/varinfo6
memcheck/tests/varinfo3
memcheck/tests/buflen_check
none/tests/ansi
memcheck/tests/malloc_usable
drd/tests/hg06_readshared
drd/tests/hg02_deadlock
memcheck/tests/pdb-realloc2
memcheck/tests/partiallydefinedeq
memcheck/tests/match-overrun
cachegrind/tests/chdir
none/tests/async-sigs
drd/tests/annotate_ignore_rw
none/tests/manythreads
memcheck/tests/linux/syscalls-2007
none/tests/amd64/bug156404-amd64
massif/tests/one
drd/tests/annotate_rwlock
drd/tests/tc16_byterace
drd/tests/concurrent_close
memcheck/tests/mallinfo
memcheck/tests/calloc-overflow
none/tests/map_unaligned
memcheck/tests/nanoleak_supp
memcheck/tests/null_socket
memcheck/tests/sigaltstack
helgrind/tests/bar_trivial
none/tests/linux/mremap2
none/tests/linux/mremap3
callgrind/tests/notpower2
none/tests/fdleak_creat
memcheck/tests/linux/lsframe1
memcheck/tests/sbfragment
memcheck/tests/manuel2
memcheck/tests/sendmsg
none/tests/amd64/sse4-64
memcheck/tests/memalign2
none/tests/amd64/cmpxchg
drd/tests/pth_broadcast
none/tests/ifunc
drd/tests/annotate_hbefore
drd/tests/tc08_hbl2
memcheck/tests/badjump
none/tests/fucomip
memcheck/tests/leak-pool-1
drd/tests/free_is_write2
helgrind/tests/annotate_hbefore
none/tests/bug129866
massif/tests/thresholds_10_10
memcheck/tests/linux/stack_switch
helgrind/tests/tc03_re_excl
memcheck/tests/amd64/insn_mmx
none/tests/amd64/bug127521-64
none/tests/amd64/ssse3_misaligned
drd/tests/rwlock_test
none/tests/amd64/redundantRexW
none/tests/amd64/pcmpxstrx64w
memcheck/tests/stpncpy
helgrind/tests/annotate_smart_pointer
memcheck/tests/linux/proc-auxv
none/tests/faultstatus
memcheck/tests/vcpu_fnfns
drd/tests/sem_open2
drd/tests/sem_open3
memcheck/tests/malloc_free_fill
none/tests/pth_cancel1
none/tests/pth_cancel2
callgrind/tests/threads
none/tests/amd64/aes
none/tests/amd64/insn_basic
drd/tests/tc02_simple_tls
drd/tests/sigalrm
none/tests/amd64/insn_sse3
none/tests/fdleak_ipv4
none/tests/pth_exit2
massif/tests/ignoring
memcheck/tests/amd64/insn_sse2
massif/tests/zero2
none/tests/floored
massif/tests/zero1
none/tests/amd64/pcmpstr64w
none/tests/amd64/insn_fpu
massif/tests/no-stack-no-heap
memcheck/tests/amd64-linux/int3-amd64
none/tests/gxx304
massif/tests/thresholds_0_0
none/tests/fdleak_dup2
callgrind/tests/threads-use
memcheck/tests/sigkill
drd/tests/annotate_publish_hg
drd/tests/pth_create_chain
drd/tests/pth_barrier3
drd/tests/pth_barrier2
none/tests/fork
massif/tests/peak
drd/tests/free_is_write
massif/tests/thresholds_0_10
none/tests/pth_stackalign
memcheck/tests/mmaptest
memcheck/tests/linux/sys-openat
drd/tests/annotate_ignore_write
none/tests/amd64/xacq_xrel
none/tests/amd64/xadd
massif/tests/realloc
none/tests/amd64/asorep
memcheck/tests/wrap2
memcheck/tests/wrap3
memcheck/tests/wrap1
memcheck/tests/wrap6
memcheck/tests/wrap7
memcheck/tests/wrap4
memcheck/tests/wrap5
memcheck/tests/amd64/insn-pcmpistri
memcheck/tests/wrap8
memcheck/tests/amd64/xor-undef-amd64
drd/tests/pth_detached2
memcheck/tests/atomic_incs
memcheck/tests/amd64/insn_fpu
memcheck/tests/manuel3
memcheck/tests/manuel1
callgrind/tests/notpower2-wb
drd/tests/hg01_all_ok
memcheck/tests/execve2
drd/tests/tc07_hbl1
memcheck/tests/inits
drd/tests/fp_race2
cachegrind/tests/notpower2
none/tests/linux/blockfault
none/tests/closeall
none/tests/amd64/movbe
none/tests/cmd-with-special
drd/tests/tc01_simple_race
memcheck/tests/realloc1
none/tests/amd64/nan80and64
memcheck/tests/metadata
none/tests/require-text-symbol-1
memcheck/tests/erringfds
massif/tests/deep-A
massif/tests/deep-B
massif/tests/deep-C
massif/tests/deep-D
none/tests/fdleak_dup
memcheck/tests/realloc2
none/tests/amd64/bug132813-amd64
helgrind/tests/tc07_hbl1
drd/tests/custom_alloc_fiw
none/tests/pth_mutexspeed
massif/tests/pages_as_heap
drd/tests/threaded-fork
drd/tests/tc05_simple_race
memcheck/tests/amd64/insn-bsfl
drd/tests/tc13_laog1
none/tests/amd64/looper
memcheck/tests/linux/stack_changes
memcheck/tests/amd64/more_x87_fp
memcheck/tests/malloc1_ks_none
none/tests/pth_cvsimple
memcheck/tests/varinfo4
memcheck/tests/post-syscall
memcheck/tests/amd64/insn_basic
none/tests/process_vm_readv_writev
massif/tests/thresholds_5_0
memcheck/tests/pdb-realloc
none/tests/pth_exit
drd/tests/pth_process_shared_mutex
memcheck/tests/varinfo2
memcheck/tests/client-msg
none/tests/amd64/insn_sse
memcheck/tests/amd64/bug279698
drd/tests/pth_cleanup_handler
drd/tests/unit_vc
memcheck/tests/linux/lsframe2
memcheck/tests/leak-pool-3
memcheck/tests/leak-pool-2
memcheck/tests/leak-pool-0
memcheck/tests/leak-pool-5
memcheck/tests/leak-pool-4
none/tests/amd64/bug132918
none/tests/map_unmap
helgrind/tests/tc04_free_lock
drd/tests/memory_allocation
drd/tests/pth_detached
drd/tests/bar_trivial
cachegrind/tests/dlclose
memcheck/tests/clientperm
drd/tests/tc11_XCHG
helgrind/tests/tc11_XCHG
none/tests/amd64/bug137714-amd64
none/tests/amd64/tm1
memcheck/tests/deep-backtrace
none/tests/procfs-linux
helgrind/tests/hg01_all_ok
cachegrind/tests/clreq
massif/tests/custom_alloc
drd/tests/tc17_sembar
memcheck/tests/bug287260
none/tests/coolo_sigaction
drd/tests/fp_race
massif/tests/malloc_usable
drd/tests/annotate_ignore_rw2
drd/tests/circular_buffer
drd/tests/pth_detached_sem
none/tests/amd64/nibz_bennee_mmap
helgrind/tests/tc08_hbl2

Tests that were skipped now and worked last time: 1

none/tests/res_search

Tests that were skipped last time and worked now: 27

drd/tests/tls_threads
drd/tests/boost_thread
helgrind/tests/cond_timedwait_test
helgrind/tests/tls_threads
drd/tests/std_list
memcheck/tests/suppfreecollision
drd/tests/std_atomic
memcheck/tests/supponlyobj
memcheck/tests/descr_belowsp
memcheck/tests/linux/rfcomm
drd/tests/std_thread
drd/tests/std_thread2
drd/tests/str_tester
memcheck/tests/inlinfosuppobj
drd/tests/std_string
memcheck/tests/inltemplate
memcheck/tests/demangle
none/tests/amd64/x87trigOOR
drd/tests/annotate_sem
memcheck/tests/inlinfosupp
none/tests/amd64/mpx
memcheck/tests/varinforestrict
memcheck/tests/inlinfo
none/tests/ioctl_moans
drd/tests/threaded-fork-vcs
memcheck/tests/suppvarinfo5
memcheck/tests/err_disable_arange1
lttng-tools 583 577 6 99.0 99.0 No
beecrypt 21 21 0 100.0 100.0 No
diffstat 439 439 0 100.0 100.0 No
strace 30 24 6 80.0 100.0
Yes

Results for sugarbay ptest strace 2015-10-05:
********************************

Tests that failed now and worked last time: 6

caps.test
sun_path.test
select.test
net-yy.test
getrandom.test
uid.test

Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 5

stat
net
qual_syscall
strace-f
ptrace_setoptions

Tests that were skipped last time and worked now: 30

ipc_sem.test
detach-sleeping.test
qual_syscall.test
dumpio.test
statfs.test
net.test
sigaction.test
caps.test
sun_path.test
net-fd.test
fanotify_mark.test
count.test
stat.test
scm_rights-fd.test
uio.test
bexecve.test
select.test
ipc_msg.test
strace-f.test
net-yy.test
pc.test
detach-stopped.test
detach-running.test
ioctl.test
getrandom.test
uid.test
sigreturn.test
stat64-v.test
mmsg.test
ipc_shm.test
acl 211 197 14 93.0 93.0 No
libpcre 3 3 0 100.0 67.0
Yes

Results for sugarbay ptest libpcre 2015-10-05:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

RunTest

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

quilt 55 54 1 98.0 98.0 No
pango 11 10 1 91.0 100.0
Yes

Results for sugarbay ptest pango 2015-10-05:
********************************

Tests that failed now and worked last time: 1

pango/test-layout.test (Child process killed by signal 6)

Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 3

pango/test-layout.test (Child process killed by signal 6)
pango/test-font.test
pango/markup-parse.test
busybox 487 473 14 97.0 96.0
Yes

Results for sugarbay ptest busybox 2015-10-05:
********************************

Tests that failed now and worked last time: 1

sed n (flushes pattern space terminates early)

Tests that passed now and and failed last time: 3

grep -w ^str doesn't match str not at the beginning
sort key range with numeric option and global reverse
sort key range with multiple options

Tests that were skipped now and worked last time: 2

uniq input ou/usr/lib/busybox/ptest/testsuite/unzip.tests
sed n (flushes pattern space terminates earsed

Tests that were skipped last time and worked now: 18

awk continue
awk break
grep -r on symlink to dir
sed s///NUM test
find -exec exitcode 4
find -exec exitcode 3
find -exec exitcode 2
sed n (flushes pattern space terminates early)
test '(' = '('
uniq input outfile (two files)
grep -r on dir/symlink to dir
grep -w word match second word
test '!' = '!'
find -type f
test '!' '!' = '!'
test '!' '(' = '('
grep -w word doesn't match wordword
find -exec exitcode 1
dbus-test 15 15 0 100.0 100.0 No
openssl 48 48 0 100.0 98.0
Yes

Results for sugarbay ptest openssl 2015-10-05:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

test_constant_time

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 4

test_ocsp
test_evp_extra
test_v3name
test_verify_extra
libxml2 85 85 0 100.0 100.0 No
bash 76 69 7 91.0 89.0
Yes

Results for sugarbay ptest bash 2015-10-05:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

run-read

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

udev 139 139 0 100.0 99.0
Yes

Results for sugarbay ptest udev 2015-10-05:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 1

test/rules-test.sh

Tests that were skipped now and worked last time: 0


Tests that were skipped last time and worked now: 0

diffutils 12 12 0 100.0 100.0 No
gdk-pixbuf 9 9 0 100.0 100.0 No
tcl 148 146 2 99.0 99.0 No
python 14192 14152 40 100.0 100.0 No
attr 108 108 0 100.0 100.0 No
gawk 282 281 1 100.0 99.0
Yes

Results for sugarbay ptest gawk 2015-10-05:
********************************

Tests that failed now and worked last time: 0


Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 2

rebuf
filefuncs

Tests that were skipped last time and worked now: 16

callparam
regnul2
rebrackloc
badbuild
fpat4
regexpbrack
indirectbuiltin
crlf
sortglos
rsgetline
exitval3
inpref
indirectcall2
printfbad4
regexpbrack2
regnul1
perl 2010 1926 84 96.0 100.0
Yes

Results for sugarbay ptest perl 2015-10-05:
********************************

Tests that failed now and worked last time: 83

cpan/IO-Socket-IP/t/16v6only
cpan/IO-Socket-IP/t/02local-server-v4
cpan/IO-Socket-IP/t/15io-socket
cpan/HTTP-Tiny/t/050_chunked_body
cpan/HTTP-Tiny/t/030_response
cpan/IO-Socket-IP/t/19no-addrs
cpan/HTTP-Tiny/t/102_put
dist/IO/t/io_multihomed
cpan/libnet/t/ftp
cpan/HTTP-Tiny/t/070_cookie_jar
cpan/IO-Socket-IP/t/06local-cross-v6
cpan/HTTP-Tiny/t/141_no_proxy
cpan/ExtUtils-MakeMaker/t/recurs
cpan/IO-Socket-IP/t/20subclass
cpan/HTTP-Tiny/t/000_load
t/run/switches
cpan/IO-Socket-IP/t/05local-server-v6
cpan/IO-Socket-IP/t/31nonblocking-connect-internet
cpan/HTTP-Tiny/t/101_head
dist/IO/t/io_sel
cpan/IO-Socket-IP/t/30nonblocking-connect
cpan/libnet/t/nntp_ssl
cpan/HTTP-Tiny/t/020_headers
cpan/HTTP-Tiny/t/140_proxy
cpan/IO-Socket-IP/t/18fdopen
cpan/IO-Socket-IP/t/10args
dist/IO/t/cachepropagate-unix
cpan/IO-Socket-IP/t/01local-client-v4
cpan/ExtUtils-MakeMaker/t/basic
dist/IO/t/IO
t/porting/customized
cpan/HTTP-Tiny/t/103_delete
cpan/HTTP-Tiny/t/010_url
dist/IO/t/io_unix
cpan/IO-Socket-IP/t/03local-cross-v4
dist/IO/t/cachepropagate-tcp
cpan/HTTP-Tiny/t/130_redirect
cpan/IO-Socket-IP/t/13addrinfo
cpan/ExtUtils-MakeMaker/t/several_authors
cpan/IO-Socket-IP/t/21as-inet
t/io/fs
cpan/libnet/t/pop3_ipv6
cpan/File-Fetch/t/01_File-Fetch
cpan/ExtUtils-MakeMaker/t/PL_FILES
cpan/libnet/t/pop3_ssl
cpan/HTTP-Tiny/t/160_cookies
cpan/HTTP-Tiny/t/161_basic_auth
cpan/HTTP-Tiny/t/001_api
cpan/libnet/t/require
cpan/HTTP-Tiny/t/104_post
cpan/ExtUtils-MakeMaker/t/pm_to_blib
ext/Errno/t/ErrnoEND
cpan/HTTP-Tiny/t/150_post_form
dist/IO/t/io_sock
dist/IO/t/io_udp
dist/autouse/t/autouse
cpan/IO-Socket-IP/t/12port-fallback
cpan/libnet/t/smtp_ipv6
cpan/HTTP-Tiny/t/110_mirror
cpan/HTTP-Tiny/t/100_get
cpan/IO-Socket-IP/t/14fileno
cpan/HTTP-Tiny/t/002_croakage
cpan/ExtUtils-MakeMaker/t/min_perl_version
cpan/libnet/t/smtp
cpan/HTTP-Tiny/t/060_http_date
cpan/IO-Socket-IP/t/04local-client-v6
cpan/HTTP-Tiny/t/003_agent
cpan/libnet/t/nntp_ipv6
t/re/reg_namedcapture
cpan/IO-Socket-IP/t/17gai-flags
cpan/ExtUtils-MakeMaker/t/INSTALL_BASE
cpan/IO-Socket-IP/t/00use
cpan/HTTP-Tiny/t/170_keepalive
cpan/IO-Socket-IP/t/22timeout
t/op/magic
cpan/HTTP-Tiny/t/040_content
cpan/libnet/t/smtp_ssl
t/io/open
cpan/IO-Socket-IP/t/11sockopts
cpan/libnet/t/nntp
dist/IO/t/cachepropagate-udp
cpan/HTTP-Tiny/t/162_proxy_auth
cpan/Socket/t/socketpair

Tests that passed now and and failed last time: 3

t/op/numconvert
t/op/stat
t/op/range

Tests that were skipped now and worked last time: 375

cpan/CGI/t/init
cpan/Term-ANSIColor/t/taint
ext/SDBM_File/t/constants
cpan/Module-Build/t/compat/exit
ext/XS-APItest/t/stuff_modify_bug
ext/Pod-Html/t/htmlescp
cpan/CGI/t/start_end_start
cpan/Module-Build/t/write_default_maniskip
lib/DirHandle
ext/XS-APItest/t/pad_scalar
ext/POSIX/t/unimplemented
ext/XS-APItest/t/gv_fetchmeth_autoload
ext/Pod-Functions/t/Functions
ext/XS-APItest/t/svpv
lib/Tie/ExtraHash
lib/Tie/Scalar
ext/POSIX/t/math
cpan/IO-Compress/t/106prime-deflate
ext/FileCache/t/07noimport
ext/POSIX/t/termios
ext/XS-APItest/t/keyword_plugin
lib/Thread
ext/XS-APItest/t/temp_lv_sub
cpan/Module-Build/t/notes
dist/ExtUtils-Install/t/Installed
ext/XS-APItest/t/peep
ext/XS-APItest/t/push
lib/Tie/SubstrHash
cpan/CGI/t/cookie
ext/POSIX/t/sigaction
cpan/IO-Compress/t/106prime-zip
cpan/CGI/t/utf8
ext/FileCache/t/05override
ext/XS-APItest/t/handy
lib/subs
cpan/CGI/t/push
dist/Net-Ping/t/450_service
lib/vars_carp
cpan/Module-Build/t/destinations
lib/Pod/t/Select
cpan/Module-Build/t/compat
ext/File-Glob/t/rt114984
lib/User/pwent
ext/XS-APItest/t/lvalue
ext/XS-APItest/t/printf
lib/File/stat-7896
ext/XS-APItest/t/postinc
lib/Tie/Array/std
ext/Pod-Html/t/crossref3
lib/overloading
cpan/Module-Build/t/test_file_exts
lib/vars
ext/XS-APItest/t/op
ext/I18N-Langinfo/t/Langinfo
cpan/Term-ANSIColor/t/eval
t/lib/1_compile
lib/File/stat
ext/XS-APItest/t/overload
cpan/CGI/t/multipart_init
cpan/Module-Build/t/perl_mb_opt
cpan/Module-Build/t/tilde
cpan/Module-Build/t/runthrough
ext/XS-APItest/t/my_cxt
ext/File-DosGlob/t/DosGlob
cpan/CGI/t/charset
cpan/autodie/t/version
lib/DBM_Filter/t/compress
cpan/Module-Build/t/use_tap_harness
cpan/Module-Build/t/sample
ext/XS-APItest/t/call_checker
cpan/CGI/t/query_string
ext/re/t/reflags
lib/Tie/Array/stdpush
ext/Pod-Html/t/htmllink
lib/DBM_Filter/t/01error
lib/B/Deparse-core
lib/File/Basename
ext/Errno/t/Errno
ext/FileCache/t/03append
ext/XS-APItest/t/sym-hook
lib/Tie/Handle/stdhandle_from_handle
ext/XS-APItest/t/scopelessblock
ext/Pod-Html/t/cache
ext/POSIX/t/is
cpan/CGI/t/no_tabindex
lib/Benchmark
lib/Time/gmtime
cpan/Module-Build/t/extend
ext/XS-APItest/t/newCONSTSUB
ext/XS-APItest/t/swaplabel
ext/XS-APItest/t/gv_init
lib/blib
cpan/Module-Build/t/ext
cpan/Module-Build/t/actions/installdeps
ext/FileCache/t/04twoarg
ext/FileCache/t/02maxopen
ext/XS-APItest/t/pmflag
lib/open
ext/XS-APItest/t/copyhints
ext/XS-APItest/t/blockhooks
cpan/Module-Build/t/properties/module_name
cpan/CGI/t/headers
lib/English
ext/POSIX/t/sysconf
lib/Net/hostent
ext/POSIX/t/waitpid
lib/feature/unicode_strings
ext/XS-APItest/t/ptr_table
lib/feature
cpan/Module-Build/t/properties/requires
ext/Pod-Html/t/anchorify
cpan/CGI/t/util
cpan/CGI/t/param_fetch
ext/IPC-Open3/t/IPC-Open2
ext/IPC-Open3/t/IPC-Open3
cpan/Module-Build/t/unit_run_test_harness
ext/XS-APItest/t/sviscow
lib/Pod/t/Usage
ext/XS-APItest/t/arrayexpr
cpan/Module-Build/t/test_type
cpan/CGI/t/Dump
ext/Pod-Html/t/crossref2
cpan/Module-Build/t/resume
lib/Symbol
lib/dumpvar
lib/Tie/Array/splice
cpan/CGI/t/can
lib/AnyDBM_File
cpan/IO-Compress/t/106prime-rawdeflate
lib/Internals
ext/XS-APItest/t/loopblock
dist/ExtUtils-Manifest/t/Manifest
ext/Hash-Util-FieldHash/t/11_hashassign
ext/re/t/re
cpan/Term-ANSIColor/t/aliases-func
lib/locale
t/x2p/find2perl
cpan/CGI/t/save_read_roundtrip
cpan/CGI/t/hidden
ext/PerlIO-encoding/t/nolooping
lib/Unicode/UCD
cpan/CGI/t/function
ext/PerlIO-scalar/t/scalar
lib/h2ph
lib/DB
cpan/Module-Build/t/basic
cpan/Module-Build/t/versions
cpan/Module-Build/t/debug
ext/XS-APItest/t/exception
ext/XS-APItest/t/sort
ext/POSIX/t/taint
ext/XS-APItest/t/gv_autoload4
ext/XS-APItest/t/op_list
cpan/CGI/t/checkbox_group
ext/XS-APItest/t/whichsig
cpan/Module-Build/t/test_types
ext/POSIX/t/wrappers
cpan/Module-Build/t/properties/release_status
ext/XS-APItest/t/underscore_length
cpan/Module-Build/t/actions/manifest_skip
ext/XS-APItest/t/clone-with-stack
cpan/Module-Build/t/PL_files
lib/integer
ext/Hash-Util-FieldHash/t/12_hashwarn
ext/POSIX/t/usage
ext/XS-APItest/t/magic
lib/Tie/Handle/stdhandle
lib/sigtrap
lib/strict
ext/XS-APItest/t/svpv_magic
ext/XS-APItest/t/coplabel
ext/Hash-Util-FieldHash/t/02_function
lib/Getopt/Std
lib/diagnostics
cpan/Test-Harness/t/proveenv
cpan/CGI/t/upload
ext/XS-APItest/t/gv_fetchmeth
ext/Hash-Util-FieldHash/t/04_thread
ext/XS-APItest/t/refs
lib/vmsish
cpan/Compress-Raw-Zlib/t/07bufsize
ext/File-Find/t/find
lib/Net/servent
cpan/CGI/t/switch
ext/XS-APItest/t/stmtsasexpr
ext/XS-APItest/t/hash
ext/Pod-Html/t/htmlview
cpan/IO-Compress/t/101truncate-bzip2
lib/DBM_Filter/t/02core
ext/SDBM_File/t/sdbm
cpan/IO-Compress/t/101truncate-deflate
ext/File-Glob/t/basic
cpan/CGI/t/request
dist/ExtUtils-Install/t/InstallWithMM
cpan/Module-Build/t/properties/dist_suffix
ext/Pod-Html/t/podnoerr
ext/XS-APItest/t/utf8
cpan/Scalar-List-Utils/t/proto
lib/SelectSaver
lib/DBM_Filter/t/null
ext/POSIX/t/posix
ext/XS-APItest/t/my_exit
ext/FileCache/t/01open
ext/Opcode/t/ops
cpan/Package-Constants/t/01_list
ext/XS-APItest/t/labelconst
cpan/Module-Build/t/pod_parser
ext/XS-APItest/t/rv2cv_op_cv
ext/XS-Typemap/t/Typemap
ext/Pod-Html/t/crossref
ext/Opcode/t/Opcode
lib/File/Compare
ext/re/t/re_funcs
cpan/Module-Build/t/test_reqs
ext/XS-APItest/t/eval-filter
ext/Hash-Util/t/Util
lib/FileHandle
cpan/Module-Build/t/add_property
cpan/CGI/t/autoescape
ext/PerlIO-encoding/t/fallback
lib/Pod/t/utils
ext/Sys-Hostname/t/Hostname
cpan/Module-Build/t/mymeta
t/op/waitpid
ext/Fcntl/t/mode
lib/Tie/Hash
ext/re/t/lexical_debug
cpan/Module-Build/t/parents
cpan/CGI/t/apache
ext/Fcntl/t/autoload
lib/B/Deparse
lib/Net/protoent
cpan/CGI/t/start_end_end
ext/POSIX/t/export
ext/Pod-Html/t/eol
ext/XS-APItest/t/xs_special_subs
ext/XS-APItest/t/customop
cpan/Module-Build/t/add_property_array
dist/ExtUtils-Install/t/Packlist
ext/File-Glob/t/case
ext/POSIX/t/sigset
ext/XS-APItest/t/autoload
cpan/Module-Build/t/files
cpan/Module-Build/t/install
ext/XS-APItest/t/blockhooks-csc
ext/Fcntl/t/fcntl
ext/XS-APItest/t/xsub_h
cpan/Module-Build/t/metadata
cpan/CGI/t/pretty
lib/sort
ext/XS-APItest/t/keyword_multiline
ext/XS-APItest/t/xs_special_subs_require
cpan/Module-Build/t/script_dist
lib/less
cpan/CGI/t/url
cpan/IO-Compress/t/106prime-bzip2
ext/XS-APItest/t/cleanup
ext/File-Glob/t/taint
lib/warnings
ext/File-Glob/t/global
cpan/Term-ANSIColor/t/basic256
ext/XS-APItest/t/fetch_pad_names
lib/filetest
ext/POSIX/t/time
lib/overload
cpan/CGI/t/html
dist/ExtUtils-Install/t/can_write_dir
cpan/IO-Compress/t/105oneshot-zip-store-only
ext/XS-APItest/t/addissub
cpan/CGI/t/unescapeHTML
lib/File/Copy
cpan/IO-Compress/t/101truncate-zip
ext/XS-APItest/t/copstash
ext/XS-APItest/t/callregexec
ext/XS-APItest/t/cophh
cpan/Term-ANSIColor/t/basic
ext/Pod-Html/t/feature
ext/XS-APItest/t/multicall
ext/XS-APItest/t/caller
cpan/Module-Build/t/manifypods_with_utf8
cpan/IO-Compress/t/106prime-gzip
lib/FindBin
lib/Pod/t/InputObjects
cpan/Module-Build/t/new_from_context
ext/Pod-Html/t/htmldir1
ext/XS-APItest/t/mro
ext/Pod-Html/t/htmldir2
ext/Hash-Util-FieldHash/t/03_class
lib/overload64
lib/Class/Struct
cpan/Scalar-List-Utils/t/multicall-refcount
ext/XS-APItest/t/utf16_to_utf8
ext/Tie-Memoize/t/Tie-Memoize
cpan/Config-Perl-V/t/21_plv518
cpan/CGI/t/util-58
ext/IPC-Open3/t/fd
ext/re/t/qr
lib/utf8
ext/Pod-Html/t/htmldir3
ext/Pod-Html/t/htmldir4
ext/Pod-Html/t/htmldir5
cpan/CGI/t/form
ext/XS-APItest/t/gotosub
cpan/CGI/t/popup_menu
ext/XS-APItest/t/op_contextualize
cpan/CGI/t/rt-52469
lib/DBM_Filter/t/int32
ext/XS-APItest/t/stuff_svcur_bug
ext/Pod-Html/t/poderr
ext/Tie-Hash-NamedCapture/t/tiehash
cpan/CGI/t/carp
ext/XS-APItest/t/call
cpan/CGI/t/start_end_asterisk
dist/ExtUtils-Command/t/eu_command
ext/XS-APItest/t/savehints
lib/User/grent
cpan/CPAN-Meta/t/strings
lib/Config/Extensions
ext/XS-APItest/t/stmtasexpr
lib/DBM_Filter/t/encode
ext/XS-APItest/t/rmagical
cpan/Module-Build/t/00-compile
cpan/Module-Build/t/add_property_hash
lib/charnames
cpan/Term-ANSIColor/t/stringify
lib/h2xs
cpan/Module-Build/t/manifypods
lib/bytes
cpan/CGI/t/user_agent
ext/XS-APItest/t/gv_fetchmethod_flags
ext/XS-APItest/t/grok
ext/Hash-Util-FieldHash/t/01_load
cpan/Module-Build/t/install_extra_target
cpan/CGI/t/end_form
ext/SDBM_File/t/prep
lib/Time/localtime
cpan/Module-Build/t/properties/needs_compiler
ext/Fcntl/t/syslfs
dist/ExtUtils-Install/t/Installapi2
ext/re/t/regop
ext/Pod-Html/t/feature2
dist/ExtUtils-Command/t/cp
ext/XS-APItest/t/blockasexpr
ext/XS-APItest/t/magic_chain
ext/File-Glob/t/threads
cpan/Module-Build/t/properties/share_dir
ext/re/t/re_funcs_u
ext/XS-APItest/t/subcall
ext/FileCache/t/06export
cpan/Module-Build/t/metadata2
t/x2p/s2p
ext/XS-APItest/t/svpeek
ext/XS-APItest/t/svsetsv
ext/XS-APItest/t/check_warnings
ext/XS-APItest/t/looprest
cpan/CGI/t/uploadInfo
lib/DBM_Filter/t/utf8
lib/Tie/Array/push
cpan/CGI/t/http
lib/perl5db
cpan/CGI/t/delete
cpan/Module-Build/t/properties/license
ext/PerlIO-encoding/t/encoding
ext/XS-APItest/t/swaptwostmts
cpan/IO-Compress/t/101truncate-rawdeflate
ext/Hash-Util-FieldHash/t/05_perlhook
ext/PerlIO-scalar/t/scalar_ungetc
cpan/IO-Compress/t/101truncate-gzip
lib/Config
cpan/Config-Perl-V/t/20_plv510
ext/XS-APItest/t/lexsub
ext/File-Find/t/taint
cpan/Module-Build/t/help
dist/ExtUtils-Install/t/Install
ext/PerlIO-via/t/via

Tests that were skipped last time and worked now: 98

t/re/speed
t/base/translate
cpan/libnet/t/datasend
cpan/ExtUtils-MakeMaker/t/vstrings
cpan/Test-Simple/t/478-cmp_ok_hash
cpan/Scalar-List-Utils/t/subname
cpan/Digest-SHA/t/inheritance
cpan/autodie/t/read
cpan/libnet/t/ftp
cpan/ExtUtils-Install/t/Packlist
cpan/Test-Simple/t/Builder/reset_outputs
cpan/Term-ANSIColor/t/module/stringify
t/op/anonconst
cpan/ExtUtils-MakeMaker/t/recurs
cpan/ExtUtils-Install/t/InstallWithMM
cpan/Config-Perl-V/t/21_plv58
cpan/Test-Simple/t/auto
t/perf/optree
cpan/IO-Socket-IP/t/05local-server-v6
cpan/Config-Perl-V/t/20_plv56
cpan/ExtUtils-Install/t/Installed
cpan/libnet/t/nntp_ssl
cpan/Term-ANSIColor/t/module/aliases-func
cpan/Term-ANSIColor/t/module/eval
cpan/Scalar-List-Utils/t/prototype
cpan/ExtUtils-MakeMaker/t/basic
t/op/hexfp
t/re/rt122747
cpan/Encode/t/utf8warnings
cpan/ExtUtils-Install/t/can_write_dir
cpan/Test-Simple/t/check_tests
cpan/Config-Perl-V/t/24_plv514
cpan/Memoize/t/tie_ndbm
cpan/ExtUtils-Command/t/eu_command
cpan/Test-Simple/t/capture
cpan/ExtUtils-MakeMaker/t/several_authors
cpan/Config-Perl-V/t/26_plv5182
dist/Safe/t/safesecurity
t/io/semctl
cpan/libnet/t/time
t/op/require_override
cpan/libnet/t/pop3_ipv6
cpan/Scalar-List-Utils/t/scalarutil-proto
t/porting/re_context
cpan/Config-Perl-V/t/22_plv510
cpan/Term-ANSIColor/t/module/basic
cpan/libnet/t/config
cpan/Filter-Util-Call/t/rt_54452-rebless
cpan/ExtUtils-Install/t/Installapi2
cpan/ExtUtils-Install/t/Install
cpan/Digest-SHA/t/bitorder
t/op/multideref
cpan/ExtUtils-MakeMaker/t/PL_FILES
cpan/libnet/t/pop3_ssl
t/perf/benchmarks
cpan/JSON-PP/t/zero-mojibake
cpan/Socket/t/ipv6_mreq
cpan/ExtUtils-MakeMaker/t/pm_to_blib
cpan/Config-Perl-V/t/27_plv5200
ext/Errno/t/ErrnoEND
t/perf/opcount
cpan/Archive-Tar/t/08_ptargrep
cpan/libnet/t/smtp_ipv6
cpan/Term-ANSIColor/t/taint/basic
cpan/ExtUtils-Manifest/t/Manifest
cpan/ExtUtils-MakeMaker/t/min_perl_version
cpan/Config-Perl-V/t/25_plv5162
cpan/Term-ANSIColor/t/module/basic256
cpan/CPAN-Meta/t/converter-fragments
cpan/libnet/t/netrc
cpan/libnet/t/smtp
cpan/CPAN-Meta/t/merge
cpan/Config-Perl-V/t/26_plv518
cpan/ExtUtils-Command/t/cp
cpan/Test-Simple/t/run_test
cpan/Test-Simple/t/01-basic
cpan/IO-Socket-IP/t/04local-client-v6
cpan/CPAN-Meta/t/optional_feature-merge
cpan/libnet/t/nntp_ipv6
t/perf/taint
cpan/Config-Perl-V/t/25_plv516
cpan/CPAN-Meta-Requirements/t/strings
cpan/ExtUtils-MakeMaker/t/INSTALL_BASE
dist/Data-Dumper/t/recurse
t/op/lvref
cpan/ExtUtils-MakeMaker/t/unicode
cpan/Socket/t/ip_mreq
dist/PathTools/t/abs2rel
t/re/speed_thr
cpan/IO-Socket-IP/t/22timeout
t/op/infnan
cpan/Test-Simple/t/depth
t/op/const-optree
cpan/libnet/t/smtp_ssl
cpan/Config-Perl-V/t/23_plv512
t/perf/speed
t/re/reg_nocapture
cpan/libnet/t/nntp
bzip2 6 6 0 100.0 100.0 No
zlib 2 2 0 100.0 100.0 No
openssh 19 18 1 95.0 98.0
Yes

Results for sugarbay ptest openssh 2015-10-05:
********************************

Tests that failed now and worked last time: 1

disallow agent ptrace attach

Tests that passed now and and failed last time: 0


Tests that were skipped now and worked last time: 27

convert keys
sftp glob
reexec tests
change passphrase for key
localcommand
sshd_config match
sftp batchfile
integrity
scp
sftp invalid commands
certified user keys
key options
port number parsing
login with different key exchange algorithms
simple connect after reconfigure
forced command
sshd control of local and remote forwarding
address match
sftp commands
certified host keys
connection multiplexing
basic sftp put/get
sftp permissions
expand %h and %n
keyscan
local and remote forwarding
broken keys

Tests that were skipped last time and worked now: 1

disallow agent ptrace attach

Build Performance Test

Detailed description on how performance test are run can be found on Performance Test wiki. The below charts are displaying the build performance trend for 1.8 by milestone starting 1.6 on Master. The charts by Milestone can be accessed at this link where you can view more detailed information or by clicking on the images which will open a new window with the interactive chart.


Performance Charts

For Bitbake core-image-sato with rm_work

Ww41-2k15 - rmwork.JPG

Building the Virtual kernel

Ww41-2k15 - kernel.JPG

Building the rootfs

Ww41-2k15 - rootfs.JPG

Detailed Report

Distro Testing

Status {{#testopia: |run_id={{#var:distro}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:distro}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:distro}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Core Build System

Bitbake

Status {{#testopia: |run_id={{#var:bitbake}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:bitbake}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:bitbake}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Meta-Yocyo

Status {{#testopia: |run_id={{#var:meta-yocto}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:meta-yocto}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:meta-yocto}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

OE-Core

Status {{#testopia: |run_id={{#var:oe-core}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:oe-core}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:oe-core}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Hob

Status {{#testopia: |run_id={{#var:hob}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:hob}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:hob}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

BSP

genericx86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

genericx86_64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:genericx86_64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:genericx86_64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:genericx86_64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Beaglebone Black: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:beaglebone_black}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:beaglebone_black}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

EdgeRouter: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:edgerouter}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:edgerouter}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:edgerouter}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

MPC8315e-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:mpc8315e-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:mpc8315e-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

P1022ds-rdb: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:p1022ds-rdb}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:p1022ds-rdb}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}


Qemu

qemux86: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemux86-64: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemux86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemux86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemux86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuarm: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuarm}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuarm}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuarm}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemumips: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemumips}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemumips}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemumips}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

qemuppc: core-image-sato-sdk

Status {{#testopia: |run_id={{#var:qemuppc}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:qemuppc}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:qemuppc}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Toaster

Status {{#testopia: |run_id={{#var:toaster}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:toaster}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:toaster}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Runtime Testing

Status {{#testopia: |run_id={{#var:runtime}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:runtime}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:runtime}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Detailed result at: Build performance metrics

Build-appliance

Status {{#testopia: |run_id={{#var:build-appliance}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:build-appliance}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:build-appliance}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_i686}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_i686}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Fedora i686

Status {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_fedora_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

ADT on: Ubuntu x86-64

Status {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:adt_ubuntu_x86-64}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}

Eclipse Plugin

Status {{#testopia: |run_id={{#var:eclipseplugin}} |showhide=true |hidden=true |report_id=status |charttype=pie3}}

Bugs {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=bugs |chart=bstatus,prio,severity |charttype=pie,pie,pie |showhide=true |hidden=true}}

Agenda {{#testopia: |run_id={{#var:eclipseplugin}} |report_id=agenda |showhide=true |hidden=true |reportoptions=withdependency=false}}