Yocto Project - User contributions [en]

LTP result

2012-08-09T08:13:06Z

Ningx.ma: /* Current Milestone (1.3 20120801 build) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120801 build || 17 || n/a || n/a || n/a || n/a || n/a || n/a || || 24 || 32 || 24
|-
|| 1.3 M2 RC1 20120712 build ||18 || n/a || n/a || n/a || n/a || n/a || n/a || || 26 || 32 || n/a
|-
|| 1.1.2 20120630 build || 36 || n/a || n/a || n/a || n/a || n/a || n/a || || 41 || 42 || 29
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120801 build)==
'''environment'''
'''LTP version''': ltp-full-20120614.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120801.log -C result-20120801.fail -d /opt/ltp/tmp &> result-20120801.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1229 || 1229 || 1229 ||1230
|-
|| failures || || 24 || 32 || 24 || 17
|-
|| fixed || || 2 || 1 || 2 || 1
|-
|| NAB || || 21 || 23 || 21 || 15
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.3
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.3 M2 RC1 20120712 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120712.log -C result-20120712.fail -d /opt/ltp/tmp &> result-20120712.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || n/a || 1229
|-
|| failures || || 26 || 32 || || 18
|-
|| fixed || || 8 || 8 || || 0
|-
|| NAB || || 21 || 24 || || 15
|}

===1.1.2 20120630 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 || 1229
|-
|| failures || || 41 || 42 || 29 || 36
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 36 || 32 || 27 || 24
|}

===1.2.1 20120629 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-08-09T08:11:07Z

Ningx.ma: /* Overall trend */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120801 build || 17 || n/a || n/a || n/a || n/a || n/a || n/a || || 24 || 32 || 24
|-
|| 1.3 M2 RC1 20120712 build ||18 || n/a || n/a || n/a || n/a || n/a || n/a || || 26 || 32 || n/a
|-
|| 1.1.2 20120630 build || 36 || n/a || n/a || n/a || n/a || n/a || n/a || || 41 || 42 || 29
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120801 build)==
'''environment'''
'''LTP version''': ltp-full-20120614.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120801.log -C result-20120801.fail -d /opt/ltp/tmp &> result-20120801.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1229 || 1229 || 1229 ||1229
|-
|| failures || || 24 || 32 || 24 || 18
|-
|| fixed || || 2 || 1 || 2 || 0
|-
|| NAB || || 21 || 23 || 21 || 15
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.3
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.3 M2 RC1 20120712 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120712.log -C result-20120712.fail -d /opt/ltp/tmp &> result-20120712.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || n/a || 1229
|-
|| failures || || 26 || 32 || || 18
|-
|| fixed || || 8 || 8 || || 0
|-
|| NAB || || 21 || 24 || || 15
|}

===1.1.2 20120630 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 || 1229
|-
|| failures || || 41 || 42 || 29 || 36
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 36 || 32 || 27 || 24
|}

===1.2.1 20120629 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

Obsolete - Sugarbay-ltp

2012-08-09T07:28:55Z

Ningx.ma: /* 1.3 M2 20120802build */

==1.3 M2 20120802build ==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || Remaining cases broken || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || FAIL:/etc/cron.daily.Could not obtain directory status
/etc/cron.daily FAILED TEST
|| n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found
|| n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.3 M2 RC1 20120712build ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.1.2==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || || || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || || || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || || || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2.1 ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

Posix result

2012-08-09T01:54:26Z

Ningx.ma: /* Current Milestone (Yocto 1.3 M2 20120802-1 build) */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.3 M2 20120802-1 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || n/a || 125 || 123 || 123 ||
|-
|| 1.3 M2 RC1 20120712 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || n/a || 126 || 128 || n/a || 127
|-
|| 1.1.2 20120630 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || || 162 || 167 || 126 || n/a
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 125 || 129 || 126 || 130
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.3 M2 20120802-1 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120617

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 124 || n/a || 123 || 125 || 123 ||
|}

==Previous Milestone==

===Yocto 1.3 M2 RC1 20120712 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 126 || n/a || n/a || 126 || 128 || 127
|}

===Yocto 1.2.1 20120629 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 128 || 125 || 126 || 125 || 129 || 130
|}

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

LTP result

2012-08-08T06:41:45Z

Ningx.ma: /* Current Milestone (1.3 20120801 build) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120801 build || 18 || n/a || n/a || n/a || n/a || n/a || n/a || || 24 || || 24
|-
|| 1.3 M2 RC1 20120712 build ||18 || n/a || n/a || n/a || n/a || n/a || n/a || || 26 || 32 || n/a
|-
|| 1.1.2 20120630 build || 36 || n/a || n/a || n/a || n/a || n/a || n/a || || 41 || 42 || 29
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120801 build)==
'''environment'''
'''LTP version''': ltp-full-20120614.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120801.log -C result-20120801.fail -d /opt/ltp/tmp &> result-20120801.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1229 || || 1229 ||1229
|-
|| failures || || 24 || || 24 || 18
|-
|| fixed || || 2 || || 2 || 0
|-
|| NAB || || 21 || || 21 || 15
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.3
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.3 M2 RC1 20120712 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120712.log -C result-20120712.fail -d /opt/ltp/tmp &> result-20120712.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || n/a || 1229
|-
|| failures || || 26 || 32 || || 18
|-
|| fixed || || 8 || 8 || || 0
|-
|| NAB || || 21 || 24 || || 15
|}

===1.1.2 20120630 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 || 1229
|-
|| failures || || 41 || 42 || 29 || 36
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 36 || 32 || 27 || 24
|}

===1.2.1 20120629 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

Obsolete - Sugarbay-ltp

2012-08-08T06:39:46Z

Ningx.ma: /* 1.3 M2 RC1 20120712build */

==1.3 M2 20120802build ==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.3 M2 RC1 20120712build ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.1.2==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || || || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || || || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || || || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2.1 ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

LTP result

2012-08-08T06:23:51Z

Ningx.ma: /* Overall trend */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120801 build || 18 || n/a || n/a || n/a || n/a || n/a || n/a || || 24 || || 24
|-
|| 1.3 M2 RC1 20120712 build ||18 || n/a || n/a || n/a || n/a || n/a || n/a || || 26 || 32 || n/a
|-
|| 1.1.2 20120630 build || 36 || n/a || n/a || n/a || n/a || n/a || n/a || || 41 || 42 || 29
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120801 build)==
'''environment'''
'''LTP version''': ltp-full-20120614.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120801.log -C result-20120801.fail -d /opt/ltp/tmp &> result-20120801.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1229 || || 1229 ||
|-
|| failures || || 24 || || 24 ||
|-
|| fixed || || || || ||
|-
|| NAB || || || || ||
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.3
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.3 M2 RC1 20120712 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120712.log -C result-20120712.fail -d /opt/ltp/tmp &> result-20120712.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || n/a || 1229
|-
|| failures || || 26 || 32 || || 18
|-
|| fixed || || 8 || 8 || || 0
|-
|| NAB || || 21 || 24 || || 15
|}

===1.1.2 20120630 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 || 1229
|-
|| failures || || 41 || 42 || 29 || 36
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 36 || 32 || 27 || 24
|}

===1.2.1 20120629 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

Posix result

2012-08-08T06:20:59Z

Ningx.ma: /* Current Milestone (Yocto 1.3 M2 RC1 20120712 build) */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.3 M2 20120802-1 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || n/a || || || n/a ||
|-
|| 1.3 M2 RC1 20120712 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || n/a || 126 || 128 || n/a || 127
|-
|| 1.1.2 20120630 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || || 162 || 167 || 126 || n/a
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 125 || 129 || 126 || 130
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.3 M2 20120802-1 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 126 || n/a || n/a || || ||
|}

== Previous Milestone (Yocto 1.3 M2 RC1 20120712 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 126 || n/a || n/a || 126 || 128 || 127
|}

==Previous Milestone==

===Yocto 1.2.1 20120629 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 128 || 125 || 126 || 125 || 129 || 130
|}

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Posix result

2012-08-08T06:16:11Z

Ningx.ma: /* Overall trend */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.3 M2 20120802-1 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || n/a || || || n/a ||
|-
|| 1.3 M2 RC1 20120712 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || n/a || 126 || 128 || n/a || 127
|-
|| 1.1.2 20120630 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || || 162 || 167 || 126 || n/a
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 125 || 129 || 126 || 130
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.3 M2 RC1 20120712 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 126 || n/a || n/a || 126 || 128 || 127
|}

==Previous Milestone==

===Yocto 1.2.1 20120629 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 128 || 125 || 126 || 125 || 129 || 130
|}

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Obsolete - Sugarbay-ltp

2012-07-19T09:55:25Z

Ningx.ma: /* 1.1.2 */

==1.3 M2 RC1 20120712build ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.1.2==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || || || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || || || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || || || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2.1 ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

LTP result

2012-07-19T09:51:30Z

Ningx.ma: /* Current Milestone (1.3 M2 RC1 20120712 build) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 M2 RC1 20120712 build ||18 || n/a || n/a || n/a || n/a || n/a || n/a || || 26 || 32 || n/a
|-
|| 1.1.2 20120630 build || 36 || n/a || n/a || n/a || n/a || n/a || n/a || || 41 || 42 || 29
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 M2 RC1 20120712 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120712.log -C result-20120712.fail -d /opt/ltp/tmp &> result-20120712.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || n/a || 1229
|-
|| failures || || 26 || 32 || || 18
|-
|| fixed || || 8 || 8 || || 0
|-
|| NAB || || 21 || 24 || || 15
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.3
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.1.2 20120630 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 || 1229
|-
|| failures || || 41 || 42 || 29 || 36
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 36 || 32 || 27 || 24
|}

===1.2.1 20120629 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

Posix result

2012-07-19T09:22:31Z

Ningx.ma: /* Overall trend */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.3 M2 RC1 20120712 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || || 126 || 128 || n/a || n/a
|-
|| 1.1.2 20120630 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || || 162 || 167 || 126 || n/a
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 125 || 129 || 126 || 130
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.3 M2 RC1 20120712 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 126 || || n/a || 126 || 128 ||
|}

==Previous Milestone==

===Yocto 1.2.1 20120629 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 128 || 125 || 126 || 125 || 129 || 130
|}

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Posix result

2012-07-19T09:09:12Z

Ningx.ma: /* Current Milestone (Yocto 1.3 M2 RC1 20120712 build) */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.3 M2 RC1 20120712 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || || 126 || 128 || n/a || n/a
|-
|| 1.1.2 20120630 (****) || n/a || n/a || n/a || n/a || n/a || n/a || || || 162 || 167 || 126 || n/a
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 125 || 129 || 126 || 130
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.3 M2 RC1 20120712 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 126 || || n/a || 126 || 128 ||
|}

==Previous Milestone==

===Yocto 1.2.1 20120629 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 128 || 125 || 126 || 125 || 129 || 130
|}

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Posix result

2012-07-19T09:08:22Z

Ningx.ma: /* Overall trend */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.3 M2 RC1 20120712 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || || 126 || 128 || n/a || n/a
|-
|| 1.1.2 20120630 (****) || n/a || n/a || n/a || n/a || n/a || n/a || || || 162 || 167 || 126 || n/a
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 125 || 129 || 126 || 130
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.3 M2 RC1 20120712 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''
{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || || || n/a || 126 || 128 ||
|}

==Previous Milestone==

===Yocto 1.2.1 20120629 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || ''' huronriver'''
|-
|| failures || 128 || 125 || 126 || 125 || 129 || 130
|}

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Obsolete - Sugarbay-ltp

2012-07-19T07:46:15Z

Ningx.ma: /* 1.1.2 */

==1.1.2==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || || || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || || || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || || || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2.1 ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

Obsolete - Sugarbay-ltp

2012-07-19T07:43:35Z

Ningx.ma: /* 1.1.2 */

==1.1.2==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || || || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || || || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2.1 ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

Obsolete - Sugarbay-ltp

2012-07-19T06:24:48Z

Ningx.ma: /* 1.2.1 */

==1.1.2==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2.1 ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

LTP result

2012-07-19T06:22:30Z

Ningx.ma: /* Current Milestone (1.1.2 20120630 build) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 M2 RC1 20120712 build ||18 || n/a || n/a || n/a || n/a || n/a || n/a || || 26 || 32 || n/a
|-
|| 1.1.2 20120630 build || 36 || n/a || n/a || n/a || n/a || n/a || n/a || || 41 || 42 || 29
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.1.2 20120630 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 || 1229
|-
|| failures || || 41 || 42 || 29 || 36
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 36 || 32 || 27 || 24
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.1.2 20120630 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 ||
|-
|| failures || || 41 || 42 || 29 ||
|-
|| fixed || || 0 || 0 || 0 ||
|-
|| NAB || || 36 || 32 || 27 ||
|}

===1.2.1 20120629 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-07-19T06:17:52Z

Ningx.ma: /* Overall trend */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 M2 RC1 20120712 build ||18 || n/a || n/a || n/a || n/a || n/a || n/a || || 26 || 32 || n/a
|-
|| 1.1.2 20120630 build || 36 || n/a || n/a || n/a || n/a || n/a || n/a || || 41 || 42 || 29
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.1.2 20120630 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1227 || 1228 || 1228 ||
|-
|| failures || || 41 || 42 || 29 ||
|-
|| fixed || || 0 || 0 || 0 ||
|-
|| NAB || || 36 || 32 || 27 ||
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.2.1 20120629 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

Obsolete - Sugarbay-ltp

2012-07-09T02:28:39Z

Ningx.ma: /* 1.2/denzil rc5 */

==1.2.1 ==
'''total: 19 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| get_robust_list01 || LTP || || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

LTP result

2012-07-09T02:14:10Z

Ningx.ma: /* Current Milestone (1.2.1 20120629 build) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.2.1 20120629 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1229
|-
|| failures || || 23 || 30 || 22 || 19
|-
|| fixed || || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 20 || 16
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-07-09T02:12:11Z

Ningx.ma: /* 1.3 M1 RC1 20120613 build */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.2.1 20120629 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 ||
|-
|| failures || || 23 || 30 || 22 ||
|-
|| fixed || || 0 || 0 || 0 ||
|-
|| NAB || || 21 || 24 || 20 ||
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 16 || 33 || 41 || 30 || 27
|-
|| fixed || 1 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 24
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-07-09T02:03:47Z

Ningx.ma: /* Overall trend */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.2.1 20120629 build || 19 || n/a || n/a || n/a || n/a || n/a || n/a || || 23 || 30 || 22
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 33 || 41 || 30
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || 15 || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.2.1 20120629 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 ||
|-
|| failures || || 23 || 30 || 22 ||
|-
|| fixed || || 0 || 0 || 0 ||
|-
|| NAB || || 21 || 24 || 20 ||
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.3 M1 RC1 20120613 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 ||
|-
|| failures || 16 || 33 || 41 || 30 ||
|-
|| fixed || 1 || 0 || 0 || 0 ||
|-
|| NAB || 15 || 29 || 32 || 27 ||
|}

===1.3 20120606 build===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 15 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 15 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

Posix result

2012-07-09T02:00:36Z

Ningx.ma: /* Overall trend */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || || 125 || 129 || 126 ||
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.2.1 20120629 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || || 126 || 125 || 129
|}

==Previous Milestone==

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Posix result

2012-07-09T01:59:53Z

Ningx.ma: /* Current Milestone (Yocto 1.2.1 20120629 build) */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb''' || ''' huronriver'''
|-
|| 1.2.1 20120629 (****) || n/a || n/a || n/a || n/a || n/a || n/a || || || 125 || 129 || 126 ||
|-
|| 1.2 denzil meta-intel (****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 126 || n/a || n/a || n/a || 129
|-
|| 1.3 M1 RC1 20120613 (****) || n/a || n/a || n/a || n/a || n/a || n/a || 125 || 125 || 126 || 129 || 126 || 127
|-
|| 1.3 20120606 build(****) || n/a || n/a || n/a || n/a || n/a || n/a || 126 || 125 || 125 || 126 || 126 || n/a
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 125 || 126 || 129 || 126 || n/a
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127 || n/a
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126 || n/a
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126 || n/a
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126 || n/a
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126 || n/a
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32 || n/a
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128 || n/a
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89 || n/a
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34 || n/a
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32 || n/a
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31 || n/a
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32 || n/a
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31 || n/a
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33 || n/a
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49 || n/a
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.2.1 20120629 build)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || || 126 || 125 || 129
|}

==Previous Milestone==

===Yocto 1.2 Denzil meta-intel ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''git info''':

Tree/Branch: poky/denzil

Commit: 7552ccd06c6327b5f36ee0cceb432946f8e98d3f

Meta-intel branch: denzil

Commit: a79035a584cd618d7202ce006cfb2d714a0ce717

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''huronriver'''
|-
|| failures || 126 || 126 || 129
|}

===Yocto 1.3 M1 RC1 20120613 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation''' || '''huronriver'''
|-
|| failures || 125 || 125 || 126 || 126 || 129 || 127
|}

===Yocto 1.3 20120606 build===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 126 || 125 || 126 || 125 || 126
|}

===Yocto 1.2 Denzil RC5===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || 125 || 126 || 126 || 129
|}

===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Performance Test

2012-06-20T05:43:27Z

Ningx.ma:

'''Poky/Bitbake Performance:''' 
Performance is an essential point for measuring the quality of a build system. 
This page is to track performance trend of poky build. Detailed development work is on https://wiki.yoctoproject.org/wiki/Performance. 
 
'''Hardware and software configuration:''' 
CPU: 4-core * 2-threads Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz 
Memory: 4GB 
Harddisk: 1TB 
 
OS: Ubuntu 11.10 x86_64 
Kernel: 2.6.35-22 
 
local.conf: 
CONF_VERSION = "1" 
DL_DIR ?= "/sda1/sources/downloads" # Using a local download dir to avoid fetch. 
BB_NUMBER_THREADS = "8" 
PARALLEL_MAKE = "-j 8" 
MACHINE ?= "qemux86" 
DISTRO ?= "poky" 
BBMASK = "" 
EXTRA_IMAGE_FEATURES = "debug-tweaks" 
PACKAGE_CLASSES ?= "package_rpm" 
USER_CLASSES ?= "image-mklibs image-prelink" 
PACKAGE_DEBUG_SPLIT_STYLE = '.debug' 
BBINCLUDELOGS = "yes" 
ENABLE_BINARY_LOCALE_GENERATION = "1" 
NO32LIBS = "1" 
 

'''Build Performance Trend'''
{|border="1"
|| '''Host''' ||'''[[Yocto1.3_M1-build]]'''|| '''[[Yocto1.2-M4-RC5-build]]'''|| '''[[Yocto1.2-M4-RC4-build]]'''|| '''[[Yocto1.2-M4-RC3-build]]'''|| '''[[Yocto1.2-M4-RC2-build]]'''|| '''[[Yocto1.2-M4-RC1-build]]'''|| '''[[Yocto1.2-M3-RC1-build]]''' || '''[[Yocto1.2-M2-RC1-build]]''' || '''[[Yocto1.2-M1-RC2-build]]'''|| '''[[Yocto1.1-M4-RC4-build]]'''|| '''[[Yocto1.1-M4-RC3-build]]''' || '''[[Yocto1.1-M4-RC2-build]]'''|| '''[[Yocto1.1-M2-RC3-build]] (both rpm and ipk built by default)'''
|-
||Ubuntu11.10 x86_64 || real 115m0.322s user 388m51.720s sys 48m34.660s|| real 111m48.083s user 381m29.410s sys 46m52.080s || real 111m27.967s user 383m32.690s sys 46m41.830s || real 110m24.635s user 381m29.740s sys 46m32.430s || real 112m8.776s user 379m10.670s sys 47m19.270s || real 130m48.838s user 370m56.000s sys 45m36.060s || real 133m39.703s user 371m37.450s sys 46m57.510s || real 124m39s user 373m16 sys 52m17s || real 104m24s user 374m16s real 50m 37s || real 119m31s user 355m3s sys 47m42s || real 127m33s user 346m3s sys 48m5s || real 124m54s user 342m57s sys 47m33s || real 109m53s user 356m16s sys 48m16s
|}

Yocto1.3 M1-build

2012-06-20T02:40:39Z

Ningx.ma: Created page with "{|border="1" ||'''Tree'''|| Poky |- ||'''Branch''' || remotes/origin/1.3_M1 |- ||'''Commit''' || 7f017cab0b3e4d5a4fc356eccd8eb8429b0531d0 |- !colspan="6"|Information |- |colspa..."

{|border="1"
||'''Tree'''|| Poky
|-
||'''Branch''' || remotes/origin/1.3_M1
|-
||'''Commit''' || 7f017cab0b3e4d5a4fc356eccd8eb8429b0531d0
|-
!colspan="6"|Information
|-
|colspan="2"|commit 7f017cab0b3e4d5a4fc356eccd8eb8429b0531d0
Author: Elizabeth Flanagan <elizabeth.flanagan@intel.com>
Date: Tue Jun 12 17:11:24 2012 +0300

connman: bump PR and add some comments

The comments are for informing anyone who wants to change USERADD_PARAMs
to make sure it's in sync with the one in xserver-nodm-init, in order
for rootless X to work.

(From OE-Core rev: c4d0b1c5438039dab07103c151c0c5a76a4c9499)

Signed-off-by: Laurentiu Palcu <laurentiu.palcu@intel.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>

Performance Test

2012-06-20T02:36:00Z

Ningx.ma:

'''Poky/Bitbake Performance:''' 
Performance is an essential point for measuring the quality of a build system. 
This page is to track performance trend of poky build. Detailed development work is on https://wiki.yoctoproject.org/wiki/Performance. 
 
'''Hardware and software configuration:''' 
CPU: 4-core * 2-threads Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz 
Memory: 4GB 
Harddisk: 1TB 
 
OS: Ubuntu 11.10 x86_64 
Kernel: 2.6.35-22 
 
local.conf: 
CONF_VERSION = "1" 
DL_DIR ?= "/sda1/sources/downloads" # Using a local download dir to avoid fetch. 
BB_NUMBER_THREADS = "8" 
PARALLEL_MAKE = "-j 8" 
MACHINE ?= "qemux86" 
DISTRO ?= "poky" 
BBMASK = "" 
EXTRA_IMAGE_FEATURES = "debug-tweaks" 
PACKAGE_CLASSES ?= "package_rpm" 
USER_CLASSES ?= "image-mklibs image-prelink" 
PACKAGE_DEBUG_SPLIT_STYLE = '.debug' 
BBINCLUDELOGS = "yes" 
ENABLE_BINARY_LOCALE_GENERATION = "1" 
NO32LIBS = "1" 
 

'''Build Performance Trend'''
{|border="1"
|| '''Host''' ||'''[[Yocto1.3_M1-build]]'''|| '''[[Yocto1.2-M4-RC5-build]]'''|| '''[[Yocto1.2-M4-RC4-build]]'''|| '''[[Yocto1.2-M4-RC3-build]]'''|| '''[[Yocto1.2-M4-RC2-build]]'''|| '''[[Yocto1.2-M4-RC1-build]]'''|| '''[[Yocto1.2-M3-RC1-build]]''' || '''[[Yocto1.2-M2-RC1-build]]''' || '''[[Yocto1.2-M1-RC2-build]]'''|| '''[[Yocto1.1-M4-RC4-build]]'''|| '''[[Yocto1.1-M4-RC3-build]]''' || '''[[Yocto1.1-M4-RC2-build]]'''|| '''[[Yocto1.1-M2-RC3-build]] (both rpm and ipk built by default)'''
|-
||Ubuntu11.10 x86_64 || real|| real 111m48.083s user 381m29.410s sys 46m52.080s || real 111m27.967s user 383m32.690s sys 46m41.830s || real 110m24.635s user 381m29.740s sys 46m32.430s || real 112m8.776s user 379m10.670s sys 47m19.270s || real 130m48.838s user 370m56.000s sys 45m36.060s || real 133m39.703s user 371m37.450s sys 46m57.510s || real 124m39s user 373m16 sys 52m17s || real 104m24s user 374m16s real 50m 37s || real 119m31s user 355m3s sys 47m42s || real 127m33s user 346m3s sys 48m5s || real 124m54s user 342m57s sys 47m33s || real 109m53s user 356m16s sys 48m16s
|}

Performance Test

2012-06-20T02:35:36Z

Ningx.ma:

'''Poky/Bitbake Performance:''' 
Performance is an essential point for measuring the quality of a build system. 
This page is to track performance trend of poky build. Detailed development work is on https://wiki.yoctoproject.org/wiki/Performance. 
 
'''Hardware and software configuration:''' 
CPU: 4-core * 2-threads Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz 
Memory: 4GB 
Harddisk: 1TB 
 
OS: Ubuntu 11.10 x86_64 
Kernel: 2.6.35-22 
 
local.conf: 
CONF_VERSION = "1" 
DL_DIR ?= "/sda1/sources/downloads" # Using a local download dir to avoid fetch. 
BB_NUMBER_THREADS = "8" 
PARALLEL_MAKE = "-j 8" 
MACHINE ?= "qemux86" 
DISTRO ?= "poky" 
BBMASK = "" 
EXTRA_IMAGE_FEATURES = "debug-tweaks" 
PACKAGE_CLASSES ?= "package_rpm" 
USER_CLASSES ?= "image-mklibs image-prelink" 
PACKAGE_DEBUG_SPLIT_STYLE = '.debug' 
BBINCLUDELOGS = "yes" 
ENABLE_BINARY_LOCALE_GENERATION = "1" 
NO32LIBS = "1" 
 

'''Build Performance Trend'''
{|border="1"
|| '''Host''' ||'''[[Yocto1.3_M1-build]]'''|||| '''[[Yocto1.2-M4-RC5-build]]'''|| '''[[Yocto1.2-M4-RC4-build]]'''|| '''[[Yocto1.2-M4-RC3-build]]'''|| '''[[Yocto1.2-M4-RC2-build]]'''|| '''[[Yocto1.2-M4-RC1-build]]'''|| '''[[Yocto1.2-M3-RC1-build]]''' || '''[[Yocto1.2-M2-RC1-build]]''' || '''[[Yocto1.2-M1-RC2-build]]'''|| '''[[Yocto1.1-M4-RC4-build]]'''|| '''[[Yocto1.1-M4-RC3-build]]''' || '''[[Yocto1.1-M4-RC2-build]]'''|| '''[[Yocto1.1-M2-RC3-build]] (both rpm and ipk built by default)'''
|-
||Ubuntu11.10 x86_64 || real|| real 111m48.083s user 381m29.410s sys 46m52.080s || real 111m27.967s user 383m32.690s sys 46m41.830s || real 110m24.635s user 381m29.740s sys 46m32.430s || real 112m8.776s user 379m10.670s sys 47m19.270s || real 130m48.838s user 370m56.000s sys 45m36.060s || real 133m39.703s user 371m37.450s sys 46m57.510s || real 124m39s user 373m16 sys 52m17s || real 104m24s user 374m16s real 50m 37s || real 119m31s user 355m3s sys 47m42s || real 127m33s user 346m3s sys 48m5s || real 124m54s user 342m57s sys 47m33s || real 109m53s user 356m16s sys 48m16s
|}

Performance Test

2012-06-20T02:35:08Z

Ningx.ma:

'''Poky/Bitbake Performance:''' 
Performance is an essential point for measuring the quality of a build system. 
This page is to track performance trend of poky build. Detailed development work is on https://wiki.yoctoproject.org/wiki/Performance. 
 
'''Hardware and software configuration:''' 
CPU: 4-core * 2-threads Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz 
Memory: 4GB 
Harddisk: 1TB 
 
OS: Ubuntu 11.10 x86_64 
Kernel: 2.6.35-22 
 
local.conf: 
CONF_VERSION = "1" 
DL_DIR ?= "/sda1/sources/downloads" # Using a local download dir to avoid fetch. 
BB_NUMBER_THREADS = "8" 
PARALLEL_MAKE = "-j 8" 
MACHINE ?= "qemux86" 
DISTRO ?= "poky" 
BBMASK = "" 
EXTRA_IMAGE_FEATURES = "debug-tweaks" 
PACKAGE_CLASSES ?= "package_rpm" 
USER_CLASSES ?= "image-mklibs image-prelink" 
PACKAGE_DEBUG_SPLIT_STYLE = '.debug' 
BBINCLUDELOGS = "yes" 
ENABLE_BINARY_LOCALE_GENERATION = "1" 
NO32LIBS = "1" 
 

'''Build Performance Trend'''
{|border="1"
|| '''Host''' ||'''[[Yocto1.3_M1-build]]'''|||| '''[[Yocto1.2-M4-RC5-build]]'''|| '''[[Yocto1.2-M4-RC4-build]]'''|| '''[[Yocto1.2-M4-RC3-build]]'''|| '''[[Yocto1.2-M4-RC2-build]]'''|| '''[[Yocto1.2-M4-RC1-build]]'''|| '''[[Yocto1.2-M3-RC1-build]]''' || '''[[Yocto1.2-M2-RC1-build]]''' || '''[[Yocto1.2-M1-RC2-build]]'''|| '''[[Yocto1.1-M4-RC4-build]]'''|| '''[[Yocto1.1-M4-RC3-build]]''' || '''[[Yocto1.1-M4-RC2-build]]'''|| '''[[Yocto1.1-M2-RC3-build]] (both rpm and ipk built by default)'''
|-
||Ubuntu11.10 x86_64 || real|||| real 111m48.083s user 381m29.410s sys 46m52.080s || real 111m27.967s user 383m32.690s sys 46m41.830s || real 110m24.635s user 381m29.740s sys 46m32.430s || real 112m8.776s user 379m10.670s sys 47m19.270s || real 130m48.838s user 370m56.000s sys 45m36.060s || real 133m39.703s user 371m37.450s sys 46m57.510s || real 124m39s user 373m16 sys 52m17s || real 104m24s user 374m16s real 50m 37s || real 119m31s user 355m3s sys 47m42s || real 127m33s user 346m3s sys 48m5s || real 124m54s user 342m57s sys 47m33s || real 109m53s user 356m16s sys 48m16s
|}

Performance Test

2012-06-20T02:34:19Z

Ningx.ma:

'''Poky/Bitbake Performance:''' 
Performance is an essential point for measuring the quality of a build system. 
This page is to track performance trend of poky build. Detailed development work is on https://wiki.yoctoproject.org/wiki/Performance. 
 
'''Hardware and software configuration:''' 
CPU: 4-core * 2-threads Intel(R) Core(TM) i7 CPU 860 @ 2.80GHz 
Memory: 4GB 
Harddisk: 1TB 
 
OS: Ubuntu 11.10 x86_64 
Kernel: 2.6.35-22 
 
local.conf: 
CONF_VERSION = "1" 
DL_DIR ?= "/sda1/sources/downloads" # Using a local download dir to avoid fetch. 
BB_NUMBER_THREADS = "8" 
PARALLEL_MAKE = "-j 8" 
MACHINE ?= "qemux86" 
DISTRO ?= "poky" 
BBMASK = "" 
EXTRA_IMAGE_FEATURES = "debug-tweaks" 
PACKAGE_CLASSES ?= "package_rpm" 
USER_CLASSES ?= "image-mklibs image-prelink" 
PACKAGE_DEBUG_SPLIT_STYLE = '.debug' 
BBINCLUDELOGS = "yes" 
ENABLE_BINARY_LOCALE_GENERATION = "1" 
NO32LIBS = "1" 
 

'''Build Performance Trend'''
{|border="1"
|| '''Host''' ||'''[[Yocto1.3_M1-build]]'''|||| '''[[Yocto1.2-M4-RC5-build]]'''|| '''[[Yocto1.2-M4-RC4-build]]'''|| '''[[Yocto1.2-M4-RC3-build]]'''|| '''[[Yocto1.2-M4-RC2-build]]'''|| '''[[Yocto1.2-M4-RC1-build]]'''|| '''[[Yocto1.2-M3-RC1-build]]''' || '''[[Yocto1.2-M2-RC1-build]]''' || '''[[Yocto1.2-M1-RC2-build]]'''|| '''[[Yocto1.1-M4-RC4-build]]'''|| '''[[Yocto1.1-M4-RC3-build]]''' || '''[[Yocto1.1-M4-RC2-build]]'''|| '''[[Yocto1.1-M2-RC3-build]] (both rpm and ipk built by default)'''
|-
||Ubuntu11.10 x86_64 ||| ||| real 111m48.083s user 381m29.410s sys 46m52.080s || real 111m27.967s user 383m32.690s sys 46m41.830s || real 110m24.635s user 381m29.740s sys 46m32.430s || real 112m8.776s user 379m10.670s sys 47m19.270s || real 130m48.838s user 370m56.000s sys 45m36.060s || real 133m39.703s user 371m37.450s sys 46m57.510s || real 124m39s user 373m16 sys 52m17s || real 104m24s user 374m16s real 50m 37s || real 119m31s user 355m3s sys 47m42s || real 127m33s user 346m3s sys 48m5s || real 124m54s user 342m57s sys 47m33s || real 109m53s user 356m16s sys 48m16s
|}

LTP result

2012-06-20T02:20:58Z

Ningx.ma: /* Current Milestone (1.3 20120606 build) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || || || ||
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120613 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120613.log -C result-20120613.fail -d /opt/ltp/tmp &> result-20120613.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || || || ||
|-
|| failures || || || || ||
|-
|| fixed || || || || ||
|-
|| NAB || || || || ||
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

==1.3 20120606 build==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 21 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-06-20T02:18:29Z

Ningx.ma: /* Previous Milestone */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || || || ||
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120606 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 21 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 29 || 32 || 27 || 17
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

==1.3 20120606 build==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 21 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 29 || 32 || 27 || 17
|}

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-06-20T02:16:04Z

Ningx.ma: /* Overall trend */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120613 build || 27 || n/a || n/a || n/a || n/a || n/a || n/a || || || ||
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120606 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 21 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 29 || 32 || 27 || 17
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-06-20T02:15:09Z

Ningx.ma: /* Overall trend */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| 1.3 20120613 build || || n/a || n/a || n/a || n/a || n/a || n/a || || || ||
|-
|| 1.3 20120606 build || || n/a || n/a || n/a || n/a || n/a || n/a || || 32 || 39 || 29
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.3 20120606 build)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120606.log -C result-20120606.fail -d /opt/ltp/tmp &> result-20120606.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1227 || 1228 || 1227
|-
|| failures || 21 || 32 || 39 || 29 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 29 || 32 || 27 || 17
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.

===1.2 Denzil RC5===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 19 || 17
|}

===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

File:Weekly Yocto1.3 20120505 Issue Summary.png

2012-05-08T07:30:08Z

Ningx.ma:

File:Weekly Yocto1.3 20120505 Detailed Test Result.png

2012-05-08T07:29:53Z

Ningx.ma:

File:Weekly Yocto1.3 20120505 Test Result Summary2.png

2012-05-08T07:29:36Z

Ningx.ma:

File:Weekly Yocto1.3 20120505 Test Result Summary.png

2012-05-08T07:29:17Z

Ningx.ma:

Posix result

2012-04-26T07:02:53Z

Ningx.ma: /* Current Milestone (Yocto 1.2 Denzil RC5) */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || || 126 || 129 || 126
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.2 Denzil RC5)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures ||128 || || 126 || 126 || 129
|}

==Previous Milestone==
===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Posix result

2012-04-26T07:02:21Z

Ningx.ma: /* Overall trend */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || || 126 || 129 || 126
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.2 Denzil RC5)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 126 || 126 || 129
|}

==Previous Milestone==
===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

LTP result

2012-04-26T05:41:01Z

Ningx.ma: /* Current Milestone (1.2 Denzil RC5) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21|| 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.2 Denzil RC5)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 || 1227
|-
|| failures || || 24 || 30 || 21 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 19 || 17
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.
===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-04-26T03:19:48Z

Ningx.ma: /* Overall trend */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| Denzil (1.2 RC5) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || || 24 || 30 || 21
|-
|| Denzil (1.2 RC4) || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21|| 24 || 30 || 23
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (1.2 Denzil RC5)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120423.log -C result-20120423.fail -d /opt/ltp/tmp &> result-20120423.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || || 1228 || 1228 || 1228 ||
|-
|| failures || || 24 || 30 || 21 ||
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || || 21 || 24 || 19 ||
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.
===1.2 Denzil RC4===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120418.log -C result-20120418.fail -d /opt/ltp/tmp &> result-20120418.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || 1228 || 1228 || 1227
|-
|| failures || 21 || 24 || 30 || 23 || 18
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 16 || 21 || 24 || 21 || 17
|}

===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

Obsolete - Sugarbay-ltp

2012-04-26T02:11:43Z

Ningx.ma:

==1.2/denzil rc5==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

Posix result

2012-04-26T02:10:18Z

Ningx.ma: /* Current Milestone (Yocto 1.2 RC4 Denzil) */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || || || || ||
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.2 Denzil RC5)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || || ||
|}

==Previous Milestone==
===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Posix result

2012-04-26T02:09:47Z

Ningx.ma: /* Previous Milestone */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || || || || ||
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.2 RC4 Denzil)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

==Previous Milestone==
===Yocto 1.2 Denzil RC4 ===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Posix result

2012-04-26T02:08:36Z

Ningx.ma: /* Overall trend */

==Introduction==
The Open POSIX* Test Suite is an open source test suite with the goal of performing conformance, functional, stress, and performance testing of the functions described in the IEEE Std 1003.1-2001 System Interfaces specification. Eventual testing of the full specification is desired (http://posixtest.sourceforge.net/)

Similar to [[https://wiki.yoctoproject.org/wiki/LTP_result LTP result]], embedded linux distribution is highly customized for a specific purpose, and thus both the kernel and base environment may not satisfy the posix requirement. So the major purposes of this work are:
* to understand the reasons for existing posix failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track poix test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

There is one bugzilla entry related:
http://bugzilla.pokylinux.org/show_bug.cgi?id=172

==Overall trend==

Overall trend tends to track the change of posix test results along with Yocto's progress.

In below table we list total POSIX failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''sugarbay''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| Denzil 1.2 RC5(****) || n/a || n/a || n/a || n/a || n/a || n/a || || || || ||
|-
|| Denzil 1.2 RC4(****) || n/a || n/a || n/a || n/a || n/a || n/a || 128 || 126 || 126 || 128 || 127
|-
|| 1.2 M4 RC3(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 128 || 125 || n/a || 126
|-
|| 1.2 M4 RC2(****) || n/a || n/a || n/a || n/a || n/a || n/a || 127 || 125 || 127 || 130 || 126
|-
|| 1.2 M4 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 129 || 126 || 127 || 130 || 126
|-
|| 1.2 M3 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 127 || 129 || 132 || 126
|-
|| 1.1.1 || n/a || n/a || n/a || n/a || n/a || n/a || 10 || 9 || 31 || 33 || 32
|-
|| 1.2 M2 RC1(****) || n/a || n/a || n/a || n/a || n/a || n/a || 130 || 128 || 131 || 132 || 128
|-
|| 1.2 M1 RC2(***) || n/a || n/a || 90 || 92 || 92 || n/a || 98 || 98 || 91 || 92 || 89
|-
|| 1.0.2 || n/a || n/a || 35 || 32 || 33 || n/a || || || 30 || 71 || 34
|-
|| 1.1 M4 RC4 || n/a || n/a || 31 || 33 || 32 || n/a || 25 || 25 || 30 || 31 || 32
|-
|| 1.1 M4 RC3 || n/a || n/a || 32 || 35 || 33 || n/a || 24 || 23 || 37 || 33 || 31
|-
|| 1.1 M4 RC2 || n/a || n/a || 31 || 34 || 34 || n/a || 25 || 24 || 31 || 33 || 32
|-
|| 1.1 M3 || n/a || n/a || 32 || 34 || 34 || n/a || 23 || 24 || 30 || 32 || 31
|-
|| 1.1 M2 || n/a || n/a || 30 || 34 || 32 || n/a || 31 || 26 || 32 || 69 || 33
|-
|| 1.1 M1(**) || n/a || n/a || 35 || 49 || 43 || n/a || 50 || 48 || 46 || 84 || 49
|-
|| 1.0-M2 (*) || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || n/a || 1744 || 1755 || 1754 || n/a
|}
*: 1.0-M2 misses some link flags, and thus many unexpected link failures observed
**: 1.1 M1 has gcc upgrade from 4.5.1 to 4.6.1, which has two new options, -Wunused-but-set-variable and -Waddress enabled by default. They casused many cases failed. We need add -Wno-unused-but-set-variable and -Wno-address to fix the problems.
***: For 1.2, We using POSIX test suite in LTP release 20110915 instead of POSIX test suite 1.5.2.
****: For 1.2 M2, We also test AIO.
general tips:
* use "-m 512" to launch the qemu targets
* make sure below line is uncommented in LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
* don't test AIO as the test cases themselves have compilation warnings which are treated as errors (use 'exit' while doesn't include stdlib.h)

==Result analysis==
Current results are base on Yocto 1.1 and POSIX test suite in LTP release 20110915.
After analysis every test case except PASS will be list here, whether a patch will be gave to fix it or put the case to blacklist with a explanation.

POSIX test results: https://wiki.yoctoproject.org/wiki/POSIX-results

==Current Milestone (Yocto 1.2 RC4 Denzil)==
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 126 || 127 || 126 || 128
|}

==Previous Milestone==
===Yocto 1.2 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 128 || 125 || n/a || 126
|}

===Yocto 1.2 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120401

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 127 || 125 || 126 || 127 || 130
|}
===Yocto 1.2 M4 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 129 || 126 || 126 || 127 || 130
|}
===Yocto 1.2 M3 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20120104

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 130 || 127 || 126 || 129 || 132
|}

===Yocto 1.1.1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 10 || 9 || 32 || 31 || 33
|}

===Yocto 1.2 M2 RC1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 128 || 130 || 128 || 131 || 132
|}

===Yocto 1.2 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite in LTP release 20110915

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 98 || 98 || 90 || 92 || 92 || 89 || 91 || 92
|}

===Yocto 1.0.2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 35 || 32 || 33 || 34 || 30 || 71
|}

===Yocto 1.1 M4 RC4===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 25 || 31 || 33 || 32 || 32 || 30 || 31
|}

===Yocto 1.1 M4 RC3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 24 || 23 || 32 || 35 || 33 || 31 || 37 || 33
|}

===Yocto 1.1 M4 RC2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 25 || 24 || 31 || 34 || 34 || 32 || 31 || 33
|}

===Yocto 1.1 M3===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || || || 32 || 34 || 34 || 31 || 30 || 32
|}

===Yocto 1.1 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 31 || 26 || 30 || 34 || 32 || 33 || 32 || 69
|}

===Yocto 1.1 M1===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': core-image-sato-sdk

'''run command''': ./run_tests [MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''sugarbay''' || '''blacksand''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''mpc8315e-rdb''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 50 || 48 || 35 || 49 || 43 || 49 || 46 || 84
|}

===Yocto 1.0 M2===
'''environment'''
'''OpenPOSIX version''': posixtestsuite-1.5.2.tar

'''profile''': poky-image-sdk

'''run command''': ./run_tests [AIO|MEM|MSG|SEM|SIG|THR|TMR|TPS]

'''result'''

{|border="1"
|| '''Status''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation'''
|-
|| failures || 1744 || 1744 || 1745 || 1750 || 1753 || 1753 || 1744 || 1755 || 1754
|}

The major problem for high failure numbers here is due to one environmental issue. It's suggested to uncomment below line from LDFLAGS file:
#-D_XOPEN_SOURCE=600 -lpthread -lrt -lm
libpthread and librt are critical for posix interface test. Without doing this the majority of the failures are link failures being failed to find necessary libraries.
My quick test on qemux86 shows that the failure could be reduced a lot to <200 in a rough run

Based on above fact, no more analysis is done on 1.0-M2 posix results. The thorough analysis will be postponed to 1.0-M3 which will use the right test steps and newer 2.6.37 kernel

Obsolete - Sugarbay-ltp

2012-04-25T05:38:43Z

Ningx.ma: /* 1.2/denzil */

==1.2/denzil rc4==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}

==1.2/M4(RC3)==
'''total: 18 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| thp02|| NEW || || thp02 1 TBROK : cannot find "Hugepagesize:" in /proc/meminfo thp02 2 TBROK : Remaining cases broken || n/a || n/a || n/a
|-
|}
==1.2/M4(RC2)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| aio02 || LTP || || aio02/aio_tio io_fsync write:Invalid argument || n/a || This is a LTP bug ||n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M4(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}
==1.2/M3(RC1)==
'''total: 17 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
ksm05 3 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 610 T<<<execution_status>>>
|| n/a || This is a LTP bug || n/a
|-
|| getrusage04 || LTP || || getrusage04 1 TFAIL : stime increased > 1000us: delta = 4000us
|| n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1.1==
'''total: 36 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M2(RC1)==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/8208/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/8208/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/8208/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| ldd || NEW|| || /usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/lddfile5.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../x86_64-poky-linux/bin/ld: error in /opt/ltp/testcases/bin/main.obj(.eh_frame); no .eh_frame_hdr table will be created.
/usr/lib/gcc/x86_64-poky-linux/4.6.3/../../../../lib/crt1.o: In function `_start':
/srv/home/pokybuild/yocto-autobuilder/yocto-slave/sugarbay/build/build/tmp/work/x86_64-poky-linux/eglibc-2.13-r20+svnr15508/eglibc-2_13/libc/csu/../sysdeps/x86_64/elf/start.S:109: undefined reference to `main'
collect2: ld returned 1 exit status
ASSERTION 1
ldd: /tmp/ldd01-3541/a.out: No such file or directory
|| || || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1922 bug1922]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| ksm05 || LTP || || ksm05 0 TINFO : KSM merging...
ksm05 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm05 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| getrusage03 || || || getrusage03 5 TFAIL : child.children !~= 300MB
getrusage03 0 TINFO : Testcase #05: zombie getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 5 TFAIL : child.children !~= 300MB getrusage03 0 TINFO : post_wait.children = 153908
getrusage03 7 TFAIL : post_wait.children !~= 400MB
|| n/a || n/a || n/a
|-
|| nm|| NEW || || nm: nmfile1.obj: no symbols
nm: nmfile2.obj: no symbols
nm: nmfile3.obj: no symbols
|| n/a || n/a || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1923 bug1923]]
|-
|}

==1.2/M1(RC2)==
'''total: 34 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || proc01 1 TFAIL : read failed: /proc/self/task/17325/ns/net: errno=EINVAL(22): Invalid argument
proc01 2 TFAIL : read failed: /proc/self/task/17325/ns/uts: errno=EINVAL(22): Invalid argument
proc01 3 TFAIL : read failed: /proc/self/task/17325/ns/ipc: errno=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || clock_settime03 8 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
clock_settime03 9 TFAIL : clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument
|| || introduced with 3.0 kernel ||
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a
|| n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC4)==
'''total: 35 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4(RC3)==
'''total: 37 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| creat08 || NEW || || || ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| || introduced with 3.0 kernel ||
|-
|| readlink03 || LTP || ||readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno=2
|| n/a || When 'Symlink Pathname is empty' the return value was 'ENOENT' but with newer kernels the return value is 'EINVAL'. It is a LTP bug. || n/a
|-
|| sockioctl01 || LTP || ||sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)
|| n/a || Inappropriate ioctl operation returning EINVAL with newer kernels. It is a LTP bug. || n/a
|-
|| mmap11 || LTP || || mmap11 0 TINFO : [471]
mmap11 1 TBROK : pthread_create: errno=EAGAIN(11): Resource temporarily unavailable
mmap11 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_2 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use /dev/zero.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_3 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken

|| n/a || This is a LTP bug || n/a
|-
|| mmap10_4 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| mmap10_5 || LTP || || mmap10 0 TINFO : add to KSM regions.
mmap10 0 TINFO : use anonymous pages.
mmap10 0 TINFO : start tests.
mmap10 1 TBROK : madvise: errno=EINVAL(22): Invalid argument
mmap10 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm01_1 || LTP || || ksm01 0 TINFO : KSM merging...
ksm01 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm01 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ksm03_1 || LTP || || ksm03 0 TINFO : KSM merging...
ksm03 1 TBROK : open: errno=ENOENT(2): No such file or directory
ksm03 2 TBROK : Remaining cases broken
|| n/a || This is a LTP bug || n/a
|-
|| ld || LTP || || Assertion 1 ..................
-)
Assertion 2 ..................
1,4c1,3
< gcc: error: x.obj: No such file or directory
< gcc: error: y.obj: No such file or directory
< gcc: fatal error: no input files
< compilation terminated.
---
> gcc: x.obj: No such file or directory
> gcc: y.obj: No such file or directory
> gcc: No input files
FAIL - ld failed to give expected error msg
|| n/a || This is a LTP bug || [[http://bugzilla.pokylinux.org/show_bug.cgi?id=1162 bug1162]]
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || /opt/ltp/testcases/bin/file_test.sh: line 549: rpmbuild: command not found || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog06 || || n/a || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a || n/a
|-
|}

==1.1/M4==
'''total: 26 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M3==
'''total: 27 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| readlink03 || NEW || jiajun || readlink03 9 TFAIL : readlink() failed, Symlink Pathname is empty, errno=22, expected errno= || introduced with 3.0 kernel ||
|-
|| sockioctl01 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| proc01 || NEW || jiajun || clock_settime(2) failed to produce expected error (return code = -1): TEST_ERRNO=EINVAL(22): Invalid argument || introduced with 3.0 kernel ||
|-
|| ldd || http://bugzilla.pokylinux.org/show_bug.cgi?id=1236 || || || ||
|-
||clock_settime03 || NEW || jiajun || sockioctl01 4 TFAIL : ATMARK on UDP ; returned -1 (expected -1), errno 25 (expected 22)|| introduced with 3.0 kernel ||
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M2==
'''total: 30 (100%)'''

Note: A link folder "/lib64" is created linked to /lib to resolve broken ldd bug, bug 1236.

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

==1.1/M1==
'''total: 33 (100%)'''

{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''comment''' || '''bugzilla'''
|-
|| clock_nanosleep01 || NEW || Bruce || iclock_gettime failed: TEST_ERRNO=EINVAL(22): Invalid argument || || http://bugzilla.pokylinux.org/show_bug.cgi?id=900
|-
|| gf02 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf05 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf07 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf09 || NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| gf19 ||NEW || ||growfiles(gf02): 13903 growfiles.c/2144: 1 tlibio.c/1675 aio_write, aio_error = 1 Operation not permitted; random method 0200002 growfiles(gf02): 13903 growfiles.c/1679: 1 Hit max errors value of 1 || ||http://bugzilla.pokylinux.org/show_bug.cgi?id=1138
|-
|| quota_remount_test01 || NAB || Kevin Tian || quota_remount_test01.sh: line 86: quotacheck: not found
|| live image doesn't contain quota utility
|| n/a
|-
|| sendfile05 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| sendfile05_64 || [[qemux86_64-ltp|qemux86_64]] || n/a || n/a || n/a
|-
|| ioctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| sysctl03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog03 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog04 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog05 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog07 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog08 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog09 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| syslog10 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| su01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron02 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_deny01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_allow01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron_dirs_checks01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ld || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| ldd || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| file || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cron || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| logrotate || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| cpio || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| unzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|| gzip01 || [[qemux86-ltp|qemux86]] || n/a || n/a || n/a || n/a
|-
|}

LTP result

2012-04-23T08:42:51Z

Ningx.ma: /* Current Milestone (denzil) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| denzil|| 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21|| || ||
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (denzil)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || || || || 1227
|-
|| failures || 21 || || || || 18
|-
|| fixed || 0 || || || || 0
|-
|| NAB || 16 || || || || 17
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2 M4
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.
===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

LTP result

2012-04-23T08:42:32Z

Ningx.ma: /* Current Milestone (denzil) */

==Introduction==
Linux Test Project (LTP) is an open source project with a goal to deliver test suites to the open source community that validate the reliability, robustness, and stability of Linux. (http://ltp.sourceforge.net)

Unlike typical desktop/server distributions, embedded linux distribution is highly customized for a specific purpose. It's not unusual to observe more failures in Yocto than in a typical desktop Linux distro like Ubuntu, etc. So the major purposes of this work are:
* to understand the reasons for existing LTP failures. If the cause is from a specific package itself, go to fix it. Or else if the error simply come from the fact that a given package doesn't exist in current profile, add the explanation here
* to track LTP test results cross Yocto releases, and ensure a declining error number for same profile
* to be the reference if Yocto users want to get a base picture

==Overall trend==

Overall trend tends to track the change of LTP test results along with Yocto's progress. Previous data in 0.9 is not complete and not consistent configured on all targets. So we start from 1.0-M2 as the starting point.

In below table we list total LTP failures for each architectures in each milestone: (now this wiki doesn't allow upload files. So for detail logs please refer to earlier bug link)

{|border="1"
|| '''Milestone''' || '''sugarbay''' || '''qemux86''' || '''qemu-x86_64''' || '''qemuppc''' || '''qemuarm''' || '''qemumips''' || '''atom-pc''' || '''blacksand''' || '''beagleboard''' || '''routerstation''' || '''mpc8315e-rdb'''
|-
|| denzil|| 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21|| || ||
|-
|| 1.2-M4 RC3 || 18 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 24 || n/a || 21
|-
|| 1.2-M4 RC2 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 21 || 22 || 28 || 20
|-
|| 1.2-M4 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 28 || 20
|-
|| 1.2-M3 RC1 || 17 || n/a || n/a || n/a || n/a || n/a || n/a || 16 || 22 || 29 || 20
|-
|| 1.1.1 || 36 || n/a || n/a || n/a || n/a || n/a || n/a || 36 || 41 || 43 || 41
|-
|| 1.2-M2 RC1 || 26 || n/a || n/a || n/a || n/a || n/a || n/a || 27 || 30 || 37 || 31
|-
|| 1.2-M1 RC2 || 34 || n/a || n/a || 34 || 35 || 33 || n/a || 36 || 39 || 40 || 38
|-
|| 1.0.2 || || n/a || n/a || 35 || 35 || 35 || n/a || || 36 || 137 (*) || 36
|-
|| 1.1-M4 RC4 || 35 || n/a || n/a || 38 || 39 || 37 || n/a || 36 || 41 || 43 || 39
|-
|| 1.1-M4 RC3 || 37 || n/a || n/a || 37 || 38 || 37 || n/a || 37 || 41 || 44 || 39
|-
|| 1.1-M4 RC2 || 26 || n/a || n/a || 38 || 39 || 37 || n/a || 26 || 43 || 59 || 39
|-
|| 1.1-M3 || 27 || n/a || n/a || 35 || 37 || 36 || n/a || 28 || 41 || 57 || 42
|-
|| 1.1-M2 || 30 || n/a || n/a || 25 || 29 || 26 || n/a || 28 || 33 || 146 (*) || 31
|-
|| 1.1-M1 || 33 || n/a || n/a || 26 || 29 || 26 || n/a || 30 || 34 || 146 (*) || 32
|-
|| 1.0-M2 || || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) ||
|}
*: routerstation has kernel config issues. See later for detail.

general tips:
* Yocto links /tmp to /var/volatiles/tmp which is dynamically created at each boot. This causes one issue to LTP test. /var is normally not writable to non-root users, while LTP does run some test cases under non-root accounts. This causes considerable failures (~60 in qemux86) when creating temporary contents under /tmp. The workaround to this issue is to use "-d newtmpdir" when running LTP, where newtmpdir is created with full write permissions to all users.
* There's a puzzle which profile should be chosen as the test target. Now SDK is chosen because same image can work on both qemu and real hardware. LSB profile provides better result which is more desktop like but now this profile doesn't run on real hardware and lack of some development packages like gcc. For now we just keep this choice, and introduce a Not-A-Bug type to mark failures which are caused simply because related packages are missing
** It's better to use a tmp dir from the 2nd disk which contains ltp test suite. This way it avoids some noisy disk space limitation errors
* suggest to use "-m 512" as some tests are memory stress
* suggest to disable hackbench from runtest/sched, which is not suitable to run in emulator, and simply hang
* don't use "-q" option when running ltp, which hides many useful output info

==Current Milestone (denzil)==
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || || || || 1227
|-
|| failures || 21 || || || || 18
|-
|| fixed || 0 || || || ||
|-
|| NAB || 16 || || || ||
|}

===Configuration===
Below table includes which LTP categories are included in the measurement:

{|border="1"
|| '''Milestone''' || '''qemu targets''' || '''real hardware'''
|-
|| 1.2 M4
||
syscalls

mm

ipc

sched

math

nptl

pty

admin_tools

command
||
syscalls

fs

fsx

dio

io

mm

ipc

sched

math

nptl

pty

admin_tools

timers

commands
|}

==Previous Milestone==

a placeholder. Once we reach a new milestone, the data under "current milestone" will be moved here.
===1.2 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120412.log -C result-20120412.fail -d /opt/ltp/tmp &> result-20120412.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1228 || n/a || 1228 || 1227
|-
|| failures || 21 || 24 || n/a || 21 || 18
|-
|| fixed || 0 || 2 || n/a || 2 || 0
|-
|| NAB || 16 || 21 || n/a || 19 || 17
|}

===1.2 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20120401.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120405.log -C result-20120405.fail -d /opt/ltp/tmp &> result-20120405.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1229 || 1206 || 1206 || 1206 || 1209
|-
|| failures || 21 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 0 || 0 || 1
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}
===1.2 M4 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120328.log -C result-20120328.fail -d /opt/ltp/tmp &> result-20120328.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1206
|-
|| failures || 16 || 22 || 28 || 20 || 17
|-
|| fixed || 0 || 0 || 1 || 0 || 0
|-
|| NAB || 16 || 20 || 21 || 19 || 16
|}

===1.2 M3 RC1===
'''environment'''
'''LTP version''': ltp-full-20120104.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120229.log -C result-20120229.fail -d /opt/ltp/tmp &> result-20120229.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1208 || 1206 || 1206 || 1206 || 1026
|-
|| failures || 16 || 22 || 29 || 20 || 17
|-
|| fixed || 11 || 11 || 10 || 11 || 11
|-
|| NAB || 13 || 20 || 21 || 19 || 16
|}

===1.1.1===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-20120216.log -C result-20120216.fail -d /opt/ltp/tmp &> result-20120216.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1206 || 1203 || 1203
|-
|| failures || 36 || 41 || 43 || 41 || 36
|-
|| fixed || 0 || 0 || 0 || 0 || 0
|-
|| NAB || 22 || 36 || 36 || 39 || 24
|}
===1.2 M2 RC1===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20120111.log -C result-20120111.fail -d /opt/ltp/tmp &> result-20120111.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "blacksand" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1206 || 1206 || 1207 || 1204 || 1206
|-
|| failures || 27 || 30 || 37 || 31 || 26
|-
|| fixed || 13 || 14 || 14 || 9 || 12
|-
|| NAB || 24 || 27 || 33|| 28 || 22
|}

===1.2 M1 RC2===
'''environment'''
'''LTP version''': ltp-full-20110915.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111213.log -C result-20111213.fail -d /opt/ltp/tmp &> result-20111213.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1102 || 1106 || 1102 ||1205 || 1206 || 1207 || 1204 ||1205
|-
|| failures || 34 || 35 || 33 ||36 || 39 || 40 || 38 ||34
|-
|| fixed || 0 || 0 || 0 || 1 || 0 || 0 || 0 ||1
|-
|| NAB || 33 || 34 || 31 ||36 || 34 || 32|| 36 || 34
|}

===1.0.2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': poky-image-sato-sdk

'''run command''': ./runltp -p -l result-20111201.log -C result-20111201.fail -d /opt/ltp/tmp &> result-20111201.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || || 1206 || 1206 || 1206 ||
|-
|| failures || 35 || 35 || 35 || || 36 || 137 || 36 ||
|-
|| fixed || 0 || 0 || 0 || || 0 || 0 || 0 ||
|-
|| NAB || '''34''' || '''35''' || '''35''' || || '''36''' || '''37''' || '''36''' ||
|}

===1.1 M4 RC4===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1208
|-
|| failures || 38 || 39 || 37 || 36 || 41 || 43 || 39 || 35
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''36''' || '''36''' || '''37''' || '''37''' || '''35'''
|}

===1.1 M4 RC3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1208 || 1206 || 1206 || 1206 || 1203
|-
|| failures || 37 || 38 || 37 || 37 || 41 || 44 || 39 || 37
|-
|| fixed || 1 || 1 || 0 || 0 || 2 || 16 || 0 || 0
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''37''' || '''36''' || '''37''' || '''37''' || '''37'''
|}

===1.1 M4 RC2===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M4-20110914.log -C result-M4-20110914.fail -d /opt/ltp/tmp &> result-M4-20110914.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1206 || 1206 || 1206 || 1180
|-
|| failures || 38 || 39 || 37 || 26 || 43 || 59 || 39 || 26
|-
|| fixed || 0 || 0 || 0 || 5 || 0 || 0 || 6 || 1
|-
|| NAB || '''37''' || '''38''' || '''36''' || '''26''' || '''38''' || '''43''' || '''37''' || '''26'''
|}

===1.1 M3===
'''environment'''
'''LTP version''': ltp-full-20110606.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M3-20110806.log -C result-M3-20110806.fail -d /opt/ltp/tmp &> result-M3-20110806.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1104 || 1105 || 1104 || 1180 || 1207 || 1206 || 1206 || 1180
|-
|| failures || 35 || 37 || 36 || 28 || 41 || 57 || 42 || 27
|-
|| fixed || 0 || 3 || 3 || 0 || 3 || 104 || 0 || 9
|-
|| NAB || '''34''' || '''36''' || '''32''' || '''23''' || '''35''' || '''51''' || '''36''' || '''27'''
|}

===1.1 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M2-20110711.log -C result-M2-20110711.fail -d /opt/ltp/tmp &> result-M2-20110711.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1080 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 25 || 29 || 26 || 28 || 33 || 146 || 31 || 30
|-
|| fixed || 1 || 0 || 0 || 2 || 1 || 2 || 1 || 3
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''23''' || '''24''' || '''23''' || '''24''' || '''24'''
|}

===1.1 M1===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': core-image-sato-sdk

'''run command''': ./runltp -p -l result-M1-20110528.log -C result-M1-20110528.fail -d /opt/ltp/tmp &> result-M2-20110528.fulllog

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemuarm" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]''' || '''[[sugarbay-ltp|sugarbay]]'''
|-
|| total || 1078 || 1078 || 1078 || 1182 || 1180 || 1179 || 1180 || 1180
|-
|| failures || 26 || 29 || 26 || 30 || 34 || 146 || 32 || 33
|-
|| fixed || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''23''' || '''25''' || '''23''' || '''4''' || '''25''' || '''23''' || '''25''' || 0
|-
|| LTP || 0 || 0 || 0 || 0 || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || 0 || 0 || '''29''' || '''5''' || '''5''' || '''5''' || '''35'''
|-
|| pending || 0 || '''3''' || '''3''' || '''3''' || '''3''' || '''3''' || 0 || 0
|}

===1.0 M4===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -l result-M4-20110318.log -C result-M4-20110318.fail -d /opt/tmp

'''result'''
Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]''' || '''[[Jasperforest-ltp|Jasperforest]] (lsb-sdk)''' || '''[[mpc8315e-rdb-ltp|mpc8315e-rdb]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182 || 1198 ||
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*) || 20 ||
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)''' || '''0(0%)''' ||
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0 || 0 ||
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0 || 0 ||
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || ||
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0 || 13 ||
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0 || ||
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%''' || ||
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.

===1.0 M2===
'''environment'''
'''LTP version''': ltp-full-20101031.bz2

'''profile''': poky-image-sdk

'''run command''': ../runltp -p -q -l result-M2-20101218.log -C result-M2-20101218.fail -d /opt/tmp

Below table shows overall progress in LTP failures analysis for current milestone:
* '''total''': the number of total test cases
* '''failures''': the number of failures
* '''audit''': the number of audited failures, which status could be:
** fixed: the number of fixed failures
** LTP: native failures
** NAB: Not-A-Bug, the number of the failures which come from miss of some packages due to the profile definition, or can't reproduce locally
** pending: the analysis is done with bug reported, but pending for final solution
** duplicated: the number of failures which are same as on other platforms which have been analyzed already
* '''similarity''': similarity to Qemux86 which is chosen as the base. most cases are common on all targets

(click the title like "qemux86" to check detail data for that target
{|border="1"
|| '''Status''' || '''[[qemux86-ltp|Qemux86]]''' || '''[[qemux86_64-ltp|Qemux86_64]]''' || '''[[qemuppc-ltp|Qemuppc]]''' || '''[[qemuarm-ltp|Qemuarm]]''' || '''[[qemumips-ltp|Qemumips]]''' || '''[[netbook-ltp|netbook]]''' || '''[[blacksand-ltp|blacksand]]''' || '''[[beagleboard-ltp|beagleboard]]''' || '''[[routerstation-ltp|routerstation]]'''
|-
|| total || 1072 || n/a || 1071 || 1071 || 1081 || n/a || n/a || 1174 || 1182
|-
|| failures || 34 || 32 || 34 || 37 || 37 || 33 || 29 || 35 || 145 (*)
|-
|| '''audit''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' || '''100%''' ||'''100%''' || '''100%''' ||''' 0(0%)'''
|-
|| fixed || '''6''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0 || 0
|-
|| NAB || '''26''' || '''1''' || '''1''' || '''4''' || '''1''' || '''2''' || '''1''' || 0 || 0
|-
|| LTP || '''2''' || '''2''' || 0 || 0 || '''1''' || 0 || 0 || 0 || 0
|-
|| Duplicated || 0 || '''29''' || '''33''' || '''29''' || '''29''' || '''31''' || '''28''' || '''35''' || 0
|-
|| pending || 0 || 0 || 0 || '''3''' || 0 || 0 || 0 || 0 || 0
|-
|| '''similarity''' || '''100%''' || '''90%''' || '''88%''' || '''78%''' || '''78%''' || '''90%''' || '''96%''' || '''85%''' || '''19%'''
|}
* on routerstation kernel is not configured correctly. Lots of new failures
are related to IPC, which may come from lacking of some kernel options. This
has been verified with newer 2.6.37 kernel recently, that only ~60 failures
remaining. So the analysis is skipped for it in this cycle.