Qemux86-ltp: Difference between revisions

From Yocto Project
Jump to navigationJump to search
 
(13 intermediate revisions by 2 users not shown)
Line 1: Line 1:
==1.0/M2==
==1.0/M4 - RC2==
total: 34
'''total: 27'''
*NEW Intro: 2 (mtest01, mtest01w)
 
*LTP: 2
 
*NAB: 23
 
*Fixed: 0
 
*Disappear in this build without fixing: 0
 
New introduced failed cases:
{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| mtest01|| n/a || n/a || mtest01    0  TINFO  :  Total memory used needed to reach maxpercent = 409254 kbytes mtest01    0  TINFO  :  Total memory already used on system = 429332 kbytes mtest01    1  TFAIL  :  More memory than the maximum amount you specified is already being use || N/T || n/a || n/a
|-
|| mtest01w|| n/a || n/a || mtest01    0  TINFO  :  Total memory used needed to reach maxpercent = 409254 kbytes mtest01    0  TINFO  :  Total memory already used on system = 429332 kbytes mtest01    1  TFAIL  :  More memory than the maximum amount you specified is already being use || N/T || n/a || n/a
|-
|}


audit: 23(56.00%)
==1.0/M4 - RC1==
'''total: 25'''
*NEW Intro: 0


*LTP: 3
*LTP: 2


*NAB: 20
*NAB: 23


*Fixed: 0
*Fixed: 0


pending: 4
*Disappear in this build without fixing: 2(tar, open08)
 
{|border="1"
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|-
|| lchown02 || LTP || Kevin Tian || Fail to modify tfile_1 ownership(s) || N/T || n/a || n/a
|-
|| lchown02_16 || LTP || Kevin Tian || Fail to modify tfile_1 ownership(s) || N/T || n/a || n/a
|-
|| cron || NAB || Kevin Tian || cron_tests.sh: line 102: crontab: not found; tail: cannot open `/var/log/messages' for reading: No such file or directory || N/T || in yocto crontab is recorded in /var/log/sysctl
|| n/a
|-
|| ioctl03 || NAB || Kevin Tian || Error Opening /dev/net/tun: No such file or directory || N/T || tun is an optional kernel feature, not included in the kernel config for current profile
|| n/a
|-
|| unzip01 || NAB || Kevin Tian || unzip output differs from expected output. Details || '''PASS'''
|| busybox has a different output format
|| n/a
|-
|| syslog01 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: *.crit: not found; /var/log/maillog no such log file || N/T || n/a || n/a
|-
|| syslog02 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: mail.emerg: not found; /var/log/maillog no such log file || N/T || n/a || n/a
|-
|| syslog03 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: daemon.info: not found; /var/log/messages no such log file || N/T || n/a || n/a
|-
|| syslog04 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || N/T || n/a || n/a
|-
|| syslog05 || NAB || Kevin Tian  || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || N/T || n/a || n/a
|-
|| syslog07 || NAB || Kevin Tian  || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; grep: /var/log/messages: No such file or directory || N/T || n/a || n/a
|-
|| syslog08 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || N/T || n/a || n/a
|-
|| syslog09 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file || N/T || n/a || n/a
|-
|| syslog10 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file || N/T || n/a || n/a
|-
|| gzip01 || NAB || Kevin Tian || gzip: invalid option -- 'r' || '''PASS'''
|| busybox doesn't support "-r" option
|| n/a
|-
|| cpio || NAB || Kevin Tian || cpio: invalid option -- 'o' || '''PASS'''
|| busybox doesn't support "-o" option
|| n/a
|-
|| logrotate || NAB || Kevin Tian || INIT: command logrotate not found || N/T || n/a || n/a
|-
|| file || NAB || Kevin Tian || file_test.sh: line 576: rpmbuild: not found /usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm: cannot open `/usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm' (No such file or directory) || N/T || two reasons for LSB failure:
 
a) LTP's own problem - there's no check whether /usr/src/rpm/SRPM exists or not, which contributes to "No such file or directory" error;
 
b) rpm5 has different output as rpm.org. "RPM v3.0 bin" is generated while "RPM v3.0 src" is expected
|| n/a
|-
|| mtest06_2 || NAB || Kevin Tian || main(): mmap(): Cannot allocate memory || N/T || '''PASS''' by enlarging memory size to 1278M, because this test case requires 1G free memory
|| n/a
|-
|| cron_deny01 || NAB || Kevin Tian || Could not add test user c01_user to system || N/T || SDK profile doesn't contain cron;
 
LSB profile has multiple issues:
 
1) lsb's own error (use /var/spool/cron/deny while /etc/cron.deny is expected by cronie)
 
2) PATH contains ending colon which results "cron_deny01 not found" error
 
3) cronie itself lacks of necessary files and permissions to support non-root user using crontab 
|| [[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]
 
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]
 
|-
|| cron_allow01 || NAB || Kevin Tian || cron_allow01: line 200: useradd: not found || N/T || same reason as cron_deny01
|| [[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]
 
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]
 
|-
|| cron02 || NAB || Kevin Tian || cron02: line 79: useradd: not found;Could not add test user c01_user to system || N/T || same reason as cron_deny01
 
and one more specific reason. LTP cron test assumes vixie-cron behavior, which allows any user to use crontab if there's no /etc/cron.deny and /etc/cron.allow. cronie however enforces the reverse, that only superuser is allowed under that condition. LTP test case needs to be enhanced to explicitly set cron.allow before the test.
 
|| report to LTP
 
[[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]
 
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]
 
|-
|| cron_dirs_checks01 || NAB || Kevin Tian || FAIL: /etc/cron.d. Could not obtain directory status || N/T
|| lack of necessary directories, like cron.monthly, ...
 
but there's also one known issue. this case requires no write permission for group/other users, however we have to keep write permission for crontab user for /var/spool/cron to make crontab working correctly. So this case is known to fail in the future too
|| [[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]
 
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]


not started: 7
|-
|| su01 || NAB || Kevin Tian || su01: line 175: userdel: not found || N/T || su01_s1 uses '/usr/bin/expect' as the interpreter, which I don't think needs to add into yocto. so this will remain as a failure
 
there's one issue though, that /bin/sh is still linked to busybox even when bash is included in LSB profile, which makes the error message inaccurate. with bash the error becomes "/usr/bin/expect: bad interpreter"
 
|| [[http://bugzilla.pokylinux.org/show_bug.cgi?id=674 bug674]]
|-
|| sysctl03 || NAB || Kevin Tian ||  TWARN  :  this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details ||  N/T || TWARN is not a failure, especially in this case sysctl03 throws out the warning when the kernel version >2.6.32.
 
since we have 2.6.37, this is expected
|| n/a
|-
|}
 
==1.0/M2==
'''total: 34 (100% audited)'''
 
*LTP: 2
 
*NAB: 26
 
*Fixed: 6
 
pending: 0
 
not started: 0


{|border="1"  
{|border="1"  
Line 21: Line 161:
|| lchown02_16 || LTP || Kevin Tian || Fail to modify tfile_1 ownership(s) || Fail to modify tfile_1 ownership(s) || n/a || n/a
|| lchown02_16 || LTP || Kevin Tian || Fail to modify tfile_1 ownership(s) || Fail to modify tfile_1 ownership(s) || n/a || n/a
|-
|-
|| cron || LTP || Kevin Tian || cron_tests.sh: line 102: crontab: not found; tail: cannot open `/var/log/messages' for reading: No such file or directory || crontab activity not recorded in /var/log/messages. || lsb error is same as native || n/a
|| ld || Fixed || Kevin Tian || ld01: line 149: file: not found; FAIL - ld failed to build a shared object || ld01: line 75: gcc: not found
|| '''PASS''' after copying 'file' utility to SDK profile
 
but I'm not sure whether we want to pull this into SDK profile.
|| [[http://bugzilla.pokylinux.org/show_bug.cgi?id=676 bug676]]
|-
|-
|| ioctl03 || NAB || Kevin Tian || Error Opening /dev/net/tun: No such file or directory || Error Opening /dev/net/tun: No such file or directory || tun is an optional kernel feature, not included in the kernel config for current profile || n/a
|| ldd || Fixed || Kevin Tian || ldd01: line 99: file: not found; ldd01: line 100: ldd: not found || dd01: line 99: gcc: not found
|| '''PASS''' after copying 'ldd' utility to SDK profile
 
ldd package is actually generated already. this one is good to be included into SDK profile as a development utility
|| [[http://bugzilla.pokylinux.org/show_bug.cgi?id=676 bug676]]
|-
|-
|| unzip01 || NAB || Kevin Tian || unzip output differs from expected output. Details || PASS || busybox has a different output format || n/a
|| chroot01 || Fixed || Kevin Tian || Received unexpected error - 13 : Permission denied || '''PASS'''
|| this case expects an -EPERM (if /var is set with 755 permission bits), but not sure why SDK image in M2 has the permission bits of /var as 0700 which results -EACCES returned. latest master has no this issue. will monitor in later tests.
|| n/a
|-
|-
|| syslog01 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: *.crit: not found; /var/log/maillog no such log file || PASS || n/a || n/a
|| mtest06 || Fixed || Kevin Tian || caught unexpected signal - 11 --- exiting || same error in lsb
|| '''PASS''' in 01/11 nightly test
 
will recheck in next milestone test
|| n/a
|-
|-
|| syslog02 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: mail.emerg: not found; /var/log/maillog no such log file || PASS || n/a || n/a
|| at_deny01 || Fixed || Kevin Tian || TCONF  :  at command not found on system || at_deny01: line 194: /etc/init.d/atd: not found  
|| similar reason as cron_deny01, that we don't have a right environment for normal user to use at.
|| [[http://bugzilla.pokylinux.org/show_bug.cgi?id=675 bug675]]
 
bug5
|-
|-
|| syslog03 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: daemon.info: not found; /var/log/messages no such log file || PASS || n/a || n/a
|| at_allow01 || Fixed || Kevin Tian || TCONF  :  at command not found on system || at_allow01: line 185: /etc/init.d/atd: not found  
|| similar reason as cron_deny01, that we don't have a right environment for normal user to use at.
|| [[http://bugzilla.pokylinux.org/show_bug.cgi?id=675 bug675]]
 
bug5
|-
|-
|| syslog04 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || PASS || n/a || n/a
|| cron || NAB || Kevin Tian || cron_tests.sh: line 102: crontab: not found; tail: cannot open `/var/log/messages' for reading: No such file or directory || crontab activity not recorded in /var/log/messages.
|| in yocto crontab is recorded in /var/log/sysctl
|| n/a
|-
|-
|| syslog05 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || PASS || n/a || n/a
|| ioctl03 || NAB || Kevin Tian || Error Opening /dev/net/tun: No such file or directory || Error Opening /dev/net/tun: No such file or directory
|| tun is an optional kernel feature, not included in the kernel config for current profile
|| n/a
|-
|-
|| syslog07 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; grep: /var/log/messages: No such file or directory || PASS || n/a || n/a
|| unzip01 || NAB || Kevin Tian || unzip output differs from expected output. Details || '''PASS'''
|| busybox has a different output format
|| n/a
|-
|-
|| syslog08 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || PASS || n/a || n/a
|| syslog01 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: *.crit: not found; /var/log/maillog no such log file || '''PASS''' || n/a || n/a
|-
|-
|| syslog09 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file || PASS || n/a || n/a
|| syslog02 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: mail.emerg: not found; /var/log/maillog no such log file || '''PASS''' || n/a || n/a
|-
|-
|| syslog10 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file || PASS || n/a || n/a
|| syslog03 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: daemon.info: not found; /var/log/messages no such log file || '''PASS''' || n/a || n/a
|-
|-
|| tar || NAB || Kevin Tian || tar_tests.sh: line 172: file: not found; tar: zcvf option failed to create a compressed tar file || PASS || n/a || n/a
|| syslog04 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || '''PASS''' || n/a || n/a
|-
|-
|| gzip01 || NAB || Kevin Tian || gzip: invalid option -- 'r' || PASS || busybox doesn't support "-r" option || n/a
|| syslog05 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || '''PASS''' || n/a || n/a
|-
|-
|| cpio || NAB || Kevin Tian || cpio: invalid option -- 'o' || PASS || busybox doesn't support "-o" option || n/a
|| syslog07 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; grep: /var/log/messages: No such file or directory || '''PASS''' || n/a || n/a
|-
|-
|| logrotate || NAB || Kevin Tian || INIT: command logrotate not found || PASS || n/a || n/a
|| syslog08 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file || '''PASS''' || n/a || n/a
|-
|-
|| ld || NAB || Kevin Tian || ld01: line 149: file: not found; FAIL - ld failed to build a shared object || ld01: line 75: gcc: not found || PASS after copying 'file' utility to SDK profile || n/a
|| syslog09 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file || '''PASS''' || n/a || n/a
|-
|-
|| ldd || NAB || Kevin Tian || ldd01: line 99: file: not found; ldd01: line 100: ldd: not found || dd01: line 99: gcc: not found || PASS after copying 'ldd' utility to SDK profile || n/a
|| syslog10 || NAB || Kevin Tian || /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file || '''PASS''' || n/a || n/a
|-
|| tar || NAB || Kevin Tian || tar_tests.sh: line 172: file: not found; tar: zcvf option failed to create a compressed tar file || '''PASS'''
|| busybox supports less options than standard tar
|| n/a
|-
|| gzip01 || NAB || Kevin Tian || gzip: invalid option -- 'r' || '''PASS'''
|| busybox doesn't support "-r" option
|| n/a
|-
|| cpio || NAB || Kevin Tian || cpio: invalid option -- 'o' || '''PASS'''
|| busybox doesn't support "-o" option
|| n/a
|-
|| logrotate || NAB || Kevin Tian || INIT: command logrotate not found || '''PASS''' || n/a || n/a
|-
|| file || NAB || Kevin Tian || file_test.sh: line 162: file: not found || home/root/ltp/ltp/tmp/cprog: cannot open `/home/root/ltp/ltp/tmp/cprog' (No such file or directory); file09      9  TBROK  :  rpm command broke. Reason:warning: Could not canonicalize hostname: qemux86; error: Could not open /usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm: No such file or directory
|| two reasons for LSB failure:
 
a) LTP's own problem - there's no check whether /usr/src/rpm/SRPM exists or not, which contributes to "No such file or directory" error;
 
b) rpm5 has different output as rpm.org. "RPM v3.0 bin" is generated while "RPM v3.0 src" is expected
|| n/a
|-
|-
|| file || NAB || Kevin Tian || file_test.sh: line 162: file: not found || home/root/ltp/ltp/tmp/cprog: cannot open `/home/root/ltp/ltp/tmp/cprog' (No such file or directory); file09      9  TBROK  :  rpm command broke. Reason:warning: Could not canonicalize hostname: qemux86; error: Could not open /usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm: No such file or directory || two reasons for LSB failure: a) LTP's own problem - there's no check whether /usr/src/rpm/SRPM exists or not, which contributes to "No such file or directory" error; b) rpm5 has different output as rpm.org. "RPM v3.0 bin" is generated while "RPM v3.0 src" is expected || pending: to send a fix to LTP upstream
|| open08 || NAB || Kevin Tian || unexpected error - 13 : Permission denied - expected 21 || '''PASS''' || n/a || n/a
|-
|-
|| chroot01 || NAB || Kevin Tian || Received unexpected error - 13 : Permission denied || PASS || this case expects an -EPERM (if /var is set with 755 permission bits), but not sure why SDK image in M2 has the permission bits of /var as 0700 which results -EACCES returned. latest master has no this issue. will monitor in later tests. || n/a
|| mmapstress06 || NAB || Kevin Tian || mmapstress06: errno = 12; large mmap failed for this test to run, it needs a mmap space of 32769 pages || same in lsb
|| '''PASS''' with "-m 512". not enough free memory. at least 128M is required.
|| n/a
|-
|-
|| mmapstress06 || NAB || Kevin Tian || mmapstress06: errno = 12; large mmap failed for this test to run, it needs a mmap space of 32769 pages || same in lsb || PASS with "-m 512". not enough free memory. at least 128M is required.  || n/a
|| mtest06_2 || NAB || Kevin Tian || main(): mmap(): Cannot allocate memory || same error in lsb  
|| '''PASS''' by enlarging memory size to 1278M, because this test case requires 1G free memory  
|| n/a
|-
|-
|| cron_deny01 || NAB || Kevin Tian || Could not add test user c01_user to system || /bin/sh: cron_deny01: not found  
|| cron_deny01 || NAB || Kevin Tian || Could not add test user c01_user to system || /bin/sh: cron_deny01: not found  
Line 73: Line 267:


3) cronie itself lacks of necessary files and permissions to support non-root user using crontab   
3) cronie itself lacks of necessary files and permissions to support non-root user using crontab   
|| bug1
|| [[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]


bug2
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]


|-
|-
|| cron_allow01 || NAB || Kevin Tian || cron_allow01: line 200: useradd: not found || /bin/sh: cron_allow01: not found || same reason as cron_deny01  
|| cron_allow01 || NAB || Kevin Tian || cron_allow01: line 200: useradd: not found || /bin/sh: cron_allow01: not found || same reason as cron_deny01  
|| bug1
|| [[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]


bug2
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]


|-
|-
Line 90: Line 284:


|| report to LTP
|| report to LTP
[[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]
|-
|-
|| cron_dirs_checks01 || NAB || Kevin Tian || FAIL: /etc/cron.d. Could not obtain directory status || FAIL: /etc/cron.d. Could not obtain directory status  
|| cron_dirs_checks01 || NAB || Kevin Tian || FAIL: /etc/cron.d. Could not obtain directory status || FAIL: /etc/cron.d. Could not obtain directory status  
Line 95: Line 294:


but there's also one known issue. this case requires no write permission for group/other users, however we have to keep write permission for crontab user for /var/spool/cron to make crontab working correctly. So this case is known to fail in the future too  
but there's also one known issue. this case requires no write permission for group/other users, however we have to keep write permission for crontab user for /var/spool/cron to make crontab working correctly. So this case is known to fail in the future too  
|| bug1
|| [[http://bugzilla.yoctoproject.org/show_bug.cgi?id=672 bug672]]


bug2
[[http://bugzilla.pokylinux.org/show_bug.cgi?id=673 bug673]]


|-
|-
Line 105: Line 304:
there's one issue though, that /bin/sh is still linked to busybox even when bash is included in LSB profile, which makes the error message inaccurate. with bash the error becomes "/usr/bin/expect: bad interpreter"
there's one issue though, that /bin/sh is still linked to busybox even when bash is included in LSB profile, which makes the error message inaccurate. with bash the error becomes "/usr/bin/expect: bad interpreter"


|| bug3
|| [[http://bugzilla.pokylinux.org/show_bug.cgi?id=674 bug674]]
|-
|-
|| at_deny01 || NAB || Kevin Tian || TCONF :  at command not found on system || at_deny01: line 194: /etc/init.d/atd: not found
|| sysctl03 || NAB || Kevin Tian || TWARN :  this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details || TWARN  : this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details
|| similar reason as cron_deny01, that we don't have a right environment for normal user to use at.
|| TWARN is not a failure, especially in this case sysctl03 throws out the warning when the kernel version >2.6.32.  
|| bug4


bug5
since we have 2.6.37, this is expected
|-
|| n/a
|| at_allow01 || NAB || Kevin Tian || TCONF  :  at command not found on system || at_allow01: line 185: /etc/init.d/atd: not found
|| similar reason as cron_deny01, that we don't have a right environment for normal user to use at.  
|| bug4
 
bug5
|-
|| sysctl03 || pending || Kevin Tian ||  TWARN  :  this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details ||  TWARN  :  this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details || n/a || n/a
|-
|| open08 || not started || Kevin Tian || unexpected error - 13 : Permission denied - expected 21 || PASS || n/a || n/a
|-
|| mtest06 || not started || Kevin Tian  || caught unexpected signal - 11 --- exiting || same error in lsb || n/a || n/a
|-
|| mtest06_2 || not started || Kevin Tian || main(): mmap(): Cannot allocate memory || same error in lsb || n/a || n/a
|-
|-
|}
|}

Latest revision as of 03:11, 18 March 2011

1.0/M4 - RC2

total: 27

  • NEW Intro: 2 (mtest01, mtest01w)
  • LTP: 2
  • NAB: 23
  • Fixed: 0
  • Disappear in this build without fixing: 0

New introduced failed cases:

LTP cases status owner error msg lsb comment bugzilla
mtest01 n/a n/a mtest01 0 TINFO  : Total memory used needed to reach maxpercent = 409254 kbytes mtest01 0 TINFO  : Total memory already used on system = 429332 kbytes mtest01 1 TFAIL  : More memory than the maximum amount you specified is already being use N/T n/a n/a
mtest01w n/a n/a mtest01 0 TINFO  : Total memory used needed to reach maxpercent = 409254 kbytes mtest01 0 TINFO  : Total memory already used on system = 429332 kbytes mtest01 1 TFAIL  : More memory than the maximum amount you specified is already being use N/T n/a n/a

1.0/M4 - RC1

total: 25

  • NEW Intro: 0
  • LTP: 2
  • NAB: 23
  • Fixed: 0
  • Disappear in this build without fixing: 2(tar, open08)
LTP cases status owner error msg lsb comment bugzilla
lchown02 LTP Kevin Tian Fail to modify tfile_1 ownership(s) N/T n/a n/a
lchown02_16 LTP Kevin Tian Fail to modify tfile_1 ownership(s) N/T n/a n/a
cron NAB Kevin Tian cron_tests.sh: line 102: crontab: not found; tail: cannot open `/var/log/messages' for reading: No such file or directory N/T in yocto crontab is recorded in /var/log/sysctl n/a
ioctl03 NAB Kevin Tian Error Opening /dev/net/tun: No such file or directory N/T tun is an optional kernel feature, not included in the kernel config for current profile n/a
unzip01 NAB Kevin Tian unzip output differs from expected output. Details PASS busybox has a different output format n/a
syslog01 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: *.crit: not found; /var/log/maillog no such log file N/T n/a n/a
syslog02 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: mail.emerg: not found; /var/log/maillog no such log file N/T n/a n/a
syslog03 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: daemon.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog04 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog05 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog07 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; grep: /var/log/messages: No such file or directory N/T n/a n/a
syslog08 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog09 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file N/T n/a n/a
syslog10 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file N/T n/a n/a
gzip01 NAB Kevin Tian gzip: invalid option -- 'r' PASS busybox doesn't support "-r" option n/a
cpio NAB Kevin Tian cpio: invalid option -- 'o' PASS busybox doesn't support "-o" option n/a
logrotate NAB Kevin Tian INIT: command logrotate not found N/T n/a n/a
file NAB Kevin Tian file_test.sh: line 576: rpmbuild: not found /usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm: cannot open `/usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm' (No such file or directory) N/T two reasons for LSB failure:

a) LTP's own problem - there's no check whether /usr/src/rpm/SRPM exists or not, which contributes to "No such file or directory" error;

b) rpm5 has different output as rpm.org. "RPM v3.0 bin" is generated while "RPM v3.0 src" is expected

n/a
mtest06_2 NAB Kevin Tian main(): mmap(): Cannot allocate memory N/T PASS by enlarging memory size to 1278M, because this test case requires 1G free memory n/a
cron_deny01 NAB Kevin Tian Could not add test user c01_user to system N/T SDK profile doesn't contain cron;

LSB profile has multiple issues:

1) lsb's own error (use /var/spool/cron/deny while /etc/cron.deny is expected by cronie)

2) PATH contains ending colon which results "cron_deny01 not found" error

3) cronie itself lacks of necessary files and permissions to support non-root user using crontab

[bug672]

[bug673]

cron_allow01 NAB Kevin Tian cron_allow01: line 200: useradd: not found N/T same reason as cron_deny01 [bug672]

[bug673]

cron02 NAB Kevin Tian cron02: line 79: useradd: not found;Could not add test user c01_user to system N/T same reason as cron_deny01

and one more specific reason. LTP cron test assumes vixie-cron behavior, which allows any user to use crontab if there's no /etc/cron.deny and /etc/cron.allow. cronie however enforces the reverse, that only superuser is allowed under that condition. LTP test case needs to be enhanced to explicitly set cron.allow before the test.

report to LTP

[bug672]

[bug673]

cron_dirs_checks01 NAB Kevin Tian FAIL: /etc/cron.d. Could not obtain directory status N/T lack of necessary directories, like cron.monthly, ...

but there's also one known issue. this case requires no write permission for group/other users, however we have to keep write permission for crontab user for /var/spool/cron to make crontab working correctly. So this case is known to fail in the future too

[bug672]

[bug673]

su01 NAB Kevin Tian su01: line 175: userdel: not found N/T su01_s1 uses '/usr/bin/expect' as the interpreter, which I don't think needs to add into yocto. so this will remain as a failure

there's one issue though, that /bin/sh is still linked to busybox even when bash is included in LSB profile, which makes the error message inaccurate. with bash the error becomes "/usr/bin/expect: bad interpreter"

[bug674]
sysctl03 NAB Kevin Tian TWARN  : this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details N/T TWARN is not a failure, especially in this case sysctl03 throws out the warning when the kernel version >2.6.32.

since we have 2.6.37, this is expected

n/a

1.0/M2

total: 34 (100% audited)

  • LTP: 2
  • NAB: 26
  • Fixed: 6

pending: 0

not started: 0

LTP cases status owner error msg lsb comment bugzilla
lchown02 LTP Kevin Tian Fail to modify tfile_1 ownership(s) Fail to modify tfile_1 ownership(s) n/a n/a
lchown02_16 LTP Kevin Tian Fail to modify tfile_1 ownership(s) Fail to modify tfile_1 ownership(s) n/a n/a
ld Fixed Kevin Tian ld01: line 149: file: not found; FAIL - ld failed to build a shared object ld01: line 75: gcc: not found PASS after copying 'file' utility to SDK profile

but I'm not sure whether we want to pull this into SDK profile.

[bug676]
ldd Fixed Kevin Tian ldd01: line 99: file: not found; ldd01: line 100: ldd: not found dd01: line 99: gcc: not found PASS after copying 'ldd' utility to SDK profile

ldd package is actually generated already. this one is good to be included into SDK profile as a development utility

[bug676]
chroot01 Fixed Kevin Tian Received unexpected error - 13 : Permission denied PASS this case expects an -EPERM (if /var is set with 755 permission bits), but not sure why SDK image in M2 has the permission bits of /var as 0700 which results -EACCES returned. latest master has no this issue. will monitor in later tests. n/a
mtest06 Fixed Kevin Tian caught unexpected signal - 11 --- exiting same error in lsb PASS in 01/11 nightly test

will recheck in next milestone test

n/a
at_deny01 Fixed Kevin Tian TCONF  : at command not found on system at_deny01: line 194: /etc/init.d/atd: not found similar reason as cron_deny01, that we don't have a right environment for normal user to use at. [bug675]

bug5

at_allow01 Fixed Kevin Tian TCONF  : at command not found on system at_allow01: line 185: /etc/init.d/atd: not found similar reason as cron_deny01, that we don't have a right environment for normal user to use at. [bug675]

bug5

cron NAB Kevin Tian cron_tests.sh: line 102: crontab: not found; tail: cannot open `/var/log/messages' for reading: No such file or directory crontab activity not recorded in /var/log/messages. in yocto crontab is recorded in /var/log/sysctl n/a
ioctl03 NAB Kevin Tian Error Opening /dev/net/tun: No such file or directory Error Opening /dev/net/tun: No such file or directory tun is an optional kernel feature, not included in the kernel config for current profile n/a
unzip01 NAB Kevin Tian unzip output differs from expected output. Details PASS busybox has a different output format n/a
syslog01 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: *.crit: not found; /var/log/maillog no such log file PASS n/a n/a
syslog02 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: mail.emerg: not found; /var/log/maillog no such log file PASS n/a n/a
syslog03 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: daemon.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog04 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog05 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog07 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; grep: /var/log/messages: No such file or directory PASS n/a n/a
syslog08 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog09 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file PASS n/a n/a
syslog10 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file PASS n/a n/a
tar NAB Kevin Tian tar_tests.sh: line 172: file: not found; tar: zcvf option failed to create a compressed tar file PASS busybox supports less options than standard tar n/a
gzip01 NAB Kevin Tian gzip: invalid option -- 'r' PASS busybox doesn't support "-r" option n/a
cpio NAB Kevin Tian cpio: invalid option -- 'o' PASS busybox doesn't support "-o" option n/a
logrotate NAB Kevin Tian INIT: command logrotate not found PASS n/a n/a
file NAB Kevin Tian file_test.sh: line 162: file: not found home/root/ltp/ltp/tmp/cprog: cannot open `/home/root/ltp/ltp/tmp/cprog' (No such file or directory); file09 9 TBROK  : rpm command broke. Reason:warning: Could not canonicalize hostname: qemux86; error: Could not open /usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm: No such file or directory two reasons for LSB failure:

a) LTP's own problem - there's no check whether /usr/src/rpm/SRPM exists or not, which contributes to "No such file or directory" error;

b) rpm5 has different output as rpm.org. "RPM v3.0 bin" is generated while "RPM v3.0 src" is expected

n/a
open08 NAB Kevin Tian unexpected error - 13 : Permission denied - expected 21 PASS n/a n/a
mmapstress06 NAB Kevin Tian mmapstress06: errno = 12; large mmap failed for this test to run, it needs a mmap space of 32769 pages same in lsb PASS with "-m 512". not enough free memory. at least 128M is required. n/a
mtest06_2 NAB Kevin Tian main(): mmap(): Cannot allocate memory same error in lsb PASS by enlarging memory size to 1278M, because this test case requires 1G free memory n/a
cron_deny01 NAB Kevin Tian Could not add test user c01_user to system /bin/sh: cron_deny01: not found SDK profile doesn't contain cron;

LSB profile has multiple issues:

1) lsb's own error (use /var/spool/cron/deny while /etc/cron.deny is expected by cronie)

2) PATH contains ending colon which results "cron_deny01 not found" error

3) cronie itself lacks of necessary files and permissions to support non-root user using crontab

[bug672]

[bug673]

cron_allow01 NAB Kevin Tian cron_allow01: line 200: useradd: not found /bin/sh: cron_allow01: not found same reason as cron_deny01 [bug672]

[bug673]

cron02 NAB Kevin Tian cron02: line 79: useradd: not found;Could not add test user c01_user to system /bin/sh: cron_pos_tests.sh: not found same reason as cron_deny01

and one more specific reason. LTP cron test assumes vixie-cron behavior, which allows any user to use crontab if there's no /etc/cron.deny and /etc/cron.allow. cronie however enforces the reverse, that only superuser is allowed under that condition. LTP test case needs to be enhanced to explicitly set cron.allow before the test.

report to LTP

[bug672]

[bug673]

cron_dirs_checks01 NAB Kevin Tian FAIL: /etc/cron.d. Could not obtain directory status FAIL: /etc/cron.d. Could not obtain directory status lack of necessary directories, like cron.monthly, ...

but there's also one known issue. this case requires no write permission for group/other users, however we have to keep write permission for crontab user for /var/spool/cron to make crontab working correctly. So this case is known to fail in the future too

[bug672]

[bug673]

su01 NAB Kevin Tian su01: line 175: userdel: not found sh: /home/root/ltp/ltp/testcases/bin/su01_s1: not found su01_s1 uses '/usr/bin/expect' as the interpreter, which I don't think needs to add into yocto. so this will remain as a failure

there's one issue though, that /bin/sh is still linked to busybox even when bash is included in LSB profile, which makes the error message inaccurate. with bash the error becomes "/usr/bin/expect: bad interpreter"

[bug674]
sysctl03 NAB Kevin Tian TWARN  : this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details TWARN  : this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details TWARN is not a failure, especially in this case sysctl03 throws out the warning when the kernel version >2.6.32.

since we have 2.6.37, this is expected

n/a
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Qemux86-ltp&oldid=974"