Qemux86-ltp: Difference between revisions

From Yocto Project
Jump to navigationJump to search
No edit summary
 
Line 11: Line 11:
*Disappear in this build without fixing: 0
*Disappear in this build without fixing: 0


New introduced failed cases:
{|border="1"  
{|border="1"  
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
|| '''LTP cases'''|| '''status''' || '''owner''' || '''error msg''' || '''lsb''' || '''comment''' || '''bugzilla'''
Line 19: Line 20:
|-
|-
|}
|}


==1.0/M4 - RC1==
==1.0/M4 - RC1==

Latest revision as of 03:11, 18 March 2011

1.0/M4 - RC2

total: 27

  • NEW Intro: 2 (mtest01, mtest01w)
  • LTP: 2
  • NAB: 23
  • Fixed: 0
  • Disappear in this build without fixing: 0

New introduced failed cases:

LTP cases status owner error msg lsb comment bugzilla
mtest01 n/a n/a mtest01 0 TINFO  : Total memory used needed to reach maxpercent = 409254 kbytes mtest01 0 TINFO  : Total memory already used on system = 429332 kbytes mtest01 1 TFAIL  : More memory than the maximum amount you specified is already being use N/T n/a n/a
mtest01w n/a n/a mtest01 0 TINFO  : Total memory used needed to reach maxpercent = 409254 kbytes mtest01 0 TINFO  : Total memory already used on system = 429332 kbytes mtest01 1 TFAIL  : More memory than the maximum amount you specified is already being use N/T n/a n/a

1.0/M4 - RC1

total: 25

  • NEW Intro: 0
  • LTP: 2
  • NAB: 23
  • Fixed: 0
  • Disappear in this build without fixing: 2(tar, open08)
LTP cases status owner error msg lsb comment bugzilla
lchown02 LTP Kevin Tian Fail to modify tfile_1 ownership(s) N/T n/a n/a
lchown02_16 LTP Kevin Tian Fail to modify tfile_1 ownership(s) N/T n/a n/a
cron NAB Kevin Tian cron_tests.sh: line 102: crontab: not found; tail: cannot open `/var/log/messages' for reading: No such file or directory N/T in yocto crontab is recorded in /var/log/sysctl n/a
ioctl03 NAB Kevin Tian Error Opening /dev/net/tun: No such file or directory N/T tun is an optional kernel feature, not included in the kernel config for current profile n/a
unzip01 NAB Kevin Tian unzip output differs from expected output. Details PASS busybox has a different output format n/a
syslog01 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: *.crit: not found; /var/log/maillog no such log file N/T n/a n/a
syslog02 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: mail.emerg: not found; /var/log/maillog no such log file N/T n/a n/a
syslog03 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: daemon.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog04 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog05 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog07 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; grep: /var/log/messages: No such file or directory N/T n/a n/a
syslog08 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file N/T n/a n/a
syslog09 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file N/T n/a n/a
syslog10 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file N/T n/a n/a
gzip01 NAB Kevin Tian gzip: invalid option -- 'r' PASS busybox doesn't support "-r" option n/a
cpio NAB Kevin Tian cpio: invalid option -- 'o' PASS busybox doesn't support "-o" option n/a
logrotate NAB Kevin Tian INIT: command logrotate not found N/T n/a n/a
file NAB Kevin Tian file_test.sh: line 576: rpmbuild: not found /usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm: cannot open `/usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm' (No such file or directory) N/T two reasons for LSB failure:

a) LTP's own problem - there's no check whether /usr/src/rpm/SRPM exists or not, which contributes to "No such file or directory" error;

b) rpm5 has different output as rpm.org. "RPM v3.0 bin" is generated while "RPM v3.0 src" is expected

n/a
mtest06_2 NAB Kevin Tian main(): mmap(): Cannot allocate memory N/T PASS by enlarging memory size to 1278M, because this test case requires 1G free memory n/a
cron_deny01 NAB Kevin Tian Could not add test user c01_user to system N/T SDK profile doesn't contain cron;

LSB profile has multiple issues:

1) lsb's own error (use /var/spool/cron/deny while /etc/cron.deny is expected by cronie)

2) PATH contains ending colon which results "cron_deny01 not found" error

3) cronie itself lacks of necessary files and permissions to support non-root user using crontab

[bug672]

[bug673]

cron_allow01 NAB Kevin Tian cron_allow01: line 200: useradd: not found N/T same reason as cron_deny01 [bug672]

[bug673]

cron02 NAB Kevin Tian cron02: line 79: useradd: not found;Could not add test user c01_user to system N/T same reason as cron_deny01

and one more specific reason. LTP cron test assumes vixie-cron behavior, which allows any user to use crontab if there's no /etc/cron.deny and /etc/cron.allow. cronie however enforces the reverse, that only superuser is allowed under that condition. LTP test case needs to be enhanced to explicitly set cron.allow before the test.

report to LTP

[bug672]

[bug673]

cron_dirs_checks01 NAB Kevin Tian FAIL: /etc/cron.d. Could not obtain directory status N/T lack of necessary directories, like cron.monthly, ...

but there's also one known issue. this case requires no write permission for group/other users, however we have to keep write permission for crontab user for /var/spool/cron to make crontab working correctly. So this case is known to fail in the future too

[bug672]

[bug673]

su01 NAB Kevin Tian su01: line 175: userdel: not found N/T su01_s1 uses '/usr/bin/expect' as the interpreter, which I don't think needs to add into yocto. so this will remain as a failure

there's one issue though, that /bin/sh is still linked to busybox even when bash is included in LSB profile, which makes the error message inaccurate. with bash the error becomes "/usr/bin/expect: bad interpreter"

[bug674]
sysctl03 NAB Kevin Tian TWARN  : this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details N/T TWARN is not a failure, especially in this case sysctl03 throws out the warning when the kernel version >2.6.32.

since we have 2.6.37, this is expected

n/a

1.0/M2

total: 34 (100% audited)

  • LTP: 2
  • NAB: 26
  • Fixed: 6

pending: 0

not started: 0

LTP cases status owner error msg lsb comment bugzilla
lchown02 LTP Kevin Tian Fail to modify tfile_1 ownership(s) Fail to modify tfile_1 ownership(s) n/a n/a
lchown02_16 LTP Kevin Tian Fail to modify tfile_1 ownership(s) Fail to modify tfile_1 ownership(s) n/a n/a
ld Fixed Kevin Tian ld01: line 149: file: not found; FAIL - ld failed to build a shared object ld01: line 75: gcc: not found PASS after copying 'file' utility to SDK profile

but I'm not sure whether we want to pull this into SDK profile.

[bug676]
ldd Fixed Kevin Tian ldd01: line 99: file: not found; ldd01: line 100: ldd: not found dd01: line 99: gcc: not found PASS after copying 'ldd' utility to SDK profile

ldd package is actually generated already. this one is good to be included into SDK profile as a development utility

[bug676]
chroot01 Fixed Kevin Tian Received unexpected error - 13 : Permission denied PASS this case expects an -EPERM (if /var is set with 755 permission bits), but not sure why SDK image in M2 has the permission bits of /var as 0700 which results -EACCES returned. latest master has no this issue. will monitor in later tests. n/a
mtest06 Fixed Kevin Tian caught unexpected signal - 11 --- exiting same error in lsb PASS in 01/11 nightly test

will recheck in next milestone test

n/a
at_deny01 Fixed Kevin Tian TCONF  : at command not found on system at_deny01: line 194: /etc/init.d/atd: not found similar reason as cron_deny01, that we don't have a right environment for normal user to use at. [bug675]

bug5

at_allow01 Fixed Kevin Tian TCONF  : at command not found on system at_allow01: line 185: /etc/init.d/atd: not found similar reason as cron_deny01, that we don't have a right environment for normal user to use at. [bug675]

bug5

cron NAB Kevin Tian cron_tests.sh: line 102: crontab: not found; tail: cannot open `/var/log/messages' for reading: No such file or directory crontab activity not recorded in /var/log/messages. in yocto crontab is recorded in /var/log/sysctl n/a
ioctl03 NAB Kevin Tian Error Opening /dev/net/tun: No such file or directory Error Opening /dev/net/tun: No such file or directory tun is an optional kernel feature, not included in the kernel config for current profile n/a
unzip01 NAB Kevin Tian unzip output differs from expected output. Details PASS busybox has a different output format n/a
syslog01 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: *.crit: not found; /var/log/maillog no such log file PASS n/a n/a
syslog02 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: mail.emerg: not found; /var/log/maillog no such log file PASS n/a n/a
syslog03 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: daemon.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog04 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog05 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog07 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; grep: /var/log/messages: No such file or directory PASS n/a n/a
syslog08 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.info: not found; /var/log/messages no such log file PASS n/a n/a
syslog09 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file PASS n/a n/a
syslog10 NAB Kevin Tian /etc/init.d/syslog: /etc/syslog.conf: line 2: user.debug: not found; /var/log/messages no such log file PASS n/a n/a
tar NAB Kevin Tian tar_tests.sh: line 172: file: not found; tar: zcvf option failed to create a compressed tar file PASS busybox supports less options than standard tar n/a
gzip01 NAB Kevin Tian gzip: invalid option -- 'r' PASS busybox doesn't support "-r" option n/a
cpio NAB Kevin Tian cpio: invalid option -- 'o' PASS busybox doesn't support "-o" option n/a
logrotate NAB Kevin Tian INIT: command logrotate not found PASS n/a n/a
file NAB Kevin Tian file_test.sh: line 162: file: not found home/root/ltp/ltp/tmp/cprog: cannot open `/home/root/ltp/ltp/tmp/cprog' (No such file or directory); file09 9 TBROK  : rpm command broke. Reason:warning: Could not canonicalize hostname: qemux86; error: Could not open /usr/src/rpm/SRPMS/cprog-0.0.7-3.src.rpm: No such file or directory two reasons for LSB failure:

a) LTP's own problem - there's no check whether /usr/src/rpm/SRPM exists or not, which contributes to "No such file or directory" error;

b) rpm5 has different output as rpm.org. "RPM v3.0 bin" is generated while "RPM v3.0 src" is expected

n/a
open08 NAB Kevin Tian unexpected error - 13 : Permission denied - expected 21 PASS n/a n/a
mmapstress06 NAB Kevin Tian mmapstress06: errno = 12; large mmap failed for this test to run, it needs a mmap space of 32769 pages same in lsb PASS with "-m 512". not enough free memory. at least 128M is required. n/a
mtest06_2 NAB Kevin Tian main(): mmap(): Cannot allocate memory same error in lsb PASS by enlarging memory size to 1278M, because this test case requires 1G free memory n/a
cron_deny01 NAB Kevin Tian Could not add test user c01_user to system /bin/sh: cron_deny01: not found SDK profile doesn't contain cron;

LSB profile has multiple issues:

1) lsb's own error (use /var/spool/cron/deny while /etc/cron.deny is expected by cronie)

2) PATH contains ending colon which results "cron_deny01 not found" error

3) cronie itself lacks of necessary files and permissions to support non-root user using crontab

[bug672]

[bug673]

cron_allow01 NAB Kevin Tian cron_allow01: line 200: useradd: not found /bin/sh: cron_allow01: not found same reason as cron_deny01 [bug672]

[bug673]

cron02 NAB Kevin Tian cron02: line 79: useradd: not found;Could not add test user c01_user to system /bin/sh: cron_pos_tests.sh: not found same reason as cron_deny01

and one more specific reason. LTP cron test assumes vixie-cron behavior, which allows any user to use crontab if there's no /etc/cron.deny and /etc/cron.allow. cronie however enforces the reverse, that only superuser is allowed under that condition. LTP test case needs to be enhanced to explicitly set cron.allow before the test.

report to LTP

[bug672]

[bug673]

cron_dirs_checks01 NAB Kevin Tian FAIL: /etc/cron.d. Could not obtain directory status FAIL: /etc/cron.d. Could not obtain directory status lack of necessary directories, like cron.monthly, ...

but there's also one known issue. this case requires no write permission for group/other users, however we have to keep write permission for crontab user for /var/spool/cron to make crontab working correctly. So this case is known to fail in the future too

[bug672]

[bug673]

su01 NAB Kevin Tian su01: line 175: userdel: not found sh: /home/root/ltp/ltp/testcases/bin/su01_s1: not found su01_s1 uses '/usr/bin/expect' as the interpreter, which I don't think needs to add into yocto. so this will remain as a failure

there's one issue though, that /bin/sh is still linked to busybox even when bash is included in LSB profile, which makes the error message inaccurate. with bash the error becomes "/usr/bin/expect: bad interpreter"

[bug674]
sysctl03 NAB Kevin Tian TWARN  : this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details TWARN  : this test's results are based on potentially undocumented behavior in the kernel. read the NOTE in the source file for more details TWARN is not a failure, especially in this case sysctl03 throws out the warning when the kernel version >2.6.32.

since we have 2.6.37, this is expected

n/a