LSB Result
Introduction
The Linux Standard Base(LSB) was created to lower the overall costs of supporting the Linux platform. By reducing the differences between individual Linux distributions, the LSB greatly reduces the costs involved with porting applications to different distributions, as well as lowers the cost and effort involved in after-market support of those applications. (http://www.linuxfoundation.org/collaborate/workgroups/lsb)
LSB Test Suite support the following architecture.
- i486
- ia64
- ppc32
- ppc64
- s390
- s390x
- x86_64
So LSB don't support arm and mips at present time and it will add test suite to support arm and mips possibly in the future.
Test Environment
- Image: core-image-lsb-qt3
- Platform: x86-32(emenlow), x86-64(jasperforest), ppc(mpc8315e-rdb)
- Version of LSB Test Suite: 4.1
result
Below table shows the result of LSB Test on different platforms. X86 result is updated in 2011-06-23. Ppc32 result is update in 2011-06-16
| Test | Version | X86-32(emenlow) | X86-64(jasperforest) | ppc(mpc8315e-rdb) |
| Command Check | v 4.1.0-1 | Success | Failures: 1 | |
| Library Check | v 4.1.0-1 | Warnings: 49 | Failures: 10 | |
| Alsa-T2C Tests | v 4.1.0-1 | Success | Test suite error | |
| Core Tests | v 4.1.0-1 | Failures: 13 | Failures: 66 | |
| Core-T2C Tests | v 4.1.0-1 | Success | Success | |
| Cpp-T2C Tests | v 4.1.0-1 | Success | Success | |
| Desktop Tests | v 4.1.0-2 | Failures: 18 | Test suite error | |
| Desktop-T2C Tests | v 4.1.0-1 | Failures: 3 | Test suite error | |
| Libstdc++ Tests | v 4.1.0-13 | Failures: 6 | Failures: 2 | |
| OLVER Core Tests | v 4.1.0-1 | Failures: 10 | Block | |
| Perl Tests | v 4.1.0-1 | Failures: 1 | Failures: 1 | |
| Printing Tests | v 4.1.0-1 | Failures: 1 | Failures: 3 | |
| Python Runtime Tests | v 4.1.1-2 | Success | Success | |
| Qt3-Azov Tests | v 4.1.0-1 | Success | Failures: 106 | |
| Qt4-Azov Tests | v 4.1.0-1 | Failures: 5 | Failures: 69 | |
| Xml2-Azov Tests | v 4.1.0-1 | Success | Success | |
| Xts5 Tests | v 5.1.5-38 | Warnings: 8 | Warnings: 8 | |
| Apache Tests | v 2.2.14-3 | Success | Success | |
| Expect Tests | v 5.43.0-11 | Success | Success | |
| Groff Tests | v 1.20.1-5 | Success | Success | |
| Raptor Tests | v 1.4.19-3 | Success | Success | |
| Rsync Tests | v 3.0.6-3 | Success | Success | |
| Samba Tests | v 3.4.3-5 | Success | Success | |
| Tcl Tests | v 8.5.7-6 | Success | Success | |
| Xpdf Tests | v 1.01-10 | Success | Failures: 1 |
Analysis of result
Below table shows the failed test cases.
- Total failures: The number of total failures after running test. It includes known problems and real failures which should be fixed.
- Known problem: Known problem means it is a bug of LSB itself and we can find trace these bugs on http://bugs.linuxbase.org. On link page we give a summary of known problems.
- Failures(need to fix) : Real failures we should fix them
- Test suite error : Caused by two reasons: one is for absent library needed by test suite. one is that test suite could lose some function which should be included in it.
x86-32 (emenlow,update(2011-06-23))
- New problem: It is a bug without arising on previous version. It could be caused by some patches updated every day.
| Test | Total failures | Known problem | Failures(need to fix) | Note |
| Core Tests | 13 | 13 | ||
| Libstdc++ Tests | 6 | 6 | ||
| Desktop Tests | 18 | 18 | ||
| Desktop-T2C Tests | 3 | 3 | ||
| OLVER Core Tests | 10 | 10 | ||
| Perl Tests | 1 | 1 | ||
| Printing Tests | 1 | 1 | ||
| Qt4-Azov Tests | 5 | 5 |
ppc(mpc8315e,update(2011-06-16))
We have the following failures(including "unresolved" and "failed") to fix.
| Test | Total failures | Known problem | Failures(need to fix) | Note |
| Command Check | 1 | 1 | New problem,Absent command | |
| Alsa-T2C Tests | New problem,Test suite error | |||
| Core Tests | 66 | 10 | 47(unresolved), 8(failed), 1(unreported) | |
| Desktop Tests | New problem, test suite error | |||
| Desktop-T2C Tests | New problem, test suite error | |||
| Library Check | 10 | 10 | New problem, Absent libraries | |
| Libstdc++ Tests | 2 | |||
| OLVER Core Tests | Blocked | |||
| Perl Tests | 1 | 1 | ||
| Printing Tests | 3 | 1 | 1(unresolved), 1(failure), 1(unreported) | |
| Qt3-Azov | 106 | No enough memory | ||
| Qt4-Azov | 69 | 5 | 64(unresolved) |
Failures tracker(update 2011-06-23)
We should fix the following problems. We also filed bugs for them and try to fix them.
| Tests | Sub Tests | Test Number | Arch | Bug ID of yocto | Proposal suggestion |
| Desktop Tests | /tests/functions/SpawnProc/SpawnProc 2nd (unresolved) | 2 | ppc | http://bugzilla.pokylinux.org/show_bug.cgi?id=1117 | |
| Printing Tests | /convenience/cupsConvenience 37th (unresolved) | 37 | ppc | http://bugzilla.pokylinux.org/show_bug.cgi?id=1123 | |
| Library Check | No library libQtOpenGL | x86,x86-64,ppc | http://git.pokylinux.org/cgit.cgi/poky-contrib/commit/?h=xiaofeng/opengl&id=1f612db123f367778de2a7a6fafd31b79538f075 | ||
| Qt4-Azov Tests | Child process timed out | ppc |
Known problems tracker
See details on Known problems tracker
