LSB Result: Difference between revisions

From Yocto Project
Jump to navigationJump to search
Line 131: Line 131:
|| '''Qt3-Azov''' || 106 ||  ||  ||  No enough memory
|| '''Qt3-Azov''' || 106 ||  ||  ||  No enough memory
|-
|-
|| '''Qt4-Azov''' || 69 || 5 || 64(unresolved)
|| '''Qt4-Azov''' || 69 || 5 || 64(unresolved)||
|-
|-
|}
|}

Revision as of 02:52, 23 June 2011

Introduction

The Linux Standard Base(LSB) was created to lower the overall costs of supporting the Linux platform. By reducing the differences between individual Linux distributions, the LSB greatly reduces the costs involved with porting applications to different distributions, as well as lowers the cost and effort involved in after-market support of those applications. (http://www.linuxfoundation.org/collaborate/workgroups/lsb)

LSB Test Suite support the following architecture.

  • i486
  • ia64
  • ppc32
  • ppc64
  • s390
  • s390x
  • x86_64

So LSB don't support arm and mips at present time and it will add test suite to support arm and mips possibly in the future.

Test Environment

  • Image: core-image-lsb-qt3
  • Platform: x86-32(emenlow), x86-64(jasperforest), ppc(mpc8315e-rdb)
  • Version of LSB Test Suite: 4.1

result

Below table shows the result of LSB Test on different platforms. X86 result is updated in 2011-06-23. Ppc32 result is update in 2011-06-16

Test Version X86-32(emenlow) X86-64(jasperforest) ppc(mpc8315e-rdb)
Command Check v 4.1.0-1 Success Failures: 1
Library Check v 4.1.0-1 Warnings: 49 Failures: 10
Alsa-T2C Tests v 4.1.0-1 Success Test suite error
Core Tests v 4.1.0-1 Failures: 13 Failures: 66
Core-T2C Tests v 4.1.0-1 Success Success
Cpp-T2C Tests v 4.1.0-1 Success Success
Desktop Tests v 4.1.0-2 Failures: 18 Test suite error
Desktop-T2C Tests v 4.1.0-1 Failures: 3 Test suite error
Libstdc++ Tests v 4.1.0-13 Failures: 6 Failures: 2
OLVER Core Tests v 4.1.0-1 Failures: 10 Block
Perl Tests v 4.1.0-1 Failures: 1 Failures: 1
Printing Tests v 4.1.0-1 Failures: 1 Failures: 3
Python Runtime Tests v 4.1.1-2 Success Success
Qt3-Azov Tests v 4.1.0-1 Success Failures: 106
Qt4-Azov Tests v 4.1.0-1 Failures: 5 Failures: 69
Xml2-Azov Tests v 4.1.0-1 Success Success
Xts5 Tests v 5.1.5-38 Warnings: 8 Warnings: 8
Apache Tests v 2.2.14-3 Success Success
Expect Tests v 5.43.0-11 Success Success
Groff Tests v 1.20.1-5 Success Success
Raptor Tests v 1.4.19-3 Success Success
Rsync Tests v 3.0.6-3 Success Success
Samba Tests v 3.4.3-5 Success Success
Tcl Tests v 8.5.7-6 Success Success
Xpdf Tests v 1.01-10 Success Failures: 1

Analysis of result

Below table shows the failed test cases.

  • Total failures: The number of total failures after running test. It includes known problems and real failures which should be fixed.
  • Known problem: Known problem means it is a bug of LSB itself and we can find trace these bugs on http://bugs.linuxbase.org. On link page we give a summary of known problems.
  • Failures(need to fix) : Real failures we should fix them
  • Test suite error : Caused by two reasons: one is for absent library needed by test suite. one is that test suite could lose some function which should be included in it.

x86-32 (emenlow,update(2011-06-23))

  • New problem: It is a bug without arising on previous version. It could be caused by some patches updated every day.
Test Total failures Known problem Failures(need to fix) Note
Core Tests 13 13
Libstdc++ Tests 6 6
Desktop Tests 18 18
Desktop-T2C Tests 3 3
OLVER Core Tests 10 10
Perl Tests 1 1
Printing Tests 1 1
Qt4-Azov Tests 5 5

ppc(mpc8315e,update(2011-06-16))

We have the following failures(including "unresolved" and "failed") to fix.

Test Total failures Known problem Failures(need to fix) Note
Command Check 1 1 New problem,Absent command
Alsa-T2C Tests New problem,Test suite error
Core Tests 66 10 47(unresolved), 8(failed), 1(unreported)
Desktop Tests New problem, test suite error
Desktop-T2C Tests New problem, test suite error
Library Check 10 10 New problem, Absent libraries
Libstdc++ Tests 2
OLVER Core Tests Blocked
Perl Tests 1 1
Printing Tests 3 1 1(unresolved), 1(failure), 1(unreported)
Qt3-Azov 106 No enough memory
Qt4-Azov 69 5 64(unresolved)

Failures tracker(update 2011-06-23)

We should fix the following problems. We also filed bugs for them and try to fix them.

Tests Sub Tests Test Number Arch Bug ID of yocto Proposal suggestion
Desktop Tests /tests/functions/SpawnProc/SpawnProc 2nd (unresolved) 2 ppc http://bugzilla.pokylinux.org/show_bug.cgi?id=1117
Printing Tests /convenience/cupsConvenience 37th (unresolved) 37 ppc http://bugzilla.pokylinux.org/show_bug.cgi?id=1123
Library Check No library libQtOpenGL x86,x86-64,ppc http://git.pokylinux.org/cgit.cgi/poky-contrib/commit/?h=xiaofeng/opengl&id=1f612db123f367778de2a7a6fafd31b79538f075

http://git.pokylinux.org/cgit.cgi/poky-contrib/commit/?h=xiaofeng/opengl&id=f654a8321554458d47d1cab6ae1201c1f60467e3

Qt4-Azov Tests Child process timed out ppc

Known problems tracker

See details on Known problems tracker