Yocto 1.1 Milestone Test Report

From Yocto Project
Revision as of 17:58, 16 October 2011 by Wenhua.fan (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

This page is to hold Milestone Test Report for Yocto 1.1

Contents

Yocto 1.1 M4 RC4 Fullpass Test Report

pdf format test report could be found @ File:Fullpass Test Report for Yocto 1.1 M4 RC4 - 20111008.pdf

This is the fullpass test report for Yocto 1.1 M4 RC4 build. There is no new bug found except for the 4 bugs found in weekly testing. There is no open major bugs for 1.1 now. Basic functions of all components, including hob and multilib, could work well. There is no distribution specific issue found against N+1 distros for Fedora, Opensuse and Ubuntu. Texinfo build could not pass, which blocks world build for all distributions. QA verified the new emenlow image from autobuilder, and the glx commands segfault issue is fixed in this build. LTP testing on Sugarbay and Blacksand is still on-going, which will be finished next Monday. Note: for difference image build against difference commit/branch, please refer to ‘commit information’ section for detail information. The test report is archived @ https://wiki.pokylinux.org/wiki/Yocto_1.1_Milestone_Test_Report


Test Summary

Fullpass Yocto1.1 M4 RC4 Test Result Summary.png

Fullpass Yocto1.1 M4 RC4 Detailed Test Result.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

For Blacksand/Crownbay/Sugarbay/Jasperforest/Qemux86/toolchain:

Tree/Branch: Poky/Edison
Commit id: bc885cd8d343ad003391222429222526dba175ad
Meta branch: Edison
Commit id: fd7eee18e38ae45efaa299f015aedd4dc3257e6d

For eMenlow:

Tree/Branch: Poky/Edison
Commit id: 5ed59ae0f25bf673d514df2371da7e0415b62bb2
Meta branch: Edison
Commit id: c3e12aa981e97261093abee05bb0301c35f54c23

For QemuArm/QemuMips/QemuPPC/Beagleboard/Routerstationpro/Mpc8315e-rdb/toolchain:

Tree/Branch: poky/edison
Poky Commit: e02d553b45808b788c721c0722379d6b37c0b7d8


Issue Summary:

Fullpass Yocto1.1 M4 RC4 Issue Summary.png


Verified Fixed Bug:

1. Bug 1444 - There is no emgd driver when build Crownbay images.

Yocto 1.1 M4 RC2 Fullpass Test Report

pdf format test report could be found @ File:Fullpass Test Report for Yocto 1.1 M4 RC2 - 20110914.pdf

This is the fullpass test report for Yocto 1.1 M4 RC2 build. There are 7 new bugs found in this testing. Sugarbay testing is blocked due to sato-sdk image not copied to sharing folder on autobuilder. Most multilib function could not work. non-GPLv3 build reports error when building core-image-basic. Basic functions of hob work well, except for the issues that 2nd build could not work after force stop 1st build and non-GPLv3 de-selection not work issue. x32 build could not work, meanwhile Nitin has fixed the issue in latest commit. Xorg eats lots of CPU’s resource issue still exists on crownbay. Both Crashme/Helltest testing on Jasperforest and LTP testing on Beagleboard could pass 24 hours stress testing. Note: for different image they are against different commit/branch information, you can refer to ‘Commit information’ section for detail information.


Test Summary

Fullpass Yocto1.1 M4 RC2 Test Result Summary.png

Fullpass Yocto1.1 M4 RC2 Detailed Test Result.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

For Qemux86/Qemux86-64:

Tree/Branch: Poky-contrib/Master_under_test
Commit id: 0e9784d26df51bd564b8f23bd40a6c36969abd5c
Meta Branch: Master-under_test
Commit id: 6e19ec6948f012b588016842d991b336dc848163

For eMenlow/Crownbay/Sugarbay:

Tree/Branch: Poky/1.1_M4
Commit id: bb4a5c44da23a1bb363f1f081cf1644fd7975957
Meta Branch: 1.1_M4
Commit id: 49277afd9e5e510f7b1f82fd8cd10732e3bf2633

For Blacksand/Jasperforest:

Tree/Branch: Poky/Master
Commit id: 92518c5017945d29099b029a7c2bf80261287d6e
Meta Branch: Master
Commit id: 49277afd9e5e510f7b1f82fd8cd10732e3bf2633


For QemuArm/QemuMips/QemuPPC/Beagleboard/Routerstationpro/Mpc8315-rdb:

Tree/Branch: poky-contrib/rc2
Poky Commit: 6e19ec6948f012b588016842d991b336dc848163


Issue Summary:

Fullpass Yocto1.1 M4 RC2 Issue Summary.png


Verified Fixed Bug:

1. Bug 1444 - There is no emgd driver when build Crownbay images.


Yocto 1.1 M4 RC1 Fullpass Test Report

pdf format test report could be found @ File:Fullpass Test Report for Yocto 1.1 M4 RC1 - 20110909.pdf

This is the weekly test report for M4 RC1 build. Three new bugs were found. The iptables-1.4.11 compiled error with arm and powerpc toolchain. All intel BSP and Qemux86-64 images didn’t built out which cause the test blocked. Rpm/zypper install/remove resume lots of space issue still exist. No icon on X desktop with sato-image issue exist also. For hob, deselected non-GPLv3 option not work. Couldn’t trigger another build after force stop a build. For fixing bug, kernel panic when booting poky-image-sdk-qemuppc by UNFS fixed. Qemuppc first boot need more than four minutes issue fixed also. Apmd complains about lack of APM support in kernel on Beagleboard fixed. lttng-ust do_compile failed on autobuilder for beagleboard fixed. Gcc-crosssdk-intermediate and gcc-runtime build failed on autobuilder for all toolchain fixed in current build. Hob test base latest master, the information please refer to “Commit information” section.


Test Summary

Fullpass Yocto1.1 M4 RC1 Test Result Summary.png

Fullpass Yocto1.1 M4 RC1 Detailed Test Result.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

Hob:

Tree/Branch: Poky/Master
Commit id: ce66e2c6bd117d1a40b547b10b376524f9276d16

Other:

Tree/Branch: Poky-contrib /Master_under_test
Commit id: 45416a04123a46ce0a35c6b9286bf53f2f8ce257
Meta Branch: Master_under_test
Commit id: 5fa508a717da07ef7352e4ac385ac276156aedec


Issue Summary:

Fullpass Yocto1.1 M4 RC1 Issue Summary.png


Verified Fixed Bug:

1. Bug 414 - [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS
2. Bug 618 - [qemuppc] qemuppc first time booting needs more than 4 minutes
3. Bug 916 - beagleboard: apmd complains about lack of APM support in kernel
4. Bug 1381 - lttng-ust do_compile failed on autobuilder for beagleboard with 20110817 build
5. Bug 1382 - gcc-crosssdk-intermediate and gcc-runtime build failed on autobuilder for all toolchain with 20110817 build
6. Bug 1479 - [HOB] deselect non-GPLv3 option not work
7. Bug 1480 - [HOB] Could not trigger another build after stop build


Yocto 1.1 M3 RC3 Fullpass Test Report

pdf format test report could be found @ File:Fullpass Test Report for Yocto 1.1 M3 RC3 - 20110806.pdf

Hi All,This is the Fullpass test report for Yocto1.1 M3 RC3 build. There are three new bugs found in this testing compared with weekly testing. Hob and some core build feature tests are added. Yocto build failed on Fedora 15, but there has been a fixing patch for it. Lib32 build failed when kernel build error with 32bit mode. Lib64 build failed with gcc-cross-intermediate error. Bitbake-layers could work well.
For hob, images as well as toolchains build could work now. Non-GPLv3 and other options in Preferences could work also. There remains 18 open bugs for hob now. The major issue is that package dependency and reload are not correctly set, which cause bug 1281, 1364 and 1359 -- packages not reload correctly when changing Machine type, image do_rootfs build fail with packages deselected against base image, package number is not consistent with user customized bb file. And user has to exit hob to restart a new build each time.
Helltest and Crashme could pass 24 hours testing on Jasperforest. Crashme could pass 24 hours testing on Beagleboard also. But LTP stress is running on Beagleboard. Idle power consumption of sugarbay and crownbay are 34.26W and 23.30W respectively.
Note:For different images, they are built against different commit/branch on autobuilder. You can refer to “Commit Information” section for detailed information.
Hob and Multilib are tested against latest master, instead of M3 branch, since there are some fixing patches not in M3 currently.


Test Summary

Fullpass Yocto1.1 M3 RC3 Test Result Summary.png

Fullpass Yocto1.1 M3 RC3 Detailed Test Result.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

For Blacksand/Crownbay/Sugarbay/Jasperforest/Qemuarm/mips/ppc/beagleboard/mpc8315e-rdb/routerstationpro:

Tree/Branch: Poky/1.1_M3
Poky Commit id: abdec68876ac7ce1a6d5c223d1757b7e8a14b85f
Meta Branch 1.1_M3
Meta Commit id: da93dc24fd73079b4dbb6811b83e44a2036d54ef

For Emenlow:

Tree/Branch: Poky/1.1_M3
Poky Commit id: abdec68876ac7ce1a6d5c223d1757b7e8a14b85f
Meta Branch 1.1_M3
Meta Commit id: 09e70dff36a1c204f76fe07c08a4f37f526728fe

For Toolchain/Qemux86/Qemux86-64:

Tree/Branch: Poky/1.1_M3
Poky Commit id: 1580d1624647bc07ffd4997b6c8cfbccd8040fc5


Issue Summary:

Fullpass Yocto1.1 M3 RC3 Issue Summary.png


Verified Fixed Bug:

1. Bug 1211 - [Blacksand] Psplash failed when boot up Yocto
2. Bug 1257 - [crownbay] broken grub due to wrong root path
3. Bug 1317 - [Qemux86-64]sato and sato-sdk images boot failed
4. Bug 1318 - [Toolchain] wrong path to ld.so for x86_64 toolchain
5. Bug 1351 - [emenlow] hdd image not found
6. Bug 1314 - toolchain do_populate_sdk failed on autobuilder for arm/mips/ppc with 20110730 build


Yocto 1.1 M3 RC1 Fullpass Test Report

pdf format test report could be found @ File:Fullpass Test Report for Yocto 1.1 M3 RC1 - 20110730.pdf

Hi All, This is weekly test report for Yocto1.1 M3 RC1 build. There are four new bugs found. All images for Intel BSP not build out. Qemuarm and beagleboard images build failed on autobuilder. Arm/mips/ppc toolchain build failed also. Both sato and sato-sdk images for Qemux86-64 boot failed. Wrong path to ld.so for x86_64 toolchain. The rpm/zypper install/removal consume disk space issue still exists. Install/Remove Software issue exist also. For bug fixing, IPC issue on routerstationpro fixed.


Test Summary

Fullpass Yocto 1.1 M3 RC1 Test Result Summary.png

Fullpass Yocto 1.1 M3 RC1 Detailed Test Result.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

Tree/Branch: Poky-contrib/master_under_test

Poky Commit id: 2f3994545e757efc575341f2b984a62a0a3441fd


Issue Summary:

Fullpass Yocto 1.1 M3 RC1 Issue Summary.png


Verified Fixed Bug:

1.[Bug 1161] [LTP] All IPC related cases failed with Yocto 1.1 M1 build on routerstationpro


Yocto 1.1 M2 RC3 Fullpass Test Report

pdf format test report could be found @ File:Fullpass Test Report for Yocto 1.1 M2 RC3 - 20110717.pdf

Hi all, This is the Fullpass test report for Yocto1.1 M2 RC3 build. QA does not find other new issues, compared with RC3 weekly test result – Crownbay has 2 issues on grub and Xorg separately. We add two stress testing for Beagleboard. Helltest and Crashme could pass 24 hours testing on Jasperforest. Crashme could pass 24 hours testing on Beagleboard also. Idle power consumption of sugarbay and crownbay are 37.50W and 23.96W respectively. Gettext-native build issue on opensuse11.4 still exists but Saul already has a patch to fix the issue. For performance testing, sugarbay and crownbay have no regression compared with M1 result. Core build testing shows 109 minutes for a qemux86 core-image-sato build on a Core i7 860 machine.


Test Summary

Fullpass Yocto 1.1 M2 RC3 Test Result Summary.png

Fullpass Yocto 1.1 M2 RC3 Detailed Test Result.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

For Emenlow/Blacksand/Crownbay/Sugarbay/Jasperforest:

Tree/Branch: Poky/1.1_M2
Poky Commit id: fa4bcfdb73167f8159b88e5a4d711c0d37627a70
Meta Branch: 1.1_M2
Meta Commit id: 738d2bc6d1a0d7ff6589000893c1c8b4f983d76f

For Toolchain/Qemux86/Qemux86-64:

Tree/Branch: Poky/1.1_M2
Poky Commit id: 93a2ca70482f09e93469481936302e7b6847156e
Meta Branch: 1.1_M2
Meta commit id:1a6bcb62666b0fc67a66bd38a1c3f2a3399a249f

For qemuarm/mips/ppc/beagleboard/mpc8315e-rdb/routerstationpro:

Tree/Branch: Poky/1.1_M2
Poky Commit: 93a2ca70482f09e93469481936302e7b6847156e


Issue Summary:

Fullpass Yocto 1.1 M2 RC3 Issue Summary.png


Yocto 1.1 M2 RC2 Weekly Test Report

pdf format test report could be found @ File:Weekly Test Report for Yocto 1.1 M2 RC2 - 20110708.pdf

Hi, All, This is the weekly test report for Yocto 1.1 M2 RC2 20110708 build. Since all lsb build failed on autobuilder, jasperforest testing is performed against sato-sdk. There are 5 new bugs found in this testing. All compile testing is blocked due to gcc/g++ could not work with a .so file missing. 3D testing is blocked on sugarbay because of a eglic bug. glxinfo and glxgears commands are found not work on emenlow. ldd on x86_64 platform could not work due to wrong path for ld.so. For other open bug, the X server start up failure issue still exists on crownbay. We have updated bug 1211, which is for psplash instead of X server. The rpm/zypper install/removal consume disk space issue still exists. For bug fixing, the 2 installation issues have been fixed. Bash missing issue is fixed also. cvs configure issue is fixed for mips toolchain Note:For different images, they are built against different commit/branch on autobuilder. You can refer to “Commit Information” section for detailed information. The test report is archived @ https://wiki.pokylinux.org/wiki/Yocto_1.1_Milestone_Test_Report


Test Summary

Yocto 1.1 M2 RC2 Test Result Summary.png

Yocto 1.1 M2 RC2 Detailed Test Result.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

For Emenlow/Blacksand/Crownbay/Sugarbay/Toolchain/Qemex86/Qemux86-64

Tree/Branch: Poky/1.1_M2

Poky Commit id: 8df2a558b4d61778a669705b867969abe3514846

Meta Branch : 1.1_M2

Meta Commit id : 92fc07a5f1b98779806cdcc2341487ff5ea5a238

For qemuarm/mips/ppc/beagleboard/mpc8315e-rdb/routerstationpro:

Tree/Branch: Poky/1.1_M2

Poky Commit id: 9f4eaeef33da5595748253d59d95c7ca548e28fa


Issue Summary:

Yocto 1.1 M2 RC2 Issue Summary.png


Verified Fixed Bug:

1. Bug 1099 - [blacksand/emenlow/crownbay] grub install failed with sato-sdk live image

2. Bug 1171 - No enough disk space with qemu sato images

3. Bug 1195 - [mips toolchain] cvs configure fail with no cvs_cv_func_printf_ptr set

4. Bug 1199 - qemuppc lsb-sdk rootfs image build failed on autobuilder in nightly build 20110625-1

5. Bug 1205 - [blacksand/emenlow/crownbay] Format swap partition failed when install

6. Bug 1214 - [Emenlow/Blacksand/Crownbay/Sugarbay] No bash exist in sato-sdk image


Yocto 1.1 M2 RC1 Weekly Test Report

pdf format test report could be found @ File:Weekly Test Report for Yocto 1.1 M2 RC1 - 20110701.pdf

Hi, All, This is the weekly test report for Yocto 1.1 M2 RC1 build. There are 2 new BLOCK bugs and 1 new NORMAL bug found in this testing. All BSP sato-sdk images have no bash built-in, which makes some bash based command not work. X server fails to start up on crownbay emgd and blacksand. And we find basic image build for qemux86 fails due to lack of locale-base-en-us. For old bugs, qemumips and qemuppc lsb images build still failed on autobuilder. mkswap issue during installation fixing patch has not been included in this build. The rpm/zypper install/removal consume disk space issue also exists.

For bug fixing, login.defs issue and no libXinerama.so for sudoku issue on jasperforest have been fixed.

Note: For different images, they are built against different commit/branch on autobuilder. So pls. check following “Commit Information” section for detailed information. The test report is archieved @ https://wiki.pokylinux.org/wiki/Yocto_1.1_Milestone_Test_Report

Test Summary

Yocto 1.1 M2 RC1 Test Result Summary.JPG

Yocto 1.1 M2 RC1 Detailed Test Result.JPG

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

For Emenlow/Blacksand/Crownbay/toolchain:

Tree/Branch : Poky/master

Poky Commit id : ad2363278f0ea86fcf3464f8f6073d3a3d06be63

Meta Branch : master

Meta Commit id: 92fc07a5f1b98779806cdcc2341487ff5ea5a238


For Sugarbay/Jasperforest/qemux86/qemux86-64:

Tree/Branch : Poky/1.1_M2

Poky Commit id : ea518846b889a1bad2263d1cb49cb238a295a8e7

Meta Branch : master

Meta Commit id: 92fc07a5f1b98779806cdcc2341487ff5ea5a238


For qemuarm/mips/ppc/beagleboard/mpc8315e-rdb/routerstationpro:

Tree/Branch : Poky/master

Poky Commit id : 8511d1ec1bac699c742952e6fe4c306e1aaa2f9f


Issue Summary:

Yocto 1.1 M2 RC1 Issue Summary.JPG


Yocto 1.1 M1 RC2 Fullpass Test Report

pdf format test report could be found @ File:Fullpass Test Report for Yocto 1.1 M1 RC2 - 20110528l.pdf

This is the fullpass test report for Yocto 1.1 M1 RC2 build. There are 3 new bugs found in this testing compared with weekly testing. Non-GPLv3 build could not work and one new LTP failure found with new kernel. The 2 BLOCK issues on have been addressed and a new build is ready for QA testing. Except for LTP and POSIX failures, there are 13 open bugs for RC2 build. Grub installation fails on 3 intel BSPs. Graphics testing on sugarbay is blocked because there are no mesa-demos and libSDL.so installed.

Helltest and Crashme could pass 24 hours testing on Jasperforest. Idle power consumption of sugarbay and crownbay are 40.12W and 18.72W respectively. LTP and POSIX testing is finished but the result analysis is still on-going.

Test Summary:

Yocto 1.1 M1 RC2 Test Result Summary1.png

Yocto 1.1 M1 RC2 Detailed Test Result1.png

  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

Tree/Branch: Poky/1.1_M1

Poky Commit: 4ff7af11ef69849ef9c16f585eae58ac920b222b

Meta Branch: 1.1_M1

Meta Commit: fc719f0cd6530ce15148b4aa274f1644b461b298


Beagbleboard base on another commit

Beagleboard Commit Information:

Tree/Branch: Poky/1.1_M1

Poky Commit: b4a215bd94cf1508782e49b1a3f8c6b1f7effbb9


Issue Summary:

Yocto 1.1 M1 RC2 Issue Summary1.png

Personal tools