Yocto 1.4 Milestone Test Report

From Yocto Project
Revision as of 01:32, 25 April 2013 by Corneliu Stoicescu (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

This page is to hold Milestone Test Report for Yocto 1.4

Contents

Yocto 1.4 M1 RC1 Build Test Report

Here is the weekly test report for Yocto 1.4 M1 RC1 20121128 build. The testing for p1022ds is blocked since the image didn't build out. For beagleboard, the X can’t startup in this build (Bug 3522). For Core Build System we have new issues regarding HOB under build appliance, incremental RPM and multilib with ipks (Bugs 3531, 3453, 3534). ADT toolchain fails regarding Clutter (Bugs 3477, 3488).


Test Summary:

1.4M1RC1summary.png


Test detail Summary:

1.4M1RC1detailed.png


  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20121128-1

Tree/Branch: poky/1.4_M1

Commit: 247b6a3754c2c50318e2a73d79981ba0e9cb560b


Issue Summary:

1.4M1RC1issues.png


Yocto 1.4 M1 RC2 Build Test Report

Here is the weekly test report for Yocto 1.4 M1 RC2 20121205 build.

We have anew bug for non-GPLv3 image build(3546).

Other than that, the multilib with ipk still fails for the CoreBuildSystem Weekly tests.

ADT toolchain fails with autoconf and automake (3338).


Test Summary:

1.4M1RC2summary.png


Test detail Summary:

1.4M1RC2detailed.png


  • You can check the detailed test result in attachment for each target.
  • The failed/blocked case number is listed with failed cases’ bug number.


Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20121205-3

Tree/Branch: poky/1.4_M1

Commit: 381c4b69c7e8b452f4d3de2f8214e6e5f6a9abe7


Issue Summary:

1.4M1RC2issued.png


Yocto 1.4 M2 - M3 RC1 Build Test Report

Here is the fullpass test report for Yocto 1.4 M3 RC1 20130122 build. The testing for p1022ds, FRI2, is blocked since the images didn't build out. The connmand offline mode doesn't work on qemuarm, qemuppc and qemumips images. The text can't display in GUI with qemuppc image. There is missing pam_systemd.so in images with pam support. The stress testing on beagleboard is still running. Also, there is an issue regarding crosstap script for Core Build System tests.


Test Summary:

1.4M2M3RC1summary.png


Test detail Summary:

1.4M2M3RC1detailed.png


Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20130122-2

Tree/Branch: poky/master

Commit: 8d6e55bf2192524bda84138b5356a2791adbbe61


Issue Summary:

1.4M2M3RC1issues.png


Yocto 1.4 M3 RC2 Build Test Report

Here is the fullpass test report for Yocto 1.4 M3 RC2 20130131 build. Although the image for p1022ds built out, the system can't boot up, so the testings is blocked. For other qemu and BSPs, there is no new bug found in this testing. There was a problem with qemux86 starting up, but the bug (3850) was set to invalid.


Test Summary:

1.4M3RC2summary.png


Test detail Summary:

1.4M3RC2detailed.png


Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20130131-4/

Tree/Branch: 1.4_M3

Commit: 3ae1a4ba972cfc17ff3f2fda632da8ecc3414885


Issue Summary:

1.4M3RC2issues.png


Yocto 1.4 M4 RC1 Build Test Report

Testing data

 Test type: Full Pass
 Branch: master
 Milestone: 1.4 M4
 Build name: 1.4_M4_RC1
 poky commit: 7d22ef28e64de06b6238d0ef9b664c0bee6efa46
 poky commit date: 2013-02-19
 meta-intel commit: 150be7c8fb97ac88737f6017fdf9dd47b273bb3e
 Eclipse Plugin commit: d18c45e0f5367979f7402380ee123242da2b57d5 
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130220-2/

 Distributions tested: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.1, OpenSUSE 12.2  


To get the full report click here

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
249 ADT: master branchFedora 17 i68695.7%none4.3%3338 0.0%none100.0%
237 ADT: master branchFedora 17 x86_6495.5%none4.5%3338 0.0%none100.0%
248 ADT: master branchopenSUSE 12.2 x86_6495.7%none4.3%3338 0.0%none100.0%
236 ADT: master branchUbuntu 12.04 X86_6495.5%none4.5%3338 0.0%none100.0%
252 Eclipse Plugin: master branchFedora 17 x86_6478.6%3942 21.4%3941 0.0%none100.0%
244 Meta-yocto: master branchuser-preference (any supported environment)95.0%none5.0%3908 0.0%none100.0%
241 Hob: master branchUbuntu 12.04 x86_6497.6%none2.4%2618 0.0%none100.0%
245 Build-Appliance: master branchMultiple environments25.0%none25.0%3921 50.0%3921 100.0%
273 OE-Core: master branchFedora 16 X86_6496.9%none3.1%3910 0.0%none100.0%
243 BitBake: master branchUbuntu 12.04 x86_6495.7%none4.3%3930 0.0%none100.0%
256 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 11
Test Case Status Report
StatusCount
BLOCKED2
FAILED31
PASSED576
Total: 609
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
2618MediumVERIFIEDOBSOLETE241 [Hob2] Incorrect total image size in "View Package" pageunspecified1.4 M6246
3338Medium+VERIFIEDFIXED249 237 236 248 iptables-1.4.15: autoreconf run failed on gmae-toolchain1.41.4 M5117
3908Medium+VERIFIEDFIXED244 Kernel panic on qemux86-64 when using runqemu kvm and cpu host1.41.5 M21 (Recent)
3910UndecidedVERIFIEDWORKSFORME273 [Test Case 278] Sanity check for userspace dependency1.4---2 (Recent)
3921Medium+VERIFIEDFIXED245 Hob in Build Appliance doesn't start1.41.4 M5NEW
3930Medium+RESOLVEDWORKSFORME243 [Test Case 146] Check if AUTOPR could be export/lockdown for package build.1.41.4 M5NEW
3941MediumVERIFIEDFIXED252 cannot configure and build Clutter project - glib-2.0 clutter-1.01.41.4NEW
3942MediumVERIFIEDDUPLICATE252 semantic errors appear when opening source file for a GTK project1.41.4NEW
Total: 8


Yocto 1.4 M5 RC2 Build Test Report

Testing data

 Test type: Full Pass post-release
 Branch: master
 Milestone: 1.4 M5
 Build name: 1.4 M5 RC2
 poky commit: bdca49274173153b1b0a72887de6321b4756b684
 poky commit date: Tue Mar 26 17:47:26 2013 +0000
 meta-intel commit: 2e8760d272aa2c62b41cbf768445c99569604c5e
 Eclipse Plugin commit: 5e20d3c32072ddd91dceb8b2b793ef13f25b915e
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130327-1

 Distributions tested: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.2 x86-64  


To get the full report click here

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
388 ADT: master branchFedora 17 i68630.2%none10.3%4152 4140 4131 59.5%4140 4152 4131 100.0%
369 ADT: master branchFedora 17 x86_6430.2%none10.3%4140 4152 59.5%4140 4152 100.0%
390 ADT: master branchopenSUSE 12.2 x86_6430.2%none10.3%4140 4152 4131 59.5%4140 4152 4131 100.0%
389 ADT: master branchUbuntu 12.04 X86_6430.2%none9.5%4152 4140 4131 60.3%4152 4140 4131 100.0%
372 Eclipse Plugin: master branchUbuntu 12.04 X86_6460.0%none6.7%3747 33.3%4131 4099 4165 4140 100.0%
373 Meta-yocto: master branchUbuntu 12.04 x86-6495.5%none4.5%4099 0.0%none100.0%
376 Hob: master branchUbuntu 12.04 x86_6493.8%none6.3%2618 0.0%none100.0%
367 Build-Appliance: master branchqemu-kvm on F17 libvirt25.0%none25.0%4124 50.0%4071 4124 100.0%
368 OE-Core: master branchMultiple environments87.9%none12.1%4032 3453 2918 0.0%none100.0%
366 BitBake: master branchUbuntu 12.04 x86_6495.7%none4.3%4139 0.0%none100.0%
397 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 11
Test Case Status Report
StatusCount
BLOCKED289
FAILED59
PASSED286
Total: 634
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
2618MediumVERIFIEDOBSOLETE376 [Hob2] Incorrect total image size in "View Package" pageunspecified1.4 M6282
2918Medium+RESOLVEDFIXED368 lib64-core-image-sato-sdk fails due to do_rootfs issue1.31.4 M6231
3453MediumVERIFIEDFIXED368 Build fails when building multilib with ipk packaging1.31.4131
3747MediumVERIFIEDFIXED372 an error appear when selecting kernel for yocto-bsp 1.41.41.469
4032MediumVERIFIEDFIXED368 binutils-cross_2.23.1.bb do_package_write_rpm fails1.41.412
4071Medium+VERIFIEDFIXED367 Building an image fails at quilt-native using BA for 1.4M5.rc11.41.4 M66 (Recent)
4099MediumVERIFIEDFIXED372 373 Crosstap script check fails1.41.4 M62 (Recent)
4124UndecidedVERIFIEDFIXED367 X does not start on qemu x86/x86-64 machines1.4---1 (Recent)
4131Medium+VERIFIEDFIXED388 372 389 390 error when installing the cross toolchain1.41.4 M6NEW
4139MediumVERIFIEDFIXED366 remake fails at do_configure1.41.4NEW
4140Medium+VERIFIEDFIXED389 369 388 390 372 adt-installer uses the wrong YOCTADT_REPO1.41.4 M6NEW
4152Medium+VERIFIEDFIXED369 390 388 389 Packages missing from adt-ipk repo1.41.4 M6NEW
4165MediumVERIFIEDFIXED372 cannot select Metadata Location using Browse button for systemtap tool1.41.4 M6NEW
Total: 13

Yocto 1.4 M5 RC3 Build Test Report

Testing data

 Test type: Full Pass Post-release
 Branch: master
 Milestone: 1.4 M5
 Build name: 1.4 M5 RC3
 poky commit: fe336b149552b1f4f24d979c40302653298b98cc
 poky commit date: Wed Apr 3 05:11:50 2013 +0000
 meta-intel commit: 3de2325133eb581c5c8d66133821ea5a801cf8ae
 Eclipse Plugin commit: 5e20d3c32072ddd91dceb8b2b793ef13f25b915e
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130403-2

 Environments used for testing: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.2 x86-64
 Distribution Testing was performed on: Ubuntu 12.04, Ubuntu 12.10, Fedora 17, Fedora 18, OpenSUse 12.1, OpenSuse 12.2, CentOS 6.3 


To get the full report click here

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
416 ADT: master branchFedora 17 i68671.6%none5.2%4219 23.3%4219 100.0%
403 ADT: master branchFedora 18 x86_64100.0%none0.0%none0.0%none100.0%
417 ADT: master branchopenSUSE 12.2 x86_64100.0%none0.0%none0.0%none100.0%
415 ADT: master branchUbuntu 12.04 X86_64100.0%none0.0%none0.0%none100.0%
404 Eclipse Plugin: master branchFedora 18 x86_6496.7%3747 4206 3.3%3672 0.0%none100.0%
413 Meta-yocto: master branchUbuntu 12.04 x86-6494.7%none5.3%4099 0.0%none100.0%
407 Hob: master branchUbuntu 12.04 x86_6497.2%none2.8%2618 0.0%none100.0%
411 Build-Appliance: master branchVMWare Player on Ubuntu25.0%none25.0%4203 50.0%4200 4203 100.0%
408 OE-Core: master branchMultiple environments90.9%none9.1%3453 2918 0.0%none100.0%
429 BitBake: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
418 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 11
Test Case Status Report
StatusCount
BLOCKED29
FAILED13
PASSED580
Total: 622
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
2618MediumVERIFIEDOBSOLETE407 [Hob2] Incorrect total image size in "View Package" pageunspecified1.4 M6289
2918Medium+RESOLVEDFIXED408 lib64-core-image-sato-sdk fails due to do_rootfs issue1.31.4 M6238
3453MediumVERIFIEDFIXED408 Build fails when building multilib with ipk packaging1.31.4138
3672Medium+VERIFIEDFIXED404 Adopt crosstap script for systemtap1.41.4 M390
3747MediumVERIFIEDFIXED404 an error appear when selecting kernel for yocto-bsp 1.41.41.476
4099MediumVERIFIEDFIXED413 Crosstap script check fails1.41.4 M69
4200HighRESOLVEDWORKSFORME411 Hob under Build Appliance reports that tmp/work directory is not created in build dirunspecified1.4 M6NEW
4203HighVERIFIEDFIXED411 1.4 beta build appliance fails to launch Hob automatically1.41.4 M6NEW
4206MediumVERIFIEDFIXED404 yocto-bsp "Browse" build location button does not work1.41.4NEW
4219Medium+RESOLVEDFIXED416 [Autobuilder] The adt-ipk/i686-nativesdk package index wasn't created1.41.4 M6NEW
Total: 10

Yocto 1.4 M6 RC1 Build Test Report

Testing data

 Test type: Full Pass post-release
 Branch: dylan
 Milestone: 1.4 M6
 Build name: 1.4 M6 RC1
 poky commit: dab237bc6a7679dfeaa981c14736aedc7b04ecb9
 poky commit date:  Wed Apr 10 15:15:57 2013 -0700
 poky commit(used with meta-intel): cb1941c1801276f8a098ca84aa063cc3e043e801
 meta-intel commit: dylan:94c0feea5ec4f2bc47b05f3265d5e969654b499e
 Eclipse Plugin commit: dylan:46be27bd3400419e8325d753b85a76bfb1898944
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130411-3

 Environments used for testing: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18
 Distribution Testing was performed on: Ubuntu 12.04, Ubuntu 12.10, Fedora 17, Fedora 18, OpenSUse 12.1, OpenSuse 12.2, CentOS 6.3   



To get the full report click here

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
448 ADT: master branchFedora 18 i686100.0%none0.0%none0.0%none100.0%
447 ADT: master branchUbuntu 12.10 x86_64100.0%none0.0%none0.0%none100.0%
435 Eclipse Plugin: master branchFedora 17 x86_6496.7%4272 0.0%none3.3%4270 100.0%
439 Meta-yocto: master branchUbuntu 12.04 x86-64100.0%4099 0.0%none0.0%none100.0%
441 Hob: master branchUbuntu 12.04 x86_6497.8%none2.2%2618 0.0%none100.0%
436 Build-Appliance: master branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
443 OE-Core: master branchUbuntu 12.04 X86_6492.5%4313 7.5%4314 3453 4310 0.0%none100.0%
452 BitBake: master branchUbuntu 12.04 x86_64100.0%none0.0%none0.0%none100.0%
463 Runtime: master branchMultiple Environments23.1%none7.7%none69.2%4229 100.0%
Total: 9
Test Case Status Report
StatusCount
BLOCKED10
FAILED5
PASSED393
Total: 408
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
2618MediumVERIFIEDOBSOLETE441 [Hob2] Incorrect total image size in "View Package" pageunspecified1.4 M6297
3453MediumVERIFIEDFIXED443 Build fails when building multilib with ipk packaging1.31.4146
4099MediumVERIFIEDFIXED439 Crosstap script check fails1.41.4 M617
4229Medium+VERIFIEDFIXED463 can not install image from USB1.41.4 M63 (Recent)
4270MediumVERIFIEDFIXED435 streaming stap scripts freeze Eclipse when ran from the System Tap plugin1.41.5NEW
4272UndecidedVERIFIEDINVALID435 cannot create bitbake commander project1.4---NEW
4310MediumRESOLVEDFIXED443 do_dumpdata_create_diff_gz fails for core-image-sato-qemux86-641.41.4.1NEW
4313MediumVERIFIEDFIXED443 buildhistory-diff should give coherent message with bad arguments1.41.5NEW
4314MediumRESOLVEDFIXED443 libcap do_patch fails for archive work directory and export source package with 'tar'1.41.4 M6NEW
Total: 9

Yocto 1.4 M6 RC2 Build Test Report

Testing data

 Test type: Full Pass post-release
 Branch: dylan
 Milestone: 1.4 M6 rc2
 Build name: Full Pass
 poky commit: 789b2b7e0cca404ff8ba8ed5ba823d215e6ba5b4
 poky commit date: Thu Apr 18 22:02:26 2013 +0100
 meta-intel commit: 76f70c337e5daa9593153dfdf5107aec08610a44
 Eclipse Plugin commit: dc9a609c68fe4a6bbbf34d418fd6611489c1d6f7
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130418-1/

 Environments used for testing: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.2 x86-64
 Distribution Testing was performed on: Ubuntu 12.04, Ubuntu 12.10, Fedora 17, Fedora 18, OpenSUse 12.1, OpenSuse 12.2, CentOS 6.3 



To get the full report click here

Testing Summary Report
Test RunTest PlanEnvironmentPassedOther issuesFailedFailing bugsBlockedBlocking bugsComplete
497 ADT: master branchFedora 18 i686100.0%none0.0%none0.0%none100.0%
498 ADT: master branchUbuntu 12.10 x86_64100.0%none0.0%none0.0%none100.0%
471 Eclipse Plugin: master branchFedora 17 x86_64100.0%4403 4409 0.0%none0.0%none100.0%
472 Meta-yocto: master branchUbuntu 12.04 x86-64100.0%none0.0%none0.0%none100.0%
495 Hob: master branchUbuntu 12.04 x86_6497.8%none2.2%4388 0.0%none100.0%
476 Build-Appliance: master branchVMWare Player on Ubuntu100.0%none0.0%none0.0%none100.0%
489 OE-Core: master branchMultiple environments95.2%none4.8%4314 4310 0.0%none100.0%
499 BitBake: master branchUbuntu 12.04 x86_6495.7%none4.3%4385 0.0%none100.0%
487 Runtime: master branchMultiple Environments100.0%none0.0%none0.0%none100.0%
Total: 9
Test Case Status Report
StatusCount
FAILED4
PASSED405
Total: 409
Bug Status Report
Bug Status
IDPriorityStatusResolutionTest RunsDescriptionVersionTarget MilestoneAge (days)
4310MediumRESOLVEDFIXED489 do_dumpdata_create_diff_gz fails for core-image-sato-qemux86-641.41.4.12 (Recent)
4314MediumRESOLVEDFIXED489 libcap do_patch fails for archive work directory and export source package with 'tar'1.41.4 M62 (Recent)
4385MediumVERIFIEDFIXED499 bitbake remake-native fails at do_configure1.41.5 M2NEW
4388MediumVERIFIEDFIXED495 After building an image, Hob reports the estimated image size in the "Edit Packages" screen1.41.5 M2NEW
4403LowRESOLVEDWONTFIX471 stap fails on core-image-sato x86-641.4FutureNEW
4409LowRESOLVEDFIXED471 qemu password is asked in the console when using systemtap plugin1.41.5NEW
Total: 6
Personal tools