Yocto 1.4 Milestone Test Report

This page is to hold Milestone Test Report for Yocto 1.4

Yocto 1.4 M1 RC1 Build Test Report

Here is the weekly test report for Yocto 1.4 M1 RC1 20121128 build. The testing for p1022ds is blocked since the image didn't build out. For beagleboard, the X can’t startup in this build (Bug 3522). For Core Build System we have new issues regarding HOB under build appliance, incremental RPM and multilib with ipks (Bugs 3531, 3453, 3534). ADT toolchain fails regarding Clutter (Bugs 3477, 3488).

Test Summary:

Test detail Summary:

• You can check the detailed test result in attachment for each target.
• The failed/blocked case number is listed with failed cases’ bug number.

Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20121128-1

Tree/Branch: poky/1.4_M1

Commit: 247b6a3754c2c50318e2a73d79981ba0e9cb560b

Issue Summary:

Yocto 1.4 M1 RC2 Build Test Report

Here is the weekly test report for Yocto 1.4 M1 RC2 20121205 build.

We have anew bug for non-GPLv3 image build(3546).

Other than that, the multilib with ipk still fails for the CoreBuildSystem Weekly tests.

ADT toolchain fails with autoconf and automake (3338).

Test Summary:

Test detail Summary:

• You can check the detailed test result in attachment for each target.
• The failed/blocked case number is listed with failed cases’ bug number.

Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20121205-3

Tree/Branch: poky/1.4_M1

Commit: 381c4b69c7e8b452f4d3de2f8214e6e5f6a9abe7

Issue Summary:

Yocto 1.4 M2 - M3 RC1 Build Test Report

Here is the fullpass test report for Yocto 1.4 M3 RC1 20130122 build. The testing for p1022ds, FRI2, is blocked since the images didn't build out. The connmand offline mode doesn't work on qemuarm, qemuppc and qemumips images. The text can't display in GUI with qemuppc image. There is missing pam_systemd.so in images with pam support. The stress testing on beagleboard is still running. Also, there is an issue regarding crosstap script for Core Build System tests.

Test Summary:

Test detail Summary:

Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20130122-2

Tree/Branch: poky/master

Commit: 8d6e55bf2192524bda84138b5356a2791adbbe61

Issue Summary:

Yocto 1.4 M3 RC2 Build Test Report

Here is the fullpass test report for Yocto 1.4 M3 RC2 20130131 build. Although the image for p1022ds built out, the system can't boot up, so the testings is blocked. For other qemu and BSPs, there is no new bug found in this testing. There was a problem with qemux86 starting up, but the bug (3850) was set to invalid.

Test Summary:

Test detail Summary:

Commit Information:

Location: http://autobuilder.yoctoproject.org/pub/nightly/20130131-4/

Tree/Branch: 1.4_M3

Commit: 3ae1a4ba972cfc17ff3f2fda632da8ecc3414885

Issue Summary:

Yocto 1.4 M4 RC1 Build Test Report

Testing data

 Test type: Full Pass
 Branch: master
 Milestone: 1.4 M4
 Build name: 1.4_M4_RC1
 poky commit: 7d22ef28e64de06b6238d0ef9b664c0bee6efa46
 poky commit date: 2013-02-19
 meta-intel commit: 150be7c8fb97ac88737f6017fdf9dd47b273bb3e
 Eclipse Plugin commit: d18c45e0f5367979f7402380ee123242da2b57d5 
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130220-2/

 Distributions tested: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.1, OpenSUSE 12.2  

To get the full report click here

Testing Summary Report

Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete 249 ADT: master branch Fedora 17 i686 95.7% none 4.3% 3338 0.0% none 100.0% 237 ADT: master branch Fedora 17 x86_64 95.5% none 4.5% 3338 0.0% none 100.0% 248 ADT: master branch openSUSE 12.2 x86_64 95.7% none 4.3% 3338 0.0% none 100.0% 236 ADT: master branch Ubuntu 12.04 X86_64 95.5% none 4.5% 3338 0.0% none 100.0% 252 Eclipse-Plugin: master branch Fedora 17 x86_64 78.6% 3942 21.4% 3941 0.0% none 100.0% 244 Meta-yocto: master branch user-preference (any supported environment) 95.0% none 5.0% 3908 0.0% none 100.0% 241 Hob: master branch Ubuntu 12.04 x86_64 97.6% none 2.4% 2618 0.0% none 100.0% 245 Build-Appliance: master branch Multiple environments 25.0% none 25.0% 3921 50.0% 3921 100.0% 273 OE-Core: master branch Fedora 16 X86_64 96.9% none 3.1% 3910 0.0% none 100.0% 243 BitBake: master branch Ubuntu 12.04 x86_64 95.7% none 4.3% 3930 0.0% none 100.0% 256 Runtime: master branch Multiple Environments 100.0% none 0.0% none 0.0% none 100.0% Total: 11

Test Case Status Report
Status Count BLOCKED 2 FAILED 31 PASSED 576 Total: 609

Bug Status Report
ID Priority Status Resolution Test Runs Description Version Target Milestone Age (days) 2618 Medium VERIFIED OBSOLETE 241 [Hob2] Incorrect total image size in "View Package" page unspecified 1.4 M6 246 3338 Medium+ VERIFIED FIXED 248 236 237 249 iptables-1.4.15: autoreconf run failed on gmae-toolchain 1.4 1.4 M5 117 3908 Medium+ VERIFIED FIXED 244 Kernel panic on qemux86-64 when using runqemu kvm and cpu host 1.4 1.5 M2 1 (Recent) 3910 Undecided VERIFIED WORKSFORME 273 [Test Case 278] Sanity check for userspace dependency 1.4 --- 2 (Recent) 3921 Medium+ VERIFIED FIXED 245 Hob in Build Appliance doesn't start 1.4 1.4 M5 NEW 3930 Medium+ RESOLVED WORKSFORME 243 [Test Case 146] Check if AUTOPR could be export/lockdown for package build. 1.4 1.4 M5 NEW 3941 Medium VERIFIED FIXED 252 cannot configure and build Clutter project - glib-2.0 clutter-1.0 1.4 1.4 NEW 3942 Medium VERIFIED DUPLICATE 252 semantic errors appear when opening source file for a GTK project 1.4 1.4 NEW Total: 8

Yocto 1.4 M5 RC2 Build Test Report

Testing data

 Test type: Full Pass post-release
 Branch: master
 Milestone: 1.4 M5
 Build name: 1.4 M5 RC2
 poky commit: bdca49274173153b1b0a72887de6321b4756b684
 poky commit date: Tue Mar 26 17:47:26 2013 +0000
 meta-intel commit: 2e8760d272aa2c62b41cbf768445c99569604c5e
 Eclipse Plugin commit: 5e20d3c32072ddd91dceb8b2b793ef13f25b915e
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130327-1

 Distributions tested: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.2 x86-64  

To get the full report click here

Testing Summary Report

Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete 388 ADT: master branch Fedora 17 i686 30.2% none 10.3% 4152 4140 4131 59.5% 4140 4152 4131 100.0% 369 ADT: master branch Fedora 17 x86_64 30.2% none 10.3% 4140 4152 59.5% 4140 4152 100.0% 390 ADT: master branch openSUSE 12.2 x86_64 30.2% none 10.3% 4140 4152 4131 59.5% 4140 4152 4131 100.0% 389 ADT: master branch Ubuntu 12.04 X86_64 30.2% none 9.5% 4152 4140 4131 60.3% 4152 4140 4131 100.0% 372 Eclipse-Plugin: master branch Ubuntu 12.04 X86_64 60.0% none 6.7% 3747 33.3% 4131 4099 4165 4140 100.0% 373 Meta-yocto: master branch Ubuntu 12.04 x86-64 95.5% none 4.5% 4099 0.0% none 100.0% 376 Hob: master branch Ubuntu 12.04 x86_64 93.8% none 6.3% 2618 0.0% none 100.0% 367 Build-Appliance: master branch qemu-kvm on F17 libvirt 25.0% none 25.0% 4124 50.0% 4071 4124 100.0% 368 OE-Core: master branch Multiple environments 87.9% none 12.1% 4032 3453 2918 0.0% none 100.0% 366 BitBake: master branch Ubuntu 12.04 x86_64 95.7% none 4.3% 4139 0.0% none 100.0% 397 Runtime: master branch Multiple Environments 100.0% none 0.0% none 0.0% none 100.0% Total: 11

Test Case Status Report
Status Count BLOCKED 289 FAILED 59 PASSED 286 Total: 634

Bug Status Report
ID Priority Status Resolution Test Runs Description Version Target Milestone Age (days) 2618 Medium VERIFIED OBSOLETE 376 [Hob2] Incorrect total image size in "View Package" page unspecified 1.4 M6 282 2918 Medium+ RESOLVED FIXED 368 lib64-core-image-sato-sdk fails due to do_rootfs issue 1.3 1.4 M6 231 3453 Medium VERIFIED FIXED 368 Build fails when building multilib with ipk packaging 1.3 1.4 131 3747 Medium VERIFIED FIXED 372 an error appear when selecting kernel for yocto-bsp 1.4 1.4 1.4 69 4032 Medium VERIFIED FIXED 368 binutils-cross_2.23.1.bb do_package_write_rpm fails 1.4 1.4 12 4071 Medium+ VERIFIED FIXED 367 Building an image fails at quilt-native using BA for 1.4M5.rc1 1.4 1.4 M6 6 (Recent) 4099 Medium VERIFIED FIXED 373 372 Crosstap script check fails 1.4 1.4 M6 2 (Recent) 4124 Undecided VERIFIED FIXED 367 X does not start on qemu x86/x86-64 machines 1.4 --- 1 (Recent) 4131 Medium+ VERIFIED FIXED 389 388 390 372 error when installing the cross toolchain 1.4 1.4 M6 NEW 4139 Medium VERIFIED FIXED 366 remake fails at do_configure 1.4 1.4 NEW 4140 Medium+ VERIFIED FIXED 388 389 390 369 372 adt-installer uses the wrong YOCTADT_REPO 1.4 1.4 M6 NEW 4152 Medium+ VERIFIED FIXED 369 388 390 389 Packages missing from adt-ipk repo 1.4 1.4 M6 NEW 4165 Medium VERIFIED FIXED 372 cannot select Metadata Location using Browse button for systemtap tool 1.4 1.4 M6 NEW Total: 13

Yocto 1.4 M5 RC3 Build Test Report

Testing data

 Test type: Full Pass Post-release
 Branch: master
 Milestone: 1.4 M5
 Build name: 1.4 M5 RC3
 poky commit: fe336b149552b1f4f24d979c40302653298b98cc
 poky commit date: Wed Apr 3 05:11:50 2013 +0000
 meta-intel commit: 3de2325133eb581c5c8d66133821ea5a801cf8ae
 Eclipse Plugin commit: 5e20d3c32072ddd91dceb8b2b793ef13f25b915e
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130403-2

 Environments used for testing: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.2 x86-64
 Distribution Testing was performed on: Ubuntu 12.04, Ubuntu 12.10, Fedora 17, Fedora 18, OpenSUse 12.1, OpenSuse 12.2, CentOS 6.3 

To get the full report click here

Testing Summary Report

Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete 416 ADT: master branch Fedora 17 i686 71.6% none 5.2% 4219 23.3% 4219 100.0% 403 ADT: master branch Fedora 18 x86_64 100.0% none 0.0% none 0.0% none 100.0% 417 ADT: master branch openSUSE 12.2 x86_64 100.0% none 0.0% none 0.0% none 100.0% 415 ADT: master branch Ubuntu 12.04 X86_64 100.0% none 0.0% none 0.0% none 100.0% 404 Eclipse-Plugin: master branch Fedora 18 x86_64 96.7% 3747 4206 3.3% 3672 0.0% none 100.0% 413 Meta-yocto: master branch Ubuntu 12.04 x86-64 94.7% none 5.3% 4099 0.0% none 100.0% 407 Hob: master branch Ubuntu 12.04 x86_64 97.2% none 2.8% 2618 0.0% none 100.0% 411 Build-Appliance: master branch VMWare Player on Ubuntu 25.0% none 25.0% 4203 50.0% 4200 4203 100.0% 408 OE-Core: master branch Multiple environments 90.9% none 9.1% 3453 2918 0.0% none 100.0% 429 BitBake: master branch Multiple Environments 100.0% none 0.0% none 0.0% none 100.0% 418 Runtime: master branch Multiple Environments 100.0% none 0.0% none 0.0% none 100.0% Total: 11

Test Case Status Report
Status Count BLOCKED 29 FAILED 13 PASSED 580 Total: 622

Bug Status Report
ID Priority Status Resolution Test Runs Description Version Target Milestone Age (days) 2618 Medium VERIFIED OBSOLETE 407 [Hob2] Incorrect total image size in "View Package" page unspecified 1.4 M6 289 2918 Medium+ RESOLVED FIXED 408 lib64-core-image-sato-sdk fails due to do_rootfs issue 1.3 1.4 M6 238 3453 Medium VERIFIED FIXED 408 Build fails when building multilib with ipk packaging 1.3 1.4 138 3672 Medium+ VERIFIED FIXED 404 Adopt crosstap script for systemtap 1.4 1.4 M3 90 3747 Medium VERIFIED FIXED 404 an error appear when selecting kernel for yocto-bsp 1.4 1.4 1.4 76 4099 Medium VERIFIED FIXED 413 Crosstap script check fails 1.4 1.4 M6 9 4200 High RESOLVED WORKSFORME 411 Hob under Build Appliance reports that tmp/work directory is not created in build dir unspecified 1.4 M6 NEW 4203 High VERIFIED FIXED 411 1.4 beta build appliance fails to launch Hob automatically 1.4 1.4 M6 NEW 4206 Medium VERIFIED FIXED 404 yocto-bsp "Browse" build location button does not work 1.4 1.4 NEW 4219 Medium+ RESOLVED FIXED 416 [Autobuilder] The adt-ipk/i686-nativesdk package index wasn't created 1.4 1.4 M6 NEW Total: 10

Yocto 1.4 M6 RC1 Build Test Report

Testing data

 Test type: Full Pass post-release
 Branch: dylan
 Milestone: 1.4 M6
 Build name: 1.4 M6 RC1
 poky commit: dab237bc6a7679dfeaa981c14736aedc7b04ecb9
 poky commit date:  Wed Apr 10 15:15:57 2013 -0700
 poky commit(used with meta-intel): cb1941c1801276f8a098ca84aa063cc3e043e801
 meta-intel commit: dylan:94c0feea5ec4f2bc47b05f3265d5e969654b499e
 Eclipse Plugin commit: dylan:46be27bd3400419e8325d753b85a76bfb1898944
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130411-3

 Environments used for testing: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18
 Distribution Testing was performed on: Ubuntu 12.04, Ubuntu 12.10, Fedora 17, Fedora 18, OpenSUse 12.1, OpenSuse 12.2, CentOS 6.3   

To get the full report click here

Testing Summary Report Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete 448 ADT: master branch Fedora 18 i686 100.0% none 0.0% none 0.0% none 100.0% 447 ADT: master branch Ubuntu 12.10 x86_64 100.0% none 0.0% none 0.0% none 100.0% 435 Eclipse-Plugin: master branch Fedora 17 x86_64 96.7% 4272 0.0% none 3.3% 4270 100.0% 439 Meta-yocto: master branch Ubuntu 12.04 x86-64 100.0% 4099 0.0% none 0.0% none 100.0% 441 Hob: master branch Ubuntu 12.04 x86_64 97.8% none 2.2% 2618 0.0% none 100.0% 436 Build-Appliance: master branch VMWare Player on Ubuntu 100.0% none 0.0% none 0.0% none 100.0% 443 OE-Core: master branch Ubuntu 12.04 X86_64 92.5% 4313 7.5% 4314 3453 4310 0.0% none 100.0% 452 BitBake: master branch Ubuntu 12.04 x86_64 100.0% none 0.0% none 0.0% none 100.0% 463 Runtime: master branch Multiple Environments 23.1% none 7.7% none 69.2% 4229 100.0% Total: 9

Test Case Status Report Status Count BLOCKED 10 FAILED 5 PASSED 393 Total: 408

Bug Status Report
ID Priority Status Resolution Test Runs Description Version Target Milestone Age (days) 2618 Medium VERIFIED OBSOLETE 441 [Hob2] Incorrect total image size in "View Package" page unspecified 1.4 M6 297 3453 Medium VERIFIED FIXED 443 Build fails when building multilib with ipk packaging 1.3 1.4 146 4099 Medium VERIFIED FIXED 439 Crosstap script check fails 1.4 1.4 M6 17 4229 Medium+ VERIFIED FIXED 463 can not install image from USB 1.4 1.4 M6 3 (Recent) 4270 Medium VERIFIED FIXED 435 streaming stap scripts freeze Eclipse when ran from the System Tap plugin 1.4 1.5 NEW 4272 Undecided VERIFIED INVALID 435 cannot create bitbake commander project 1.4 --- NEW 4310 Medium RESOLVED FIXED 443 do_dumpdata_create_diff_gz fails for core-image-sato-qemux86-64 1.4 1.4.1 NEW 4313 Medium VERIFIED FIXED 443 buildhistory-diff should give coherent message with bad arguments 1.4 1.5 NEW 4314 Medium RESOLVED FIXED 443 libcap do_patch fails for archive work directory and export source package with 'tar' 1.4 1.4 M6 NEW Total: 9

Yocto 1.4 M6 RC2 Build Test Report

Testing data

 Test type: Full Pass post-release
 Branch: dylan
 Milestone: 1.4 M6 rc2
 Build name: Full Pass
 poky commit: 789b2b7e0cca404ff8ba8ed5ba823d215e6ba5b4
 poky commit date: Thu Apr 18 22:02:26 2013 +0100
 meta-intel commit: 76f70c337e5daa9593153dfdf5107aec08610a44
 Eclipse Plugin commit: dc9a609c68fe4a6bbbf34d418fd6611489c1d6f7
 Autobuilder images repository: http://autobuilder.yoctoproject.org/pub/nightly/20130418-1/

 Environments used for testing: Ubuntu 12.04 x86-64, Ubuntu 12.10 x86-64, Fedora 17, Fedora 18, OpenSUSE 12.2 x86-64
 Distribution Testing was performed on: Ubuntu 12.04, Ubuntu 12.10, Fedora 17, Fedora 18, OpenSUse 12.1, OpenSuse 12.2, CentOS 6.3 

To get the full report click here

Testing Summary Report Test Run Test Plan Environment Passed Other issues Failed Failing bugs Blocked Blocking bugs Complete 497 ADT: master branch Fedora 18 i686 100.0% none 0.0% none 0.0% none 100.0% 498 ADT: master branch Ubuntu 12.10 x86_64 100.0% none 0.0% none 0.0% none 100.0% 471 Eclipse-Plugin: master branch Fedora 17 x86_64 100.0% 4403 4409 0.0% none 0.0% none 100.0% 472 Meta-yocto: master branch Ubuntu 12.04 x86-64 100.0% none 0.0% none 0.0% none 100.0% 495 Hob: master branch Ubuntu 12.04 x86_64 97.8% none 2.2% 4388 0.0% none 100.0% 476 Build-Appliance: master branch VMWare Player on Ubuntu 100.0% none 0.0% none 0.0% none 100.0% 489 OE-Core: master branch Multiple environments 95.2% none 4.8% 4314 4310 0.0% none 100.0% 499 BitBake: master branch Ubuntu 12.04 x86_64 95.7% none 4.3% 4385 0.0% none 100.0% 487 Runtime: master branch Multiple Environments 100.0% none 0.0% none 0.0% none 100.0% Total: 9

Test Case Status Report Status Count FAILED 4 PASSED 405 Total: 409

Bug Status Report
ID Priority Status Resolution Test Runs Description Version Target Milestone Age (days) 4310 Medium RESOLVED FIXED 489 do_dumpdata_create_diff_gz fails for core-image-sato-qemux86-64 1.4 1.4.1 2 (Recent) 4314 Medium RESOLVED FIXED 489 libcap do_patch fails for archive work directory and export source package with 'tar' 1.4 1.4 M6 2 (Recent) 4385 Medium VERIFIED FIXED 499 bitbake remake-native fails at do_configure 1.4 1.5 M2 NEW 4388 Medium VERIFIED FIXED 495 After building an image, Hob reports the estimated image size in the "Edit Packages" screen 1.4 1.5 M2 NEW 4403 Low RESOLVED WONTFIX 471 stap fails on core-image-sato x86-64 1.4 Future NEW 4409 Low RESOLVED FIXED 471 qemu password is asked in the console when using systemtap plugin 1.4 1.5 NEW Total: 6