Yocto Project v1.0 Release Criteria

From Yocto Project
Revision as of 13:57, 15 March 2011 by Jnfleisc (talk | contribs) (added ADT test status)
Jump to navigationJump to search

Yocto v1.0 Release Criteria

Release Criteria
Release Criteria Target Status
Functional Completion M4 (Gold) Criteria: All M1, M2, M3 features and BSPs are in build. see Yocto 1.0 Schedule#Stabilization Phase Features and Activities

All planned features are in build.

Build and Release

(Yocto)

M4 (Gold) criteria: All features in master can be built with no errors. Builds were green with a few issues:

1. There was an error (on my part) on how toolchains get built. I'm regenerating them right now and will move them into the RC3.
2. There was a dependency issue with cairo in poky-image-lsb for qemux86 on external with cairo needing glib-2.0. I have a fix I'm testing right now for this and will have a push for it this afternoon. I'll copy over the x86 images that built correctly in internal so that external is complete.
3. crownbay had a checksum failure on xorg-server. I've removed the tarball and am regenerating to see if that fixes it. If not, I'll investigate further.
4. the eclipse plugin failed. I'm regenerating this this afternoon as a fix got pushed.
I'm looking at RC3 being fully available for testing in about 10 hours [midnight Pacific time] or so depending on how things shake out.

Build and Release

(BSPs)

M4 (Gold) criteria: Core and meta-intel BSPs can be built with no errors. See above
Open Bugs M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed.

Undispositioned bugs
486 Low bash is not used as login shell even if it's available qing.he NEW
725 Low crownbay: when installing, the install prompt text isn't the last thing shown qing.he NEW
788 Med [sstate] random error message shown when sstate is used Richard.Purdie NEW
789 Med [sstate] only few setscene tasks run even with same build environment Richard.Purdie NEW
792 Med Using sstate prebuilds on another host fails with eglibc-initial do_install error Richard.Purdie NEW
803 Med [zypper] zypper install does not work on qemux86/atom-pc qing.he NEW
804 Med [zypper] package installed by rpm could not be recognized by zypper qing.he NEW
807 Med BBFILE_PRIORITY variable definition should explain how priority ordering works scott.m.rifenbark NEW
813 Med bitbake can't parse a comment line that has a trailing backslash Richard.Purdie NEW
827 Med [zypper] zypper can not search any packages after installed package by rpm on qemuarm qing.he NEW
841 Med [zypper] installation failure on ppc (nightly build 20110305-4) saul.wold NEW
844 Hig GDB hangs when trying to debug zypper, libzypper, c++ combination nitin.a.kamble NEW
845 Med [zypper] zypper install failed on routerstationpro sdk image qing.he NEW
851 Hig qemux86-64 packages packaged as qemux86 mark.hatle NEW
856 Med No UST headers in arm sato-sdk image dexuan.cui NEW

Open Defects
67 total open defects: 11 High (1 Critical); 50 Medium; 6 Low
414 Hig [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS bruce.ashfield ACCE
649 Hig QEMU Segfaults with nographic option edwin.zhai ACCE
653 Hig Build of current master fails with "cannot change ownership" errors. nitin.a.kamble REOP
686 Hig Live images won't run from CDROM bruce.ashfield ACCE
712 Hig Fail to build non-GPLv3 image saul.wold ACCE
780 Hig gcc segfault on qemuppc (nightly build 20110226-1) nitin.a.kamble NEED
784 Hig perl-native compilation failure nitin.a.kamble ACCE
828 Hig oprofile sampling doesn't work on qemux86 in the default event-based interrupt mode dexuan.cui ACCE
844 Hig GDB hangs when trying to debug zypper, libzypper, c++ combination nitin.a.kamble NEW
851 Hig qemux86-64 packages packaged as qemux86 mark.hatle NEW
853 Hig matchbox-panel segfaults, X becomes unusable ke.yu ACCE (Critical)
237 Med Bug reporting guide scott.m.rifenbark NEED
378 Med Develop a way to change ssh servers using IMAGE_FEATURES scott.a.garman ACCE
412 Med lttv can't be loaded in GUI mode dexuan.cui ACCE
477 Med Python modules not built/installed correctly nitin.a.kamble ACCE
485 Med Some ltp test cases cause blocking kevin.tian NEED
489 Med [zypper] uname -m and repo arch difference qing.he ACCE
490 Med [zypper] installation failure on arm qing.he ACCE
491 Med [zypper] package removal failure qing.he ACCE
574 Med PPC: poky-image-sdk: gcc misses register save/restore routines nitin.a.kamble Wait
576 Med COMMERCIAL_LICENSE causes confusion scott.m.rifenbark NEED
635 Med add documentation for swabber scott.m.rifenbark REOP
636 Med no doc about sanity test process and case development scott.m.rifenbark NEED
637 Med need documentation for our security process scott.a.garman ACCE
638 Med need documentation for sstate scott.m.rifenbark NEED
639 Med need manual for ADT installer scott.m.rifenbark ACCE
640 Med update eclipse/anjuta plugin section in handbook scott.m.rifenbark NEED
641 Med need a doc for qemu usage scott.m.rifenbark NEED
642 Med update kernel use manual scott.m.rifenbark NEED
643 Med extend our FAQ to contain more usage tips scott.m.rifenbark ACCE
650 Med License naming standards. saul.wold ACCE
658 Med The bottom icons on Applications and All screen are cut-off in qemu. ke.yu ACCE
671 Med source poky-init-build-dev build-x86/ will cause error josh NEED
680 Med python-native should include the multiprocessing module (bitbake requires it) elizabeth.flanagan ACCE
688 Med Unable to run OpenGL applications in qemux86 images edwin.zhai ACCE
689 Med BB_ENV_EXTRAWHITE does not respect CCACHE_DIR scott.m.rifenbark ACCE
698 Med QEMU crash when using Ubuntu with NVIDIA proprietary Xorg driver edwin.zhai ACCE
736 Med mesa-demos for PPC: fails to link due to missing dl* symbols ke.yu ACCE
737 Med xserver-xf86-lite for PPC: linking failed due to missing dl* symbols ke.yu ACCE
766 Med [mpc8315e-rdb] USB does not work on mpc8315e-rdb bruce.ashfield NEED
767 Med [beagleboard] Can not set RTC correctly bruce.ashfield NEED
773 Med [routerstationpro] USB does not work on routerstationpro bruce.ashfield ACCE
788 Med [sstate] random error message shown when sstate is used Richard.Purdie NEW
789 Med [sstate] only few setscene tasks run even with same build environment Richard.Purdie NEW
792 Med Using sstate prebuilds on another host fails with eglibc-initial do_install error Richard.Purdie NEW
794 Med LSB: A test case (lib/Config.t) failed during running perl test of LSB. nitin.a.kamble ACCE
799 Med [blacksand] configured audiosink is not working for video player dongxiao.xu ACCE
803 Med [zypper] zypper install does not work on qemux86/atom-pc qing.he NEW
804 Med [zypper] package installed by rpm could not be recognized by zypper qing.he NEW
807 Med BBFILE_PRIORITY variable definition should explain how priority ordering works scott.m.rifenbark NEW
811 Med fotowall-0.9-r1: task do_compile: Failed paul.eggleton ACCE
812 Med Slang uses "/usr/lib" for RPATH kai.kang ACCE
813 Med bitbake can't parse a comment line that has a trailing backslash Richard.Purdie NEW
825 Med [zypper] zypper segfault in qemumips sato/sdk images qing.he NEED
826 Med rpm do_unpack failure when using sstate cache kevin.tian ACCE
827 Med [zypper] zypper can not search any packages after installed package by rpm on qemuarm qing.he NEW
829 Med perl @INC error when using sstate cache nitin.a.kamble ACCE
836 Med perl compilation error when using sstate cache nitin.a.kamble ACCE
841 Med [zypper] installation failure on ppc (nightly build 20110305-4) saul.wold NEW
845 Med [zypper] zypper install failed on routerstationpro sdk image qing.he NEW
856 Med No UST headers in arm sato-sdk image dexuan.cui NEW
293 Low Test and document how to change distro features (e.g, ssh server choice) scott.a.garman ACCE
429 Low error in compiling gmp-nativesdk for qemumips architecture on x86_64 host qing.he ACCE
486 Low bash is not used as login shell even if it's available qing.he NEW
725 Low crownbay: when installing, the install prompt text isn't the last thing shown qing.he NEW
732 Low It costs a lot of time when wget missing sstate file from http/ftp server edwin.zhai ACCE
787 Low rpm remove package error mark.hatle ACCE

Functional Tests M4 (Gold) criteria: 100% of planned tests are executed and results are logged in bugzilla QA has begun testing on RC3. Team has not been able to comple a full toolchain test.
BSP Testing M4 (Gold) criteria: 100% of planned BSP tests are executed QA has begun testing on RC3.
Alpha Feedback M4 (Gold) criteria: Alpha runs Feb 11th - Feb 23rd. Feedback is dispositioned. Program completed. Saul is parsing final results.
Documentation M4 (Gold) criteria: Release documentation created and published Yocto_1.0_Schedule#Documentation_Deliverables
Build Performance M4 (Gold) criteria: Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.) At 107 minutes. Team will continue to monitor, but acknowledges other areas are more critical to finish.
ADT User Workshop M4 (Gold) criteria: ADT User Workshop is held where developers use ADT tools to demo software, and results are included. Running into problems recruiting people.
Upstream Commits M4 (Gold) criteria: No goals for Yocto 1.0 - Yocto 1.1 will include more goals.
Marketing requirements from Engineering complete M4 (Gold) criteria: Yocto demo is prepared for ELC. Demo schedule:

March 4th – 0.9 demo brought up against 1.0 branch on eMenlow, Netbook, Router Station Pro (Joshua) - images built, but not tested

March 11th – Know which media codecs we need/which videos we need to support (Julie) - DONE

March 18th – Required software for video brought up

March 18th – PPC, Beagleboard done

March 18th – Sandybridge received or no-go for Sandybridge  This could be a “when we get it” test milestone.

March 25th – Images built and tested for each target / Demo app brought up

March 25th – Sandybridge development done

March 25th – Demo integrated without Sandybridge

April 1st – Demo integrated and ready for Linux Collab Summit

April 5th – Marketing trained on demo

Publication M4 (Gold) criteria: Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced

Tunnel Creek BSP Release Criteria

Release Criteria
Release Criteria Target Status
Development progress Features implemented; Code completed Coding completed
Build and Release EMGD and non-EMGD BSPs build reliably Build completed
Open Bugs All bugs dispositioned; Show-stoppers fixed Only minor bugs found (724, 725)
Functional Tests 100% of planned tests executed 100% testing complete
Legal Compliance All legal requirements met Click-through completed
Documentation Release Notes created and published Done
Performance Performance targets achieved This will be done out of cycle.
Publication Release and documentation are published on yoctoproject.org Done

Laverne Point Release Criteria

Release Criteria
Release Criteria Target Status
Development Progress Coding complete Coding completed
Build and Release Code builds reliably Release candidate is built.
Open Bugs All bugs dispositioned; Show-stoppers fixed No opens are show-stoppers. Open issues will be ID'd in release notes.
Functional Tests 100% of planned tests executed testing completed
Legal Compliance All legal requirements met tools run; requirements met
Performance Performance targets achieved N/A
Publication Release and documentation are published on yoctoproject.org Complete