Yocto Project v1.0 Release Criteria: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(added ADT test status)
(added March 29 status)
 
(12 intermediate revisions by the same user not shown)
Line 8: Line 8:
! scope="row" | Functional Completion
! scope="row" | Functional Completion
| ''M4 (Gold) Criteria:  All M1, M2, M3 features and BSPs are in build.''
| ''M4 (Gold) Criteria:  All M1, M2, M3 features and BSPs are in build.''
| bgcolor="#66FF33" | see [[Yocto 1.0 Schedule#Stabilization Phase Features and Activities]]
| bgcolor="green" | see [[Yocto 1.0 Schedule#Stabilization Phase Features and Activities]]
All planned features are in build.
All planned features are in build.
|-
|-
Line 14: Line 14:
(Yocto)
(Yocto)
|''M4 (Gold) criteria:  All features in master can be built with no errors.''
|''M4 (Gold) criteria:  All features in master can be built with no errors.''
| bgcolor="yellow" | Builds were green with a few issues:
| bgcolor="green" | Builds are green for RC4 and RC5.<br>
1. There was an error (on my part) on how toolchains get built. I'm regenerating them right now and will move them into
RC4:  DISTRO_VERSION isn't at 1.0.<br>
the RC3. <br>
RC5:  DISTRO_VERSION is at 1.0.
2. There was a dependency issue with cairo in poky-image-lsb for qemux86 on external with cairo needing glib-2.0. I have
a fix I'm testing right now for this and will have a push for it this afternoon. I'll copy over the x86 images that
built correctly in internal so that external is complete.<br>
3. crownbay had a checksum failure on xorg-server. I've removed the tarball and am regenerating to see if that fixes it.  
If not, I'll investigate further. <br>
4. the eclipse plugin failed. I'm regenerating this this afternoon as a fix got pushed.<br>
I'm looking at RC3 being fully available for testing in about 10 hours [midnight Pacific time] or so depending on how things shake out.
 
|-
|-
! scope="row" | Build and Release
! scope="row" | Build and Release
(BSPs)
(BSPs)
| ''M4 (Gold) criteria:  Core and meta-intel BSPs can be built with no errors.''
| ''M4 (Gold) criteria:  Core and meta-intel BSPs can be built with no errors.''
| bgcolor="yellow" | See above
| bgcolor="green" | Builds are green.
|-
|-
! scope="row" | Open Bugs
! scope="row" | Open Bugs
| ''M4 (Gold) criteria:  All bugs have been dispositioned.  Critical/High bugs targeted for M4 have been fixed.''
| ''M4 (Gold) criteria:  All bugs have been dispositioned.  Critical/High bugs targeted for M4 have been fixed.''
| bgcolor="orange" |  
| bgcolor="green" | RC4 and RC5:  All High priority bugs have been dispositioned.  All High priority bugs for 1.0 are fixed. *
'''Undispositioned bugs'''<br>
486  Low  bash is not used as login shell even if it's available  qing.he  NEW  <br>
725  Low  crownbay: when installing, the install prompt text isn't the last thing shown qing.he  NEW<br> 
788  Med  [sstate] random error message shown when sstate is used  Richard.Purdie  NEW  <br>
789  Med  [sstate] only few setscene tasks run even with same build environment  Richard.Purdie  NEW  <br>
792  Med  Using sstate prebuilds on another host fails with eglibc-initial do_install error  Richard.Purdie  NEW  <br>
803  Med  [zypper] zypper install does not work on qemux86/atom-pc  qing.he  NEW  <br>
804  Med  [zypper] package installed by rpm could not be recognized by zypper  qing.he  NEW  <br>
807  Med  BBFILE_PRIORITY variable definition should explain how priority ordering works  scott.m.rifenbark NEW  <br>
813  Med  bitbake can't parse a comment line that has a trailing backslash  Richard.Purdie  NEW  <br>
827  Med  [zypper] zypper can not search any packages after installed package by rpm on qemuarm  qing.he  NEW  <br>
841  Med  [zypper] installation failure on ppc (nightly build 20110305-4)  saul.wold  NEW  <br>
844  Hig  GDB hangs when trying to debug zypper, libzypper, c++ combination  nitin.a.kamble  NEW  <br>
845  Med  [zypper] zypper install failed on routerstationpro sdk image  qing.he  NEW  <br>
851  Hig  qemux86-64 packages packaged as qemux86  mark.hatle  NEW  <br>
856  Med  No UST headers in arm sato-sdk image  dexuan.cui  NEW  <br>
 
'''Open Defects'''<br>
67 total open defects: 11 High (1 Critical); 50 Medium; 6 Low<br>
414  Hig  [PPC] kernel panic when booting poky-image-sdk-qemuppc through UNFS  bruce.ashfield  ACCE  <br>
649  Hig  QEMU Segfaults with nographic option  edwin.zhai  ACCE  <br>
653  Hig  Build of current master fails with "cannot change ownership" errors.  nitin.a.kamble  REOP  <br>
686  Hig  Live images won't run from CDROM  bruce.ashfield  ACCE  <br>
712  Hig  Fail to build non-GPLv3 image  saul.wold  ACCE  <br>
780  Hig  gcc segfault on qemuppc (nightly build 20110226-1)  nitin.a.kamble  NEED  <br>
784  Hig  perl-native compilation failure  nitin.a.kamble  ACCE  <br>
828  Hig  oprofile sampling doesn't work on qemux86 in the default event-based interrupt mode  dexuan.cui  ACCE  <br>
844  Hig  GDB hangs when trying to debug zypper, libzypper, c++ combination  nitin.a.kamble  NEW  <br>
851  Hig  qemux86-64 packages packaged as qemux86  mark.hatle  NEW  <br>
'''853  Hig  matchbox-panel segfaults, X becomes unusable  ke.yu  ACCE ''' (Critical) <br>
237  Med  Bug reporting guide  scott.m.rifenbark  NEED  <br>
378  Med  Develop a way to change ssh servers using IMAGE_FEATURES  scott.a.garman  ACCE  <br>
412  Med  lttv can't be loaded in GUI mode  dexuan.cui  ACCE  <br>
477  Med  Python modules not built/installed correctly  nitin.a.kamble  ACCE  <br>
485  Med  Some ltp test cases cause blocking  kevin.tian  NEED  <br>
489  Med  [zypper] uname -m and repo arch difference  qing.he  ACCE  <br>
490  Med  [zypper] installation failure on arm  qing.he  ACCE  <br>
491  Med  [zypper] package removal failure  qing.he  ACCE  <br>
574  Med  PPC: poky-image-sdk: gcc misses register save/restore routines  nitin.a.kamble  Wait  <br>
576  Med  COMMERCIAL_LICENSE causes confusion  scott.m.rifenbark  NEED  <br>
635  Med  add documentation for swabber  scott.m.rifenbark  REOP  <br>
636  Med  no doc about sanity test process and case development  scott.m.rifenbark  NEED  <br>
637  Med  need documentation for our security process  scott.a.garman  ACCE  <br>
638  Med  need documentation for sstate  scott.m.rifenbark  NEED  <br>
639  Med  need manual for ADT installer  scott.m.rifenbark  ACCE  <br>
640  Med  update eclipse/anjuta plugin section in handbook  scott.m.rifenbark  NEED  <br>
641  Med  need a doc for qemu usage  scott.m.rifenbark  NEED  <br>
642  Med  update kernel use manual  scott.m.rifenbark  NEED  <br>
643  Med  extend our FAQ to contain more usage tips  scott.m.rifenbark  ACCE <br>
650  Med  License naming standards.  saul.wold  ACCE  <br>
658  Med  The bottom icons on Applications and All screen are cut-off in qemu.  ke.yu  ACCE  <br>
671  Med  source poky-init-build-dev build-x86/ will cause error  josh  NEED  <br>
680  Med  python-native should include the multiprocessing module (bitbake requires it)  elizabeth.flanagan  ACCE  <br>
688  Med  Unable to run OpenGL applications in qemux86 images  edwin.zhai  ACCE  <br>
689  Med  BB_ENV_EXTRAWHITE does not respect CCACHE_DIR  scott.m.rifenbark  ACCE  <br>
698  Med  QEMU crash when using Ubuntu with NVIDIA proprietary Xorg driver  edwin.zhai  ACCE  <br>
736  Med  mesa-demos for PPC: fails to link due to missing dl* symbols  ke.yu  ACCE  <br>
737  Med  xserver-xf86-lite for PPC: linking failed due to missing dl* symbols  ke.yu  ACCE  <br>
766  Med  [mpc8315e-rdb] USB does not work on mpc8315e-rdb  bruce.ashfield  NEED  <br>
767  Med  [beagleboard] Can not set RTC correctly  bruce.ashfield  NEED  <br>
773  Med  [routerstationpro] USB does not work on routerstationpro  bruce.ashfield  ACCE  <br>
788  Med  [sstate] random error message shown when sstate is used  Richard.Purdie  NEW  <br>
789  Med  [sstate] only few setscene tasks run even with same build environment  Richard.Purdie  NEW  <br>
792  Med  Using sstate prebuilds on another host fails with eglibc-initial do_install error  Richard.Purdie  NEW  <br>
794  Med  LSB: A test case (lib/Config.t) failed during running perl test of LSB.  nitin.a.kamble  ACCE  <br>
799  Med  [blacksand] configured audiosink is not working for video player  dongxiao.xu  ACCE  <br>
803  Med  [zypper] zypper install does not work on qemux86/atom-pc  qing.he  NEW  <br>
804  Med  [zypper] package installed by rpm could not be recognized by zypper  qing.he  NEW  <br>
807  Med  BBFILE_PRIORITY variable definition should explain how priority ordering works  scott.m.rifenbark  NEW  <br>
811  Med  fotowall-0.9-r1: task do_compile: Failed  paul.eggleton  ACCE  <br>
812  Med  Slang uses "/usr/lib" for RPATH  kai.kang  ACCE  <br>
813  Med  bitbake can't parse a comment line that has a trailing backslash  Richard.Purdie  NEW  <br>
825  Med  [zypper] zypper segfault in qemumips sato/sdk images  qing.he  NEED  <br>
826  Med  rpm do_unpack failure when using sstate cache  kevin.tian  ACCE  <br>
827  Med  [zypper] zypper can not search any packages after installed package by rpm on qemuarm  qing.he  NEW  <br>
829  Med  perl @INC error when using sstate cache  nitin.a.kamble  ACCE  <br>
836  Med  perl compilation error when using sstate cache  nitin.a.kamble  ACCE  <br>
841  Med  [zypper] installation failure on ppc (nightly build 20110305-4)  saul.wold  NEW  <br>
845  Med  [zypper] zypper install failed on routerstationpro sdk image  qing.he  NEW  <br>
856  Med  No UST headers in arm sato-sdk image  dexuan.cui  NEW  <br>
293  Low  Test and document how to change distro features (e.g, ssh server choice)  scott.a.garman  ACCE  <br>
429  Low  error in compiling gmp-nativesdk for qemumips architecture on x86_64 host  qing.he  ACCE  <br>
486  Low  bash is not used as login shell even if it's available  qing.he  NEW  <br>
725  Low  crownbay: when installing, the install prompt text isn't the last thing shown  qing.he  NEW  <br>
732  Low  It costs a lot of time when wget missing sstate file from http/ftp server  edwin.zhai  ACCE  <br>
787  Low  rpm remove package error  mark.hatle  ACCE  <br>
 
|-
|-
! scope="row" | Functional Tests
! scope="row" | Functional Tests
| ''M4 (Gold) criteria:  100% of planned tests are executed and results are logged in bugzilla''
| ''M4 (Gold) criteria:  100% of planned tests are executed and results are logged in bugzilla''
| bgcolor="orange" | QA has begun testing on RC3.  Team has not been able to comple a full toolchain test.
| bgcolor="green" |
RC4:  QA has completed test pass on RC4 except for stress testing. * <br>
RC5: QA has completed sanity test for RC5.
|-
|-
! scope="row" | BSP Testing
! scope="row" | BSP Testing
| ''M4 (Gold) criteria:  100% of planned BSP tests are executed''
| ''M4 (Gold) criteria:  100% of planned BSP tests are executed''
| bgcolor="yellow" | QA has begun testing on RC3.
| bgcolor="green" |  
RC4:  QA has completed test pass on RC4 except for stress testing. * <br>
RC5:  QA has completed sanity test for RC5.
|-
|-
! scope="row" | Alpha Feedback
! scope="row" | Alpha Feedback
| ''M4 (Gold) criteria:  Alpha runs Feb 11th - Feb 23rd.  Feedback is dispositioned.''
| ''M4 (Gold) criteria:  Alpha runs Feb 11th - Feb 23rd.  Feedback is dispositioned.''
| bgcolor="#66FF33" | Program completed.  Saul is parsing final results.
| bgcolor="#66FF33" | Program completed.  Issues have been dispositioned.
|-
|-
! scope="row" | Documentation
! scope="row" | Documentation
| ''M4 (Gold) criteria:  Release documentation created and published''
| ''M4 (Gold) criteria:  Release documentation created and published''
| bgcolor="#66FF33" | [[Yocto_1.0_Schedule#Documentation_Deliverables]]
| bgcolor="green" | Planned documentation deliverables are completed.  See [[Yocto_1.0_Schedule#Documentation_Deliverables]]
|-
|-
! scope="row" | Build Performance  
! scope="row" | Build Performance  
| ''M4 (Gold) criteria:  Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)''
| ''M4 (Gold) criteria:  Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)''
| bgcolor="yellow" | At 107 minutes.  Team will continue to monitor, but acknowledges other areas are more critical to finish.
| bgcolor="#66FF33" | At 105 minutes.  Team decision that this is not a blocker for 1.0.
|-
|-
! scope="row" | ADT User Workshop
! scope="row" | ADT User Workshop
| ''M4 (Gold) criteria:  ADT User Workshop is held where developers use ADT tools to demo software, and results are included.''
| ''M4 (Gold) criteria:  ADT User Workshop is held where developers use ADT tools to demo software, and results are included.''
| bgcolor="yellow" | Running into problems recruiting people.
| bgcolor="#66FF33" | Running into problems recruiting people, but not a blocker for 1.0 release.
|-
|-
! scope="row" | Upstream Commits
! scope="row" | Upstream Commits
Line 152: Line 61:
! scope="row" | Marketing requirements from Engineering complete
! scope="row" | Marketing requirements from Engineering complete
| ''M4 (Gold) criteria:  Yocto demo is prepared for ELC.''
| ''M4 (Gold) criteria:  Yocto demo is prepared for ELC.''
| bgcolor="yellow" | Demo schedule:
| bgcolor="yellow" | Top issues:<br>
March 4th  – 0.9 demo brought up against 1.0 branch on eMenlow, Netbook, Router Station Pro (Joshua) - images built, but not tested
Need to fix bug 919 so that rygel works and audio/video can be played.- Josh had success with previous rygel version.<br>
 
Need to get video to work on at least one piece of hardware. (Tom working on.)<br>
March 11th – Know which media codecs we need/which videos we need to support (Julie) - DONE
Need to ensure PPC can be used as a Content Store. (Scott G is working on once builds are done.) <br>
 
March 18th – Required software for video brought up
 
March 18th – PPC, Beagleboard done
 
March 18th – Sandybridge received or no-go for Sandybridge  This could be a “when we get it” test milestone.
 
March 25th – Images built and tested for each target / Demo app brought up
 
March 25th – Sandybridge development done
 
March 25th – Demo integrated without Sandybridge
 
April 1st – Demo integrated and ready for Linux Collab Summit
 
April 5th – Marketing trained on demo
 
|-
|-
! scope="row" | Publication
! scope="row" | Publication
| ''M4 (Gold) criteria:  Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced''
| ''M4 (Gold) criteria:  Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced''
| bgcolor="white" |  
| bgcolor="yellow" | Release process beginning.  See [[Yocto 1.0 Release Checklist]] for details.
|}
|}


Latest revision as of 16:02, 29 March 2011

Yocto v1.0 Release Criteria

Release Criteria
Release Criteria Target Status
Functional Completion M4 (Gold) Criteria: All M1, M2, M3 features and BSPs are in build. see Yocto 1.0 Schedule#Stabilization Phase Features and Activities

All planned features are in build.

Build and Release

(Yocto)

M4 (Gold) criteria: All features in master can be built with no errors. Builds are green for RC4 and RC5.

RC4: DISTRO_VERSION isn't at 1.0.
RC5: DISTRO_VERSION is at 1.0.

Build and Release

(BSPs)

M4 (Gold) criteria: Core and meta-intel BSPs can be built with no errors. Builds are green.
Open Bugs M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed. RC4 and RC5: All High priority bugs have been dispositioned. All High priority bugs for 1.0 are fixed. *
Functional Tests M4 (Gold) criteria: 100% of planned tests are executed and results are logged in bugzilla

RC4: QA has completed test pass on RC4 except for stress testing. *
RC5: QA has completed sanity test for RC5.

BSP Testing M4 (Gold) criteria: 100% of planned BSP tests are executed

RC4: QA has completed test pass on RC4 except for stress testing. *
RC5: QA has completed sanity test for RC5.

Alpha Feedback M4 (Gold) criteria: Alpha runs Feb 11th - Feb 23rd. Feedback is dispositioned. Program completed. Issues have been dispositioned.
Documentation M4 (Gold) criteria: Release documentation created and published Planned documentation deliverables are completed. See Yocto_1.0_Schedule#Documentation_Deliverables
Build Performance M4 (Gold) criteria: Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.) At 105 minutes. Team decision that this is not a blocker for 1.0.
ADT User Workshop M4 (Gold) criteria: ADT User Workshop is held where developers use ADT tools to demo software, and results are included. Running into problems recruiting people, but not a blocker for 1.0 release.
Upstream Commits M4 (Gold) criteria: No goals for Yocto 1.0 - Yocto 1.1 will include more goals.
Marketing requirements from Engineering complete M4 (Gold) criteria: Yocto demo is prepared for ELC. Top issues:

Need to fix bug 919 so that rygel works and audio/video can be played.- Josh had success with previous rygel version.
Need to get video to work on at least one piece of hardware. (Tom working on.)
Need to ensure PPC can be used as a Content Store. (Scott G is working on once builds are done.)

Publication M4 (Gold) criteria: Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced Release process beginning. See Yocto 1.0 Release Checklist for details.

Tunnel Creek BSP Release Criteria

Release Criteria
Release Criteria Target Status
Development progress Features implemented; Code completed Coding completed
Build and Release EMGD and non-EMGD BSPs build reliably Build completed
Open Bugs All bugs dispositioned; Show-stoppers fixed Only minor bugs found (724, 725)
Functional Tests 100% of planned tests executed 100% testing complete
Legal Compliance All legal requirements met Click-through completed
Documentation Release Notes created and published Done
Performance Performance targets achieved This will be done out of cycle.
Publication Release and documentation are published on yoctoproject.org Done

Laverne Point Release Criteria

Release Criteria
Release Criteria Target Status
Development Progress Coding complete Coding completed
Build and Release Code builds reliably Release candidate is built.
Open Bugs All bugs dispositioned; Show-stoppers fixed No opens are show-stoppers. Open issues will be ID'd in release notes.
Functional Tests 100% of planned tests executed testing completed
Legal Compliance All legal requirements met tools run; requirements met
Performance Performance targets achieved N/A
Publication Release and documentation are published on yoctoproject.org Complete
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Yocto_Project_v1.0_Release_Criteria&oldid=1051"