Yocto Project v1.0 Release Criteria: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(added additional bugs)
(added March 29 status)
 
(10 intermediate revisions by the same user not shown)
Line 8: Line 8:
! scope="row" | Functional Completion
! scope="row" | Functional Completion
| ''M4 (Gold) Criteria:  All M1, M2, M3 features and BSPs are in build.''
| ''M4 (Gold) Criteria:  All M1, M2, M3 features and BSPs are in build.''
| bgcolor="#66FF33" | see [[Yocto 1.0 Schedule#Stabilization Phase Features and Activities]]
| bgcolor="green" | see [[Yocto 1.0 Schedule#Stabilization Phase Features and Activities]]
All planned features are in build.
All planned features are in build.
|-
|-
Line 14: Line 14:
(Yocto)
(Yocto)
|''M4 (Gold) criteria:  All features in master can be built with no errors.''
|''M4 (Gold) criteria:  All features in master can be built with no errors.''
| bgcolor="yellow" | Builds were green with a few issues:
| bgcolor="green" | Builds are green for RC4 and RC5.<br>
1. Tool chain issues:  Beth is working on this.  Trying to package this all up today.  Part of the problem is that we have 90 images, so builds take longer to address.  Beth is trying to get images smaller.  We should use different directories for Poky and Poky-lsb.  This could be causing some of the issues.  Beth/Richard need to discuss.  Once we have Poky-lsb builds going, Mark will ensure WR uses those.  Richard will look at changes before we start another build.<br>
RC4:  DISTRO_VERSION isn't at 1.0.<br>
2. Dependency issue with cairo in poky-image-lsb for qemux86 on external with cairo needing glib-2.0:  Fixed and pushed to Bernard and Master<br>
RC5: DISTRO_VERSION is at 1.0.
3. crownbay had a checksum failure on xorg-server - It is picking up the wrong checksum. Tom is investigating. <br>
4. the eclipse plugin failed - Rebuilt - FIXED
|-
|-
! scope="row" | Build and Release
! scope="row" | Build and Release
(BSPs)
(BSPs)
| ''M4 (Gold) criteria:  Core and meta-intel BSPs can be built with no errors.''
| ''M4 (Gold) criteria:  Core and meta-intel BSPs can be built with no errors.''
| bgcolor="yellow" | See above
| bgcolor="green" | Builds are green.
|-
|-
! scope="row" | Open Bugs
! scope="row" | Open Bugs
| ''M4 (Gold) criteria:  All bugs have been dispositioned.  Critical/High bugs targeted for M4 have been fixed.''
| ''M4 (Gold) criteria:  All bugs have been dispositioned.  Critical/High bugs targeted for M4 have been fixed.''
| bgcolor="orange" |  
| bgcolor="green" | RC4 and RC5:  All High priority bugs have been dispositioned.  All High priority bugs for 1.0 are fixed. *
Open Bugs:
853, 869 - These are high/critical that matchbox and keyboard/mouse doesn't work on X.  Are these related to the rootless X work?  Ke thinks not.  Why are these being found now?  Are we not testing Blacksand (or any x86 hardware) anymore?  Kevin will check.  Ke sent a note to Darren to work on this.  Darren will post-pone modules work to help Ke.<br>
414 - High/Major - Issues with PPC/QEMU emulation, but we can't resolve. Leaving as a High to mark for documentation.<br>
649 - Edwin is working on this.  Likely an issue with the video driver itself.  Edwin hopes to have something tomorrow.<br>
653 - Paul is working on this.  If it doesn't get in, it can be addressed via documentation.  Hope to have fix today or tomorrow.<br>
686 - Bruce is working on this.  There are some missing configurations.  This will not get fixed, so this needs to go into documentation.  Workaround = boot from USB stick instead of CD-ROM.<br>
797 - Mark is at a loss on this.  Can someone else work on?  Dongxiao can look into this.  Richard thinks the problem is related to shared state.  He'll add comments into bug report.<br>
822 - reopened for 1.1<br>
851 - Have a workaround for this.  Fixed.<br>
609 - Moved to 1.1.<br>
712 - SATO is not a target.  Basic image, which is a subset of LSB has 3 recipes that need to be adjusted for non-GPLv3.  Saul will work on this today.  We need to document in our reference manual that we support a non-GPLv3 build and document which builds we support this in.<br>
738 - This has been fixed for the Crownbay and Tom will submit a fix for no-emgd.  Darren opened a new bug on this (853).  Removing systray is a workaround for this.  Darren will try out Tom's change.<br>
780 - This happens occasionally.  Believed related to unfs.  Error was not found when use disk images/hardware.  Mark will follow up with submitter on this.  There is a known workaround (run ldconfig), so it can be documented in release notes.<br>
Zypper bugs - There are two issues:<br>
1) Architecture rework - This is in master, but needs to be tested.  This affects 5 bugs.<br>
2) NFS doesn't fully work with Zypper and RPM - Mark and Ching are working and expect to finish this week.<br>
803, 804, 827 - These are all High/Criticals (need to update bugzilla) and are most likely related.<br>
870 - Lianhao has a patch for this bug.  This is a High.
871 - Lianhao has a patch for this bug.  Richard will analyze to see if we want to take this one in.
788 - Saul may want to take this fix in.  Saul will take this in.
799 - This was just fixed. Richard will merge this in.
|-
|-
! scope="row" | Functional Tests
! scope="row" | Functional Tests
| ''M4 (Gold) criteria:  100% of planned tests are executed and results are logged in bugzilla''
| ''M4 (Gold) criteria:  100% of planned tests are executed and results are logged in bugzilla''
| bgcolor="orange" | QA has begun testing on RC3.  Team has not been able to comple a full toolchain test.
| bgcolor="green" |
RC4:  QA has completed test pass on RC4 except for stress testing. * <br>
RC5: QA has completed sanity test for RC5.
|-
|-
! scope="row" | BSP Testing
! scope="row" | BSP Testing
| ''M4 (Gold) criteria:  100% of planned BSP tests are executed''
| ''M4 (Gold) criteria:  100% of planned BSP tests are executed''
| bgcolor="yellow" | QA has begun testing on RC3.
| bgcolor="green" |  
RC4:  QA has completed test pass on RC4 except for stress testing. * <br>
RC5:  QA has completed sanity test for RC5.
|-
|-
! scope="row" | Alpha Feedback
! scope="row" | Alpha Feedback
| ''M4 (Gold) criteria:  Alpha runs Feb 11th - Feb 23rd.  Feedback is dispositioned.''
| ''M4 (Gold) criteria:  Alpha runs Feb 11th - Feb 23rd.  Feedback is dispositioned.''
| bgcolor="#66FF33" | Program completed.  Saul is parsing final results.
| bgcolor="#66FF33" | Program completed.  Issues have been dispositioned.
|-
|-
! scope="row" | Documentation
! scope="row" | Documentation
| ''M4 (Gold) criteria:  Release documentation created and published''
| ''M4 (Gold) criteria:  Release documentation created and published''
| bgcolor="#66FF33" | [[Yocto_1.0_Schedule#Documentation_Deliverables]]
| bgcolor="green" | Planned documentation deliverables are completed.  See [[Yocto_1.0_Schedule#Documentation_Deliverables]]
|-
|-
! scope="row" | Build Performance  
! scope="row" | Build Performance  
| ''M4 (Gold) criteria:  Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)''
| ''M4 (Gold) criteria:  Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)''
| bgcolor="yellow" | At 107 minutes.  Team will continue to monitor, but acknowledges other areas are more critical to finish.
| bgcolor="#66FF33" | At 105 minutes.  Team decision that this is not a blocker for 1.0.
|-
|-
! scope="row" | ADT User Workshop
! scope="row" | ADT User Workshop
| ''M4 (Gold) criteria:  ADT User Workshop is held where developers use ADT tools to demo software, and results are included.''
| ''M4 (Gold) criteria:  ADT User Workshop is held where developers use ADT tools to demo software, and results are included.''
| bgcolor="yellow" | Running into problems recruiting people.
| bgcolor="#66FF33" | Running into problems recruiting people, but not a blocker for 1.0 release.
|-
|-
! scope="row" | Upstream Commits
! scope="row" | Upstream Commits
Line 80: Line 61:
! scope="row" | Marketing requirements from Engineering complete
! scope="row" | Marketing requirements from Engineering complete
| ''M4 (Gold) criteria:  Yocto demo is prepared for ELC.''
| ''M4 (Gold) criteria:  Yocto demo is prepared for ELC.''
| bgcolor="yellow" | Demo schedule:
| bgcolor="yellow" | Top issues:<br>
March 4th  – 0.9 demo brought up against 1.0 branch on eMenlow, Netbook, Router Station Pro (Joshua) - images built, but not tested
Need to fix bug 919 so that rygel works and audio/video can be played.- Josh had success with previous rygel version.<br>
 
Need to get video to work on at least one piece of hardware. (Tom working on.)<br>
March 11th – Know which media codecs we need/which videos we need to support (Julie) - DONE
Need to ensure PPC can be used as a Content Store. (Scott G is working on once builds are done.) <br>
 
March 18th – Required software for video brought up
 
March 18th – PPC, Beagleboard done
 
March 18th – Sandybridge received or no-go for Sandybridge  This could be a “when we get it” test milestone.
 
March 25th – Images built and tested for each target / Demo app brought up
 
March 25th – Sandybridge development done
 
March 25th – Demo integrated without Sandybridge
 
March 31st – Demo integrated and ready to be shipped to ELC
 
|-
|-
! scope="row" | Publication
! scope="row" | Publication
| ''M4 (Gold) criteria:  Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced''
| ''M4 (Gold) criteria:  Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced''
| bgcolor="white" |  
| bgcolor="yellow" | Release process beginning.  See [[Yocto 1.0 Release Checklist]] for details.
|}
|}


Latest revision as of 16:02, 29 March 2011

Yocto v1.0 Release Criteria

Release Criteria
Release Criteria Target Status
Functional Completion M4 (Gold) Criteria: All M1, M2, M3 features and BSPs are in build. see Yocto 1.0 Schedule#Stabilization Phase Features and Activities

All planned features are in build.

Build and Release

(Yocto)

M4 (Gold) criteria: All features in master can be built with no errors. Builds are green for RC4 and RC5.

RC4: DISTRO_VERSION isn't at 1.0.
RC5: DISTRO_VERSION is at 1.0.

Build and Release

(BSPs)

M4 (Gold) criteria: Core and meta-intel BSPs can be built with no errors. Builds are green.
Open Bugs M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed. RC4 and RC5: All High priority bugs have been dispositioned. All High priority bugs for 1.0 are fixed. *
Functional Tests M4 (Gold) criteria: 100% of planned tests are executed and results are logged in bugzilla

RC4: QA has completed test pass on RC4 except for stress testing. *
RC5: QA has completed sanity test for RC5.

BSP Testing M4 (Gold) criteria: 100% of planned BSP tests are executed

RC4: QA has completed test pass on RC4 except for stress testing. *
RC5: QA has completed sanity test for RC5.

Alpha Feedback M4 (Gold) criteria: Alpha runs Feb 11th - Feb 23rd. Feedback is dispositioned. Program completed. Issues have been dispositioned.
Documentation M4 (Gold) criteria: Release documentation created and published Planned documentation deliverables are completed. See Yocto_1.0_Schedule#Documentation_Deliverables
Build Performance M4 (Gold) criteria: Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.) At 105 minutes. Team decision that this is not a blocker for 1.0.
ADT User Workshop M4 (Gold) criteria: ADT User Workshop is held where developers use ADT tools to demo software, and results are included. Running into problems recruiting people, but not a blocker for 1.0 release.
Upstream Commits M4 (Gold) criteria: No goals for Yocto 1.0 - Yocto 1.1 will include more goals.
Marketing requirements from Engineering complete M4 (Gold) criteria: Yocto demo is prepared for ELC. Top issues:

Need to fix bug 919 so that rygel works and audio/video can be played.- Josh had success with previous rygel version.
Need to get video to work on at least one piece of hardware. (Tom working on.)
Need to ensure PPC can be used as a Content Store. (Scott G is working on once builds are done.)

Publication M4 (Gold) criteria: Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced Release process beginning. See Yocto 1.0 Release Checklist for details.

Tunnel Creek BSP Release Criteria

Release Criteria
Release Criteria Target Status
Development progress Features implemented; Code completed Coding completed
Build and Release EMGD and non-EMGD BSPs build reliably Build completed
Open Bugs All bugs dispositioned; Show-stoppers fixed Only minor bugs found (724, 725)
Functional Tests 100% of planned tests executed 100% testing complete
Legal Compliance All legal requirements met Click-through completed
Documentation Release Notes created and published Done
Performance Performance targets achieved This will be done out of cycle.
Publication Release and documentation are published on yoctoproject.org Done

Laverne Point Release Criteria

Release Criteria
Release Criteria Target Status
Development Progress Coding complete Coding completed
Build and Release Code builds reliably Release candidate is built.
Open Bugs All bugs dispositioned; Show-stoppers fixed No opens are show-stoppers. Open issues will be ID'd in release notes.
Functional Tests 100% of planned tests executed testing completed
Legal Compliance All legal requirements met tools run; requirements met
Performance Performance targets achieved N/A
Publication Release and documentation are published on yoctoproject.org Complete
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Yocto_Project_v1.0_Release_Criteria&oldid=1051"