Yocto Project v1.0 Release Criteria: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(updates from Feb 22 Yocto meeting)
(made RC into Gold criteria)
Line 8: Line 8:
! scope="row" | Functional Completion
! scope="row" | Functional Completion
| All M1, M2, M3 functional features implemented by EO M3
| All M1, M2, M3 functional features implemented by EO M3
''Current Criteria:  Functional features are ready to go into master.''
''M4 (Gold) Criteria:  All features and BSPs are in build.''
| bgcolor="yellow" | see [[Yocto 1.0 Schedule#Stabilization Phase Features and Activities]]
| bgcolor="yellow" | see [[Yocto 1.0 Schedule#Stabilization Phase Features and Activities]]
Richard will send a note regarding the four open features.
Richard will send a note regarding the four open features.
Line 15: Line 15:
(Yocto)
(Yocto)
| Yocto 1.0 code builds reliably
| Yocto 1.0 code builds reliably
''Current criteria:  All features in master can be built.''
''M4 (Gold) criteria:  All features in master can be built with no errors.''
| bgcolor="orange" | There are two major items blocking stable builds:
| bgcolor="orange" | There are two major items blocking stable builds:
- Docutils is failing - Saul will discuss with Scott G today.
- Docutils is failing - Saul will discuss with Scott G today.
Line 24: Line 24:
(BSPs)
(BSPs)
| Yocto BSPs build reliably
| Yocto BSPs build reliably
''Current criteria:  BSPs are built for testing.''
''M4 (Gold) criteria:  BSPs can be build from master with no errors.''
| bgcolor="#66FF33" | Goals for this release are met.  QA will be able to test BSPs at the same time as RC1.
| bgcolor="yellow" | There are currently four errors Beth is working through.
|-
|-
! scope="row" | Open Bugs
! scope="row" | Open Bugs
| All bugs dispositioned; Show-stoppers fixed
| All bugs dispositioned; Show-stoppers fixed
''Current criteria:  All bugs have been dispositioned.''
''M4 (Gold) criteria:  All bugs have been dispositioned.  Bugs targeted for M4 have been fixed.''
| bgcolor="orange" | 65 bugs not yet dispositioned (in "New" state); Owners:  Tom, Scott, Saul, Richard, Qing, Paul, Nitin, Mark, Ke, Julie, Josh, Jeff, Edwin, Darren, Dongxiao); one Critical/High - bug 734; six Major/High
| bgcolor="orange" | 65 bugs not yet dispositioned (in "New" state); Owners:  Tom, Scott, Saul, Richard, Qing, Paul, Nitin, Mark, Ke, Julie, Josh, Jeff, Edwin, Darren, Dongxiao); one Critical/High - bug 734; six Major/High
|-
|-
! scope="row" | Functional Tests
! scope="row" | Functional Tests
| 100% of planned tests executed and all bugs are logged in bugzilla
| 100% of planned tests executed and all bugs are logged in bugzilla
''Current criteria:  Weekly testing is performed on master and all bugs in bugzilla''
''M4 (Gold) criteria:  All planned tests are executed and results are logged in bugzilla''
| bgcolor="#66FF33" | on-track
| bgcolor="#66FF33" | on-track
|-
|-
! scope="row" | BSP Testing
! scope="row" | BSP Testing
| 100% of planned BSP tests executed
| 100% of planned BSP tests executed
''Current criteria:  BSPs are tested at least once during master stabilization''
''M4 (Gold) criteria:  All planned BSP tests are executed''
| bgcolor="#66FF33" | on-track
| bgcolor="orange" | Team hasn't get been able to do a full BSP test pass.  Open issues exist with respect to the BSPs (Julie).
|-
|-
! scope="row" | Alpha Feedback
! scope="row" | Alpha Feedback
| Alpha feedback included
| Alpha feedback included
''Current criteria:  Alpha begins Feb 11th and completes Feb 23rd''
''M4 (Gold) criteria:  Alpha begins Feb 11th and completes Feb 23rd''
| bgcolor="#66FF33" | testing nearing completion; positive feedback so far
| bgcolor="#66FF33" | Program completed.  Someone just needs to parse final results.
|-
|-
! scope="row" | Documentation
! scope="row" | Documentation
| Release documentation created and published
| Release documentation created and published
''Current criteria:  M4 schedule items completed''
''M4 (Gold) criteria:  M4 schedule items completed''
| bgcolor="#66FF33" | [[Yocto_1.0_Schedule#Documentation_Deliverables]]
| bgcolor="#66FF33" | [[Yocto_1.0_Schedule#Documentation_Deliverables]]
|-
|-
Line 55: Line 55:
| Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)
| Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)


''Current criteria:  Richard and PRC team complete performance analysis.''
''M4 (Gold) criteria:  Goal above is reached.''
| bgcolor="yellow" | Team is down to 97-98 minute builds.  Richard will continue the analysis/tweak cycle; however, attention needs to go to other areas as well this week.  File dependencies is one other low-hanging fruit item Richard would like to investigate.
| bgcolor="yellow" | Team is down to 97-98 minute builds.  Richard will continue the analysis/tweak cycle; however, attention needs to go to other areas as well this week.  File dependencies is one other low-hanging fruit item Richard would like to investigate.
|-
|-
! scope="row" | Marketing requirements complete
! scope="row" | Marketing requirements complete
| Engineering requirements to the marketing plan are complete
| Engineering requirements to the marketing plan are complete
''Current criteria:  Yocto demo is prepared for ELC.''
''M4 (Gold) criteria:  Yocto demo is prepared for ELC.''
| bgcolor="yellow" | PPC no longer available for Joshua - investigating backup options.  Need videos.  Need plexiglass boxes.  Coding effort underway, but not complete.
| bgcolor="yellow" | Hardware plan defined.  Need videos.  Need plexiglass boxes.  Coding effort underway, but not complete.
|-
|-
! scope="row" | Publication
! scope="row" | Publication
| Release and documentation are published on yoctoproject.org
| Release and documentation are published on yoctoproject.org
''Current criteria:  None for this stage''
''M4 (Gold) criteria:  Yocto Project 1.0 published and announced''
| bgcolor="white" |  
| bgcolor="white" |  
|}
|}

Revision as of 00:16, 25 February 2011

Yocto v1.0 Release Criteria

Release Criteria
Release Criteria Target Status
Functional Completion All M1, M2, M3 functional features implemented by EO M3

M4 (Gold) Criteria: All features and BSPs are in build.

see Yocto 1.0 Schedule#Stabilization Phase Features and Activities

Richard will send a note regarding the four open features.

Build and Release

(Yocto)

Yocto 1.0 code builds reliably

M4 (Gold) criteria: All features in master can be built with no errors.

There are two major items blocking stable builds:

- Docutils is failing - Saul will discuss with Scott G today. - Zypper is failing <- Richard is working with Qing. We have until Friday to get these fixed.

Build and Release

(BSPs)

Yocto BSPs build reliably

M4 (Gold) criteria: BSPs can be build from master with no errors.

There are currently four errors Beth is working through.
Open Bugs All bugs dispositioned; Show-stoppers fixed

M4 (Gold) criteria: All bugs have been dispositioned. Bugs targeted for M4 have been fixed.

65 bugs not yet dispositioned (in "New" state); Owners: Tom, Scott, Saul, Richard, Qing, Paul, Nitin, Mark, Ke, Julie, Josh, Jeff, Edwin, Darren, Dongxiao); one Critical/High - bug 734; six Major/High
Functional Tests 100% of planned tests executed and all bugs are logged in bugzilla

M4 (Gold) criteria: All planned tests are executed and results are logged in bugzilla

on-track
BSP Testing 100% of planned BSP tests executed

M4 (Gold) criteria: All planned BSP tests are executed

Team hasn't get been able to do a full BSP test pass. Open issues exist with respect to the BSPs (Julie).
Alpha Feedback Alpha feedback included

M4 (Gold) criteria: Alpha begins Feb 11th and completes Feb 23rd

Program completed. Someone just needs to parse final results.
Documentation Release documentation created and published

M4 (Gold) criteria: M4 schedule items completed

Yocto_1.0_Schedule#Documentation_Deliverables
Build Performance Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)

M4 (Gold) criteria: Goal above is reached.

Team is down to 97-98 minute builds. Richard will continue the analysis/tweak cycle; however, attention needs to go to other areas as well this week. File dependencies is one other low-hanging fruit item Richard would like to investigate.
Marketing requirements complete Engineering requirements to the marketing plan are complete

M4 (Gold) criteria: Yocto demo is prepared for ELC.

Hardware plan defined. Need videos. Need plexiglass boxes. Coding effort underway, but not complete.
Publication Release and documentation are published on yoctoproject.org

M4 (Gold) criteria: Yocto Project 1.0 published and announced

Tunnel Creek BSP Release Criteria

Release Criteria
Release Criteria Target Status
Development progress Features implemented; Code completed Coding completed
Build and Release EMGD and non-EMGD BSPs build reliably Build completed
Open Bugs All bugs dispositioned; Show-stoppers fixed Only minor bugs found (724, 725)
Functional Tests 100% of planned tests executed Tom tested. Jiajun will test Thursday.
Legal Compliance All legal requirements met Account is set up for click-through. Click-through team has info they need.
Documentation Release Notes created and published Scott/Tom are finalizing and things look good.
Performance Performance targets achieved This will be done out of cycle.
Publication Release and documentation are published on yoctoproject.org on-track

Laverne Point Release Criteria

Release Criteria
Release Criteria Target Status
Development Progress Coding complete Coding completed
Build and Release Code builds reliably Release candidate is built.
Open Bugs All bugs dispositioned; Show-stoppers fixed No opens are show-stoppers. Open issues will be ID'd in release notes.
Functional Tests 100% of planned tests executed testing completed
Legal Compliance All legal requirements met tools run; requirements met
Performance Performance targets achieved N/A
Publication Release and documentation are published on yoctoproject.org Complete
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Yocto_Project_v1.0_Release_Criteria&oldid=826"