Yocto Project v1.0 Release Criteria: Difference between revisions

From Yocto Project
Jump to navigationJump to search
Line 15: Line 15:
| Yocto 1.0 code builds reliably
| Yocto 1.0 code builds reliably
''Current criteria:  All features in master can be built.''
''Current criteria:  All features in master can be built.''
| bgcolor="yellow" | on-track to have stable builds by the end of Master Stabilization phase
| bgcolor="yellow" | some oddities noted in incremental builds (possibly related to dependencies), working on reproducing; other minor issues are showing up on autobuilder, nothing major - on-track  
|-
|-
! scope="row" | Build and Release
! scope="row" | Build and Release
(BSPs)
(BSPs)
| Yocto BSPs build reliably
| Yocto BSPs build reliably
''Current criteria:  Plan in place to build/QA BSPs by EO Feb.''
''Current criteria:  BSPs are built for testing.''
| bgcolor="yellow" | Meeting Thursday to determine plan.  Next Wednesday, the BSP build server will be off-line for a move, which may impact dates.
| bgcolor="yellow" | first BSP build will come Thursday
|-
|-
! scope="row" | Open Bugs
! scope="row" | Open Bugs
| All bugs dispositioned; Show-stoppers fixed
| All bugs dispositioned; Show-stoppers fixed
''Current criteria:  All bugs have been dispositioned.''
''Current criteria:  All bugs have been dispositioned.''
| bgcolor="orange" | 23 bugs have not been dispositioned (still in "New" state); Owners:  Tom, Saul, Richard, Julie, Paul, Mark, Ke, Jeff, Edwin
| bgcolor="orange" | 23 bugs have not been dispositioned (still in "New" state); Owners:  Tom, Saul, Richard, Julie, Paul, Mark, Ke, Jeff, Edwin; one Critical/High - bug 665; next scrub is Thursday (Beth running)
|-
|-
! scope="row" | Functional Tests
! scope="row" | Functional Tests
| 100% of planned tests executed and all bugs are logged in bugzilla
| 100% of planned tests executed and all bugs are logged in bugzilla
''Current criteria:  Weekly testing is performed on master and all bugs in bugzilla''
''Current criteria:  Weekly testing is performed on master and all bugs in bugzilla''
| bgcolor="yellow" | testing starts in Feb
| bgcolor="#66FF33" | on-track
|-
|-
! scope="row" | BSP Testing
! scope="row" | BSP Testing
| 100% of planned BSP tests executed
| 100% of planned BSP tests executed
''Current criteria:  TBD - pending BSP plan''
''Current criteria:  BSPs are tested at least once during master stabilization''
| bgcolor="white" |  
| bgcolor="#66FF33" | on-track
|-
|-
! scope="row" | Alpha Feedback
! scope="row" | Alpha Feedback
| Alpha feedback included
| Alpha feedback included
''Current criteria:  Alpha begins Feb 11th''
''Current criteria:  Alpha begins Feb 11th and completes Feb 23rd''
| bgcolor="#66FF33" | testing has begun; at least two bugs filed so far
| bgcolor="#66FF33" | testing has begun; at least two bugs filed so far
|-
|-
Line 46: Line 46:
| Release documentation created and published
| Release documentation created and published
''Current criteria:  M4 schedule items completed''
''Current criteria:  M4 schedule items completed''
| bgcolor="#66FF33" | on-track
| bgcolor="#66FF33" | [[Yocto_1.0_Schedule#Documentation_Deliverables]]
|-
|-
! scope="row" | Build Performance  
! scope="row" | Build Performance  
| Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)
| Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)


''Current criteria:  Team has begun tracking these metrics per build and has defined plan to do engineering work to address.''
''Current criteria:  Richard and PRC team complete performance analysis.''
| bgcolor="orange" | investigating who can do this rebuild testing regularly
| bgcolor="yellow" | Goal is to have a list of potential actions to take based on analysis next week.
|-
|-
! scope="row" | Marketing requirements complete
! scope="row" | Marketing requirements complete

Revision as of 21:15, 15 February 2011

Yocto v1.0 Release Criteria

Release Criteria
Release Criteria Target Status
Functional Completion All M1, M2, M3 functional features implemented by EO M3

Current Criteria: Functional features are ready to go into master.

see Yocto 1.0 Schedule#Stabilization Phase Features and Activities
Build and Release

(Yocto)

Yocto 1.0 code builds reliably

Current criteria: All features in master can be built.

some oddities noted in incremental builds (possibly related to dependencies), working on reproducing; other minor issues are showing up on autobuilder, nothing major - on-track
Build and Release

(BSPs)

Yocto BSPs build reliably

Current criteria: BSPs are built for testing.

first BSP build will come Thursday
Open Bugs All bugs dispositioned; Show-stoppers fixed

Current criteria: All bugs have been dispositioned.

23 bugs have not been dispositioned (still in "New" state); Owners: Tom, Saul, Richard, Julie, Paul, Mark, Ke, Jeff, Edwin; one Critical/High - bug 665; next scrub is Thursday (Beth running)
Functional Tests 100% of planned tests executed and all bugs are logged in bugzilla

Current criteria: Weekly testing is performed on master and all bugs in bugzilla

on-track
BSP Testing 100% of planned BSP tests executed

Current criteria: BSPs are tested at least once during master stabilization

on-track
Alpha Feedback Alpha feedback included

Current criteria: Alpha begins Feb 11th and completes Feb 23rd

testing has begun; at least two bugs filed so far
Documentation Release documentation created and published

Current criteria: M4 schedule items completed

Yocto_1.0_Schedule#Documentation_Deliverables
Build Performance Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)

Current criteria: Richard and PRC team complete performance analysis.

Goal is to have a list of potential actions to take based on analysis next week.
Marketing requirements complete Engineering requirements to the marketing plan are complete

Current criteria: Yocto demo is prepared for ELC.

Have hardware on order. Need videos. Need plexiglass boxes. Coding effort underway, but not complete.
Publication Release and documentation are published on yoctoproject.org

Current criteria: None for this stage

Tunnel Creek BSP Release Criteria

Release Criteria
Release Criteria Target Status
Development progress Features implemented; Code completed Coding completed
Build and Release EMGD and non-EMGD BSPs build reliably Still building image with removable media fix. Latest build appears to be missing binaries.
Open Bugs All bugs dispositioned; Show-stoppers fixed TBD based on testing of latest build
Functional Tests 100% of planned tests executed Tom and Jaijun will test when final build is available.
Legal Compliance All legal requirements met Account is set up for click-through. Click-through team has info they need.
Documentation Release Notes created and published Scott/Tom are finalizing and things look good.
Performance Performance targets achieved This will be done out of cycle.
Publication Release and documentation are published on yoctoproject.org on-track

Laverne Point Release Criteria

Release Criteria
Release Criteria Target Status
Development Progress Coding complete Coding completed
Build and Release Code builds reliably Release candidate is built.
Open Bugs All bugs dispositioned; Show-stoppers fixed No opens are show-stoppers. Open issues will be ID'd in release notes.
Functional Tests 100% of planned tests executed testing completed
Legal Compliance All legal requirements met tools run; requirements met
Performance Performance targets achieved N/A
Publication Release and documentation are published on yoctoproject.org Complete