Yocto Project v1.0 Release Criteria: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(moved ADT user workshop into Release Criteria)
(added results from 3/1 Release Tracking meeting)
Line 16: Line 16:
| Yocto 1.0 code builds reliably
| Yocto 1.0 code builds reliably
''M4 (Gold) criteria:  All features in master can be built with no errors.''
''M4 (Gold) criteria:  All features in master can be built with no errors.''
| bgcolor="orange" | Four issues:
| bgcolor="yellow" | On track for builds by Friday. Working on corner cases with respect to being branch aware.
- We had an issue with builder02 running out of disk space, so some of the build copying was done post-build. This did not effect the build and was dealt with manually after cleaning up the partition.
 
- There is an issue with how package-index is being run. I will need to sync up with Jessica to verify how this should be incorporated into the build.
 
- The sanity tests on builder02 failed because builder02 was unable to resolve "localhost". This has been corrected and the sanity tests re-run incrementally: http://autobuilder.pokylinux.org:8010/builders/nightly-internal-sanity/builds/3
 
- The tarball generation buildstep is not branch aware. This will be fixed this week.  In the meantime it was run manually.
|-
|-
! scope="row" | Build and Release
! scope="row" | Build and Release
Line 29: Line 22:
| Yocto BSPs build reliably
| Yocto BSPs build reliably
''M4 (Gold) criteria:  BSPs can be build from master with no errors.''
''M4 (Gold) criteria:  BSPs can be build from master with no errors.''
| bgcolor="yellow" |  
| bgcolor="yellow" | Could build at least one BSP. On-track for Friday. Beagleboard issue (Beagleboard failed doing runstrip on uboot during do_populate_sysroot) may be fixed - investigating.
- BSPs did not complete successfully. There were some issue in the actual build mostly centering around:
-- Failing to do_kernel_checkout
-- Unpack issues around svn://svn.o-hand.com/repos
 
- Beagleboard failed doing runstrip on uboot during do_populate_sysroot
|-
|-
! scope="row" | Open Bugs
! scope="row" | Open Bugs
| All bugs dispositioned; Show-stoppers fixed
| All bugs dispositioned; Show-stoppers fixed
''M4 (Gold) criteria:  All bugs have been dispositioned.  Bugs targeted for M4 have been fixed.''
''M4 (Gold) criteria:  All bugs have been dispositioned.  Critical/High bugs targeted for M4 have been fixed.''
| bgcolor="orange" | 76 total open defects targeted for 1.0
| bgcolor="orange" | Total new defects:  11 (Bruce, Ke, Dongxiao, Liping, Nitin, Qing)
74 total open defects targeted for 1.0
Critical: 0
Critical: 0
High: 14
High: 16
Medium: 53
Medium: 53
Low: 7
Low: 5
Undetermined: 2
|-
|-
! scope="row" | Functional Tests
! scope="row" | Functional Tests
| 100% of planned tests executed and all bugs are logged in bugzilla
| 100% of planned tests executed and all bugs are logged in bugzilla
''M4 (Gold) criteria:  All planned tests are executed and results are logged in bugzilla''
''M4 (Gold) criteria:  All planned tests are executed and results are logged in bugzilla''
| bgcolor="yellow" | - zypper-search failed on qemux-x86_64 on poky-image-lsb and poky-image-sato
| bgcolor="yellow" | QA is running tests this week.
|-
|-
! scope="row" | BSP Testing
! scope="row" | BSP Testing
| 100% of planned BSP tests executed
| 100% of planned BSP tests executed
''M4 (Gold) criteria:  All planned BSP tests are executed''
''M4 (Gold) criteria:  All planned BSP tests are executed''
| bgcolor="orange" | Team hasn't get been able to do a full BSP test pass.  Open issues exist with respect to the BSPs (Julie).
| bgcolor="orange" | Team is currently blocked, but plan to be able to test next week.
|-
|-
! scope="row" | Alpha Feedback
! scope="row" | Alpha Feedback
| Alpha feedback included
| Alpha feedback included
''M4 (Gold) criteria:  Alpha begins Feb 11th and completes Feb 23rd''
''M4 (Gold) criteria:  Alpha begins Feb 11th and completes Feb 23rd''
| bgcolor="#66FF33" | Program completed.  Someone just needs to parse final results.
| bgcolor="#66FF33" | Program completed.  Saul is parsing final results.
|-
|-
! scope="row" | Documentation
! scope="row" | Documentation
Line 70: Line 58:


''M4 (Gold) criteria:  Goal above is reached.''
''M4 (Gold) criteria:  Goal above is reached.''
| bgcolor="yellow" | Team is down to 97-98 minute builds.  Richard will continue the analysis/tweak cycle; however, attention needs to go to other areas as well this week.  File dependencies is one other low-hanging fruit item Richard would like to investigate.
| bgcolor="yellow" | Team moved down from 109 minute builds to 107 due to some tweaks Richard made. Next steps: Richard, Dongxiao analyze and make changes.  Richard review notes from Dave's performance contact. Dongxiao review notes from Dave's performance contact in PRC.
real 109m52.400s
user 393m58.840s
sys 59m25.380s
 
|-
|-
! scope="row" | ADT User Workshop
! scope="row" | ADT User Workshop
Line 84: Line 68:
| Engineering requirements to the marketing plan are complete
| Engineering requirements to the marketing plan are complete
''M4 (Gold) criteria:  Yocto demo is prepared for ELC.''
''M4 (Gold) criteria:  Yocto demo is prepared for ELC.''
| bgcolor="yellow" | Hardware plan defined. Need videos. Need plexiglass boxes.  Coding effort underway, but not complete.
| bgcolor="yellow" | Demo schedule:
March 4th – 0.9 demo brought up against 1.0 branch on eMenlow, Netbook, Router Station Pro (Joshua) - on-track
March 11th – Know which media codecs we need/which videos we need to support (Julie)
March 18th – Required software for video brought up
March 18th – PPC, Beagleboard done
March 18th – Sandybridge received or no-go for Sandybridge  This could be a “when we get it” test milestone.
March 25th – Images built and tested for each target / Demo app brought up
March 25th – Sandybridge development done
March 25th – Demo integrated without Sandybridge
April 1st – Demo integrated and ready for Linux Collab Summit
April 5th – Marketing trained on demo
|-
|-
! scope="row" | Publication
! scope="row" | Publication

Revision as of 17:10, 1 March 2011

Yocto v1.0 Release Criteria

Release Criteria
Release Criteria Target Status
Functional Completion All M1, M2, M3 functional features implemented by EO M3

M4 (Gold) Criteria: All features and BSPs are in build.

see Yocto 1.0 Schedule#Stabilization Phase Features and Activities

Richard will send a note regarding the four open features.

Build and Release

(Yocto)

Yocto 1.0 code builds reliably

M4 (Gold) criteria: All features in master can be built with no errors.

On track for builds by Friday. Working on corner cases with respect to being branch aware.
Build and Release

(BSPs)

Yocto BSPs build reliably

M4 (Gold) criteria: BSPs can be build from master with no errors.

Could build at least one BSP. On-track for Friday. Beagleboard issue (Beagleboard failed doing runstrip on uboot during do_populate_sysroot) may be fixed - investigating.
Open Bugs All bugs dispositioned; Show-stoppers fixed

M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed.

Total new defects: 11 (Bruce, Ke, Dongxiao, Liping, Nitin, Qing)

74 total open defects targeted for 1.0 Critical: 0 High: 16 Medium: 53 Low: 5

Functional Tests 100% of planned tests executed and all bugs are logged in bugzilla

M4 (Gold) criteria: All planned tests are executed and results are logged in bugzilla

QA is running tests this week.
BSP Testing 100% of planned BSP tests executed

M4 (Gold) criteria: All planned BSP tests are executed

Team is currently blocked, but plan to be able to test next week.
Alpha Feedback Alpha feedback included

M4 (Gold) criteria: Alpha begins Feb 11th and completes Feb 23rd

Program completed. Saul is parsing final results.
Documentation Release documentation created and published

M4 (Gold) criteria: M4 schedule items completed

Yocto_1.0_Schedule#Documentation_Deliverables
Build Performance Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)

M4 (Gold) criteria: Goal above is reached.

Team moved down from 109 minute builds to 107 due to some tweaks Richard made. Next steps: Richard, Dongxiao analyze and make changes. Richard review notes from Dave's performance contact. Dongxiao review notes from Dave's performance contact in PRC.
ADT User Workshop ADT User Workshop is held where developers use ADT tools to demo software

M4 (Gold) criteria: Workshop is complete.

Running into problems recruiting people.
Marketing requirements complete Engineering requirements to the marketing plan are complete

M4 (Gold) criteria: Yocto demo is prepared for ELC.

Demo schedule:

March 4th – 0.9 demo brought up against 1.0 branch on eMenlow, Netbook, Router Station Pro (Joshua) - on-track March 11th – Know which media codecs we need/which videos we need to support (Julie) March 18th – Required software for video brought up March 18th – PPC, Beagleboard done March 18th – Sandybridge received or no-go for Sandybridge  This could be a “when we get it” test milestone. March 25th – Images built and tested for each target / Demo app brought up March 25th – Sandybridge development done March 25th – Demo integrated without Sandybridge April 1st – Demo integrated and ready for Linux Collab Summit April 5th – Marketing trained on demo

Publication Release and documentation are published on yoctoproject.org

M4 (Gold) criteria: Yocto Project 1.0 published and announced

Tunnel Creek BSP Release Criteria

Release Criteria
Release Criteria Target Status
Development progress Features implemented; Code completed Coding completed
Build and Release EMGD and non-EMGD BSPs build reliably Build completed
Open Bugs All bugs dispositioned; Show-stoppers fixed Only minor bugs found (724, 725)
Functional Tests 100% of planned tests executed Tom tested. Jiajun will test Thursday.
Legal Compliance All legal requirements met Account is set up for click-through. Click-through team has info they need.
Documentation Release Notes created and published Scott/Tom are finalizing and things look good.
Performance Performance targets achieved This will be done out of cycle.
Publication Release and documentation are published on yoctoproject.org on-track

Laverne Point Release Criteria

Release Criteria
Release Criteria Target Status
Development Progress Coding complete Coding completed
Build and Release Code builds reliably Release candidate is built.
Open Bugs All bugs dispositioned; Show-stoppers fixed No opens are show-stoppers. Open issues will be ID'd in release notes.
Functional Tests 100% of planned tests executed testing completed
Legal Compliance All legal requirements met tools run; requirements met
Performance Performance targets achieved N/A
Publication Release and documentation are published on yoctoproject.org Complete
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Yocto_Project_v1.0_Release_Criteria&oldid=854"