Yocto Project v1.0 Release Criteria: Difference between revisions

From Yocto Project
Jump to navigationJump to search
Line 32: Line 32:
! scope="row" | Functional Tests
! scope="row" | Functional Tests
| ''M4 (Gold) criteria:  100% of planned tests are executed and results are logged in bugzilla''
| ''M4 (Gold) criteria:  100% of planned tests are executed and results are logged in bugzilla''
| bgcolor="yellow" | QA is running tests this week.
| bgcolor="yellow" | QA will run a test pass this week.
|-
|-
! scope="row" | BSP Testing
! scope="row" | BSP Testing
| ''M4 (Gold) criteria:  100% of planned BSP tests are executed''
| ''M4 (Gold) criteria:  100% of planned BSP tests are executed''
| bgcolor="orange" | Team is currently blocked, but plan to be able to test next week.
| bgcolor="orange" | QA can run a partial test pass this week.
|-
|-
! scope="row" | Alpha Feedback
! scope="row" | Alpha Feedback
Line 48: Line 48:
! scope="row" | Build Performance  
! scope="row" | Build Performance  
| ''M4 (Gold) criteria:  Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)''
| ''M4 (Gold) criteria:  Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop.  (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)''
| bgcolor="yellow" | Team moved down from 109 minute builds to 107 due to some tweaks Richard made.  Next steps:  Richard, Dongxiao analyze and make changes.  Richard review notes from Dave's performance contact.  Dongxiao review notes from Dave's performance contact in PRC.
| bgcolor="yellow" | At 107 minutes.  Team will continue to monitor, but acknowledges other areas are more critical to finish.
|-
|-
! scope="row" | ADT User Workshop
! scope="row" | ADT User Workshop

Revision as of 06:45, 8 March 2011

Yocto v1.0 Release Criteria

Release Criteria
Release Criteria Target Status
Functional Completion M4 (Gold) Criteria: All M1, M2, M3 features and BSPs are in build. see Yocto 1.0 Schedule#Stabilization Phase Features and Activities

All planned features are in build.

Build and Release

(Yocto)

M4 (Gold) criteria: All features in master can be built with no errors. Still not green on builds; had some dependency failures related to performance changes - working on that; toolchain built, but not in right place
Build and Release

(BSPs)

M4 (Gold) criteria: Core and meta-intel BSPs can be built with no errors. Core BSPs are green. Beagleboard still needs video added (will do via branch - will make assessment based on patch). meta-intel still has some failures (Jasper Forest has failures in mesa-dri). QA can still do limited testing.
Open Bugs M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed. Total new defects: 11 (Bruce, Ke, Dongxiao, Liping, Nitin, Qing)

74 total open defects targeted for 1.0 Critical: 0 High: 16 Medium: 53 Low: 5

Functional Tests M4 (Gold) criteria: 100% of planned tests are executed and results are logged in bugzilla QA will run a test pass this week.
BSP Testing M4 (Gold) criteria: 100% of planned BSP tests are executed QA can run a partial test pass this week.
Alpha Feedback M4 (Gold) criteria: Alpha runs Feb 11th - Feb 23rd. Feedback is dispositioned. Program completed. Saul is parsing final results.
Documentation M4 (Gold) criteria: Release documentation created and published Yocto_1.0_Schedule#Documentation_Deliverables
Build Performance M4 (Gold) criteria: Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.) At 107 minutes. Team will continue to monitor, but acknowledges other areas are more critical to finish.
ADT User Workshop M4 (Gold) criteria: ADT User Workshop is held where developers use ADT tools to demo software, and results are included. Running into problems recruiting people.
Marketing requirements from Engineering complete M4 (Gold) criteria: Yocto demo is prepared for ELC. Demo schedule:

March 4th – 0.9 demo brought up against 1.0 branch on eMenlow, Netbook, Router Station Pro (Joshua) - images built, but not tested

March 11th – Know which media codecs we need/which videos we need to support (Julie) - DONE

March 18th – Required software for video brought up

March 18th – PPC, Beagleboard done

March 18th – Sandybridge received or no-go for Sandybridge  This could be a “when we get it” test milestone.

March 25th – Images built and tested for each target / Demo app brought up

March 25th – Sandybridge development done

March 25th – Demo integrated without Sandybridge

April 1st – Demo integrated and ready for Linux Collab Summit

April 5th – Marketing trained on demo

Publication M4 (Gold) criteria: Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced

Tunnel Creek BSP Release Criteria

Release Criteria
Release Criteria Target Status
Development progress Features implemented; Code completed Coding completed
Build and Release EMGD and non-EMGD BSPs build reliably Build completed
Open Bugs All bugs dispositioned; Show-stoppers fixed Only minor bugs found (724, 725)
Functional Tests 100% of planned tests executed 100% testing complete
Legal Compliance All legal requirements met Click-through completed
Documentation Release Notes created and published Done
Performance Performance targets achieved This will be done out of cycle.
Publication Release and documentation are published on yoctoproject.org on-track

Laverne Point Release Criteria

Release Criteria
Release Criteria Target Status
Development Progress Coding complete Coding completed
Build and Release Code builds reliably Release candidate is built.
Open Bugs All bugs dispositioned; Show-stoppers fixed No opens are show-stoppers. Open issues will be ID'd in release notes.
Functional Tests 100% of planned tests executed testing completed
Legal Compliance All legal requirements met tools run; requirements met
Performance Performance targets achieved N/A
Publication Release and documentation are published on yoctoproject.org Complete
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Yocto_Project_v1.0_Release_Criteria&oldid=890"