Yocto Project v1.0 Release Criteria: Difference between revisions
From Yocto Project
Jump to navigationJump to search
(added additional details) |
(added input from 3/22 meeting) |
||
| Line 14: | Line 14: | ||
(Yocto) | (Yocto) | ||
|''M4 (Gold) criteria: All features in master can be built with no errors.'' | |''M4 (Gold) criteria: All features in master can be built with no errors.'' | ||
| bgcolor="yellow" | Builds are green. IPK repo for ADT needs to be rebuilt. | | bgcolor="yellow" | Builds are green. IPK repo for ADT needs to be rebuilt. Beth and Lianhao will do Thursday. | ||
|- | |- | ||
! scope="row" | Build and Release | ! scope="row" | Build and Release | ||
| Line 23: | Line 23: | ||
! scope="row" | Open Bugs | ! scope="row" | Open Bugs | ||
| ''M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed.'' | | ''M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed.'' | ||
| bgcolor="yellow" | All must-fix bugs are in RC4. QA is currently testing this build. | | bgcolor="yellow" | All must-fix bugs are in RC4. QA is currently testing this build. Three new bugs have been found so far:<br> | ||
1. New! [blacksand] it show poor performance with video player<br> | |||
http://bugzilla.pokylinux.org/show_bug.cgi?id=921 --> not a show-stopper b/c video plays (medium priority)<br> | |||
2. New! [crownbay-noemgd] video player has poor performance when playing video file<br> | |||
http://bugzilla.pokylinux.org/show_bug.cgi?id=920 --> not a bug, as designed<br> | |||
3. New! "rpm -qa" can not run for non-root user: Permission denied<br> | |||
http://bugzilla.pokylinux.org/show_bug.cgi?id=922 --> workaround = run as root; not a show-stopper<br> | |||
|- | |- | ||
! scope="row" | Functional Tests | ! scope="row" | Functional Tests | ||
| ''M4 (Gold) criteria: 100% of planned tests are executed and results are logged in bugzilla'' | | ''M4 (Gold) criteria: 100% of planned tests are executed and results are logged in bugzilla'' | ||
| bgcolor=" | | bgcolor="yellow" | QA has begun testing on RC4. See above for bug status. | ||
|- | |- | ||
! scope="row" | BSP Testing | ! scope="row" | BSP Testing | ||
| ''M4 (Gold) criteria: 100% of planned BSP tests are executed'' | | ''M4 (Gold) criteria: 100% of planned BSP tests are executed'' | ||
| bgcolor="yellow" | QA has begun testing on RC4. | | bgcolor="yellow" | QA has begun testing on RC4. See above for bug status. | ||
|- | |- | ||
! scope="row" | Alpha Feedback | ! scope="row" | Alpha Feedback | ||
| Line 43: | Line 50: | ||
! scope="row" | Build Performance | ! scope="row" | Build Performance | ||
| ''M4 (Gold) criteria: Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)'' | | ''M4 (Gold) criteria: Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)'' | ||
| bgcolor="yellow" | At | | bgcolor="yellow" | At 105 minutes. Team will continue to monitor, but acknowledges other areas are more critical to finish. | ||
|- | |- | ||
! scope="row" | ADT User Workshop | ! scope="row" | ADT User Workshop | ||
| ''M4 (Gold) criteria: ADT User Workshop is held where developers use ADT tools to demo software, and results are included.'' | | ''M4 (Gold) criteria: ADT User Workshop is held where developers use ADT tools to demo software, and results are included.'' | ||
| bgcolor="yellow" | Running into problems recruiting people. | | bgcolor="yellow" | Running into problems recruiting people, but not a blocker for 1.0 release. | ||
|- | |- | ||
! scope="row" | Upstream Commits | ! scope="row" | Upstream Commits | ||
| Line 60: | Line 67: | ||
March 11th – Know which media codecs we need/which videos we need to support (Julie) - DONE | March 11th – Know which media codecs we need/which videos we need to support (Julie) - DONE | ||
March 18th – Required software for video brought up | March 18th – Required software for video brought up <-- Video isn't running as well, so Joshua is investigating audio. Tom will investigate video on Sandybridge. Kevin's team may be able to help as well. Team will check back in Thursday. | ||
March 18th – PPC, Beagleboard done | March 18th – PPC, Beagleboard done | ||
| Line 77: | Line 84: | ||
! scope="row" | Publication | ! scope="row" | Publication | ||
| ''M4 (Gold) criteria: Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced'' | | ''M4 (Gold) criteria: Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced'' | ||
| bgcolor="yellow" | Release process beginning | | bgcolor="yellow" | Release process beginning. Jefro is on top of this. | ||
|} | |} | ||
Revision as of 16:01, 22 March 2011
Yocto v1.0 Release Criteria
| Release Criteria | Target | Status |
|---|---|---|
| Functional Completion | M4 (Gold) Criteria: All M1, M2, M3 features and BSPs are in build. | see Yocto 1.0 Schedule#Stabilization Phase Features and Activities
All planned features are in build. |
| Build and Release
(Yocto) |
M4 (Gold) criteria: All features in master can be built with no errors. | Builds are green. IPK repo for ADT needs to be rebuilt. Beth and Lianhao will do Thursday. |
| Build and Release
(BSPs) |
M4 (Gold) criteria: Core and meta-intel BSPs can be built with no errors. | Builds are green. |
| Open Bugs | M4 (Gold) criteria: All bugs have been dispositioned. Critical/High bugs targeted for M4 have been fixed. | All must-fix bugs are in RC4. QA is currently testing this build. Three new bugs have been found so far: 1. New! [blacksand] it show poor performance with video player |
| Functional Tests | M4 (Gold) criteria: 100% of planned tests are executed and results are logged in bugzilla | QA has begun testing on RC4. See above for bug status. |
| BSP Testing | M4 (Gold) criteria: 100% of planned BSP tests are executed | QA has begun testing on RC4. See above for bug status. |
| Alpha Feedback | M4 (Gold) criteria: Alpha runs Feb 11th - Feb 23rd. Feedback is dispositioned. | Program completed. Saul is parsing final results. |
| Documentation | M4 (Gold) criteria: Release documentation created and published | Yocto_1.0_Schedule#Documentation_Deliverables |
| Build Performance | M4 (Gold) criteria: Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.) | At 105 minutes. Team will continue to monitor, but acknowledges other areas are more critical to finish. |
| ADT User Workshop | M4 (Gold) criteria: ADT User Workshop is held where developers use ADT tools to demo software, and results are included. | Running into problems recruiting people, but not a blocker for 1.0 release. |
| Upstream Commits | M4 (Gold) criteria: No goals for Yocto 1.0 - Yocto 1.1 will include more goals. | |
| Marketing requirements from Engineering complete | M4 (Gold) criteria: Yocto demo is prepared for ELC. | Demo schedule:
March 4th – 0.9 demo brought up against 1.0 branch on eMenlow, Netbook, Router Station Pro (Joshua) - images built, but not tested March 11th – Know which media codecs we need/which videos we need to support (Julie) - DONE March 18th – Required software for video brought up <-- Video isn't running as well, so Joshua is investigating audio. Tom will investigate video on Sandybridge. Kevin's team may be able to help as well. Team will check back in Thursday. March 18th – PPC, Beagleboard done March 18th – Sandybridge received or no-go for Sandybridge This could be a “when we get it” test milestone. March 25th – Images built and tested for each target / Demo app brought up March 25th – Sandybridge development done March 25th – Demo integrated without Sandybridge March 31st – Demo integrated and ready to be shipped to ELC |
| Publication | M4 (Gold) criteria: Release and documentation are published on yoctoproject.org and Yocto 1.0 is announced | Release process beginning. Jefro is on top of this. |
Tunnel Creek BSP Release Criteria
| Release Criteria | Target | Status |
|---|---|---|
| Development progress | Features implemented; Code completed | Coding completed |
| Build and Release | EMGD and non-EMGD BSPs build reliably | Build completed |
| Open Bugs | All bugs dispositioned; Show-stoppers fixed | Only minor bugs found (724, 725) |
| Functional Tests | 100% of planned tests executed | 100% testing complete |
| Legal Compliance | All legal requirements met | Click-through completed |
| Documentation | Release Notes created and published | Done |
| Performance | Performance targets achieved | This will be done out of cycle. |
| Publication | Release and documentation are published on yoctoproject.org | Done |
Laverne Point Release Criteria
| Release Criteria | Target | Status |
|---|---|---|
| Development Progress | Coding complete | Coding completed |
| Build and Release | Code builds reliably | Release candidate is built. |
| Open Bugs | All bugs dispositioned; Show-stoppers fixed | No opens are show-stoppers. Open issues will be ID'd in release notes. |
| Functional Tests | 100% of planned tests executed | testing completed |
| Legal Compliance | All legal requirements met | tools run; requirements met |
| Performance | Performance targets achieved | N/A |
| Publication | Release and documentation are published on yoctoproject.org | Complete |
