Yocto Project v1.0 Release Criteria: Difference between revisions
| Line 16: | Line 16: | ||
| Yocto 1.0 code builds reliably | | Yocto 1.0 code builds reliably | ||
''M4 (Gold) criteria: All features in master can be built with no errors.'' | ''M4 (Gold) criteria: All features in master can be built with no errors.'' | ||
| bgcolor="orange" | | | bgcolor="orange" | Four issues: | ||
- | - We had an issue with builder02 running out of disk space, so some of the build copying was done post-build. This did not effect the build and was dealt with manually after cleaning up the partition. | ||
- | |||
- There is an issue with how package-index is being run. I will need to sync up with Jessica to verify how this should be incorporated into the build. | |||
- The sanity tests on builder02 failed because builder02 was unable to resolve "localhost". This has been corrected and the sanity tests re-run incrementally: http://autobuilder.pokylinux.org:8010/builders/nightly-internal-sanity/builds/3 | |||
- The tarball generation buildstep is not branch aware. This will be fixed this week. In the meantime it was run manually. | |||
|- | |- | ||
! scope="row" | Build and Release | ! scope="row" | Build and Release | ||
| Line 25: | Line 29: | ||
| Yocto BSPs build reliably | | Yocto BSPs build reliably | ||
''M4 (Gold) criteria: BSPs can be build from master with no errors.'' | ''M4 (Gold) criteria: BSPs can be build from master with no errors.'' | ||
| bgcolor="yellow" | There | | bgcolor="yellow" | | ||
- BSPs did not complete successfully. There were some issue in the actual build mostly centering around: | |||
-- Failing to do_kernel_checkout | |||
-- Unpack issues around svn://svn.o-hand.com/repos | |||
- Beagleboard failed doing runstrip on uboot during do_populate_sysroot | |||
|- | |- | ||
! scope="row" | Open Bugs | ! scope="row" | Open Bugs | ||
| All bugs dispositioned; Show-stoppers fixed | | All bugs dispositioned; Show-stoppers fixed | ||
''M4 (Gold) criteria: All bugs have been dispositioned. Bugs targeted for M4 have been fixed.'' | ''M4 (Gold) criteria: All bugs have been dispositioned. Bugs targeted for M4 have been fixed.'' | ||
| bgcolor="orange" | | | bgcolor="orange" | 76 total open defects targeted for 1.0 | ||
Critical: 0 | |||
High: 14 | |||
Medium: 53 | |||
Low: 7 | |||
Undetermined: 2 | |||
|- | |- | ||
! scope="row" | Functional Tests | ! scope="row" | Functional Tests | ||
| 100% of planned tests executed and all bugs are logged in bugzilla | | 100% of planned tests executed and all bugs are logged in bugzilla | ||
''M4 (Gold) criteria: All planned tests are executed and results are logged in bugzilla'' | ''M4 (Gold) criteria: All planned tests are executed and results are logged in bugzilla'' | ||
| bgcolor=" | | bgcolor="yellow" | - zypper-search failed on qemux-x86_64 on poky-image-lsb and poky-image-sato | ||
|- | |- | ||
! scope="row" | BSP Testing | ! scope="row" | BSP Testing | ||
| Line 58: | Line 71: | ||
''M4 (Gold) criteria: Goal above is reached.'' | ''M4 (Gold) criteria: Goal above is reached.'' | ||
| bgcolor="yellow" | Team is down to 97-98 minute builds. Richard will continue the analysis/tweak cycle; however, attention needs to go to other areas as well this week. File dependencies is one other low-hanging fruit item Richard would like to investigate. | | bgcolor="yellow" | Team is down to 97-98 minute builds. Richard will continue the analysis/tweak cycle; however, attention needs to go to other areas as well this week. File dependencies is one other low-hanging fruit item Richard would like to investigate. | ||
real 109m52.400s | |||
user 393m58.840s | |||
sys 59m25.380s | |||
|- | |- | ||
! scope="row" | Marketing requirements complete | ! scope="row" | Marketing requirements complete | ||
Revision as of 16:53, 28 February 2011
Yocto v1.0 Release Criteria
| Release Criteria | Target | Status |
|---|---|---|
| Functional Completion | All M1, M2, M3 functional features implemented by EO M3
M4 (Gold) Criteria: All features and BSPs are in build. |
see Yocto 1.0 Schedule#Stabilization Phase Features and Activities
Richard will send a note regarding the four open features. |
| Build and Release
(Yocto) |
Yocto 1.0 code builds reliably
M4 (Gold) criteria: All features in master can be built with no errors. |
Four issues:
- We had an issue with builder02 running out of disk space, so some of the build copying was done post-build. This did not effect the build and was dealt with manually after cleaning up the partition. - There is an issue with how package-index is being run. I will need to sync up with Jessica to verify how this should be incorporated into the build. - The sanity tests on builder02 failed because builder02 was unable to resolve "localhost". This has been corrected and the sanity tests re-run incrementally: http://autobuilder.pokylinux.org:8010/builders/nightly-internal-sanity/builds/3 - The tarball generation buildstep is not branch aware. This will be fixed this week. In the meantime it was run manually. |
| Build and Release
(BSPs) |
Yocto BSPs build reliably
M4 (Gold) criteria: BSPs can be build from master with no errors. |
- BSPs did not complete successfully. There were some issue in the actual build mostly centering around: -- Failing to do_kernel_checkout -- Unpack issues around svn://svn.o-hand.com/repos - Beagleboard failed doing runstrip on uboot during do_populate_sysroot |
| Open Bugs | All bugs dispositioned; Show-stoppers fixed
M4 (Gold) criteria: All bugs have been dispositioned. Bugs targeted for M4 have been fixed. |
76 total open defects targeted for 1.0
Critical: 0 High: 14 Medium: 53 Low: 7 Undetermined: 2 |
| Functional Tests | 100% of planned tests executed and all bugs are logged in bugzilla
M4 (Gold) criteria: All planned tests are executed and results are logged in bugzilla |
- zypper-search failed on qemux-x86_64 on poky-image-lsb and poky-image-sato |
| BSP Testing | 100% of planned BSP tests executed
M4 (Gold) criteria: All planned BSP tests are executed |
Team hasn't get been able to do a full BSP test pass. Open issues exist with respect to the BSPs (Julie). |
| Alpha Feedback | Alpha feedback included
M4 (Gold) criteria: Alpha begins Feb 11th and completes Feb 23rd |
Program completed. Someone just needs to parse final results. |
| Documentation | Release documentation created and published
M4 (Gold) criteria: M4 schedule items completed |
Yocto_1.0_Schedule#Documentation_Deliverables |
| Build Performance | Build takes 90 minutes (stretch goal = one hour) to do a complete rebuild of local sources of poky-image-sato on a developer's desktop. (The one we are using is: Intel(R) Core(TM) i7 CPU 940 @ 2.93GHz, 8 siblings, 4 cpu cores, total mem 6118644k, with: MACHINE=qemux86, BB_NUMBER_THREADS = "8", PARALLEL_MAKE = "-j 6", and only rpm packaging.)
M4 (Gold) criteria: Goal above is reached. |
Team is down to 97-98 minute builds. Richard will continue the analysis/tweak cycle; however, attention needs to go to other areas as well this week. File dependencies is one other low-hanging fruit item Richard would like to investigate.
real 109m52.400s user 393m58.840s sys 59m25.380s |
| Marketing requirements complete | Engineering requirements to the marketing plan are complete
M4 (Gold) criteria: Yocto demo is prepared for ELC. |
Hardware plan defined. Need videos. Need plexiglass boxes. Coding effort underway, but not complete. |
| Publication | Release and documentation are published on yoctoproject.org
M4 (Gold) criteria: Yocto Project 1.0 published and announced |
Tunnel Creek BSP Release Criteria
| Release Criteria | Target | Status |
|---|---|---|
| Development progress | Features implemented; Code completed | Coding completed |
| Build and Release | EMGD and non-EMGD BSPs build reliably | Build completed |
| Open Bugs | All bugs dispositioned; Show-stoppers fixed | Only minor bugs found (724, 725) |
| Functional Tests | 100% of planned tests executed | Tom tested. Jiajun will test Thursday. |
| Legal Compliance | All legal requirements met | Account is set up for click-through. Click-through team has info they need. |
| Documentation | Release Notes created and published | Scott/Tom are finalizing and things look good. |
| Performance | Performance targets achieved | This will be done out of cycle. |
| Publication | Release and documentation are published on yoctoproject.org | on-track |
Laverne Point Release Criteria
| Release Criteria | Target | Status |
|---|---|---|
| Development Progress | Coding complete | Coding completed |
| Build and Release | Code builds reliably | Release candidate is built. |
| Open Bugs | All bugs dispositioned; Show-stoppers fixed | No opens are show-stoppers. Open issues will be ID'd in release notes. |
| Functional Tests | 100% of planned tests executed | testing completed |
| Legal Compliance | All legal requirements met | tools run; requirements met |
| Performance | Performance targets achieved | N/A |
| Publication | Release and documentation are published on yoctoproject.org | Complete |
