Yocto Project v1.1 Release Criteria: Difference between revisions

From Yocto Project
Jump to navigationJump to search
 
(47 intermediate revisions by 2 users not shown)
Line 2: Line 2:


= Yocto Project 1.1 =  
= Yocto Project 1.1 =  
== Milestone 4 ==
{| border="1" {{table}}
| ! scope="col" bgcolor="grey" | '''Release Criteria''' || ! scope="col" bgcolor="grey" | '''Milestone 4 Target''' || ! scope="col" bgcolor="grey" | '''Milestone 4 Status'''
|-
| Functional Completion || A significant part of all the 1.1 Med+ bug fixes and BSPs are in the build. || bgcolor="" | [[File:Schedule-status-M4.png]]<br><br>see https://wiki.yoctoproject.org/wiki/Yocto_1.1_Schedule for details <br> Remaining Med+ bugs: [http://bugzilla.pokylinux.org/buglist.cgi?bug_severity=critical&bug_severity=major&bug_severity=normal&bug_severity=minor&bug_status=NEW&bug_status=ACCEPTED&bug_status=REOPENED&bug_status=NEEDINFO&bug_status=WaitForUpstream&columnlist=bug_severity%2Ctarget_milestone%2Cpriority%2Cop_sys%2Cassigned_to%2Cbug_status%2Cstatus_whiteboard%2Cshort_desc&priority=High&priority=Medium&query_format=advanced&target_milestone=---&target_milestone=1.1&target_milestone=1.1%20M1&target_milestone=1.1%20M2&target_milestone=1.1%20M3&target_milestone=1.1%20M4&order=bug_id%20DESC&query_based_on=1.1%20remaining%20bugs 1.1 remaining bugs (Med+)] Fixed 186 bugs as of 10/17/2011
|-
| Build and Release (Yocto) || All M4 bug fixes can be built with no errors. || bgcolor="#39FF14" | RC4 generated, full test complete, no show stoppers or major issues.
|-
| Build and Release (BSPs) || Core and meta-intel BSPs can be built with no errors. || bgcolor="#39FF14" | All BSPs build with no problem
|-
| Open Bugs || All bugs have been dispositioned.  High issues have been fixed. || bgcolor="#39FF14" | [http://bugzilla.yoctoproject.org/buglist.cgi?query_format=advanced&bug_severity=critical&bug_severity=major&bug_severity=normal&bug_severity=minor&bug_status=NEW&version=1.1] - 0 new bugs for 1.1.<br>[http://bugzilla.yoctoproject.org/buglist.cgi?bug_status=NEW&bug_status=ACCEPTED&bug_status=REOPENED&bug_status=NEEDINFO&bug_status=WaitForUpstream&columnlist=bug_severity%2Cpriority%2Ctarget_milestone%2Cop_sys%2Cassigned_to%2Cbug_status%2Cresolution%2Cshort_desc&priority=High&query_format=advanced&target_milestone=---&target_milestone=0.9%20M1&target_milestone=0.9%20M2&target_milestone=0.9%20M3&target_milestone=0.9%20M4&target_milestone=0.9.1&target_milestone=0.9.2&target_milestone=1.0%20M1&target_milestone=1.0%20M2&target_milestone=1.0%20M3&target_milestone=1.0%20M4&target_milestone=1.1&target_milestone=1.1%20M1&target_milestone=1.1%20M2&target_milestone=1.1%20M3&target_milestone=1.1%20M4&target_milestone=Q1&target_milestone=Q2&target_milestone=Q3&target_milestone=Q4&query_based_on= HIGH priority bugs] -  0 high bugs for 1.1 <br>See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
|-
| Functional Tests || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | Complete https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
| Distros Tested || Fedora, Ubuntu, Opensuse (N+1) || bgcolor="#39FF14" | Fedora 15, Ubuntu 11.04, Opensuse 11.4, Fedora 16 Alpha, Ubuntu 11.10 Alpha3, Opensuse 12.1 M5: Complete and all passed
|-
| BSP Testing || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | Complete https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
| Documentation || All documents listed in M4 feature list || bgcolor="#39FF14" | Doc pull request sent, complete
|-
| Build Performance || None || bgcolor="#39FF14" | N/A
|-
| Upstream Commits || Have upstream status updated on 90% of patches (so that we can have a status update) || bgcolor="#39FF14" | Complete
|-
| Marketing Deliverables || None || bgcolor="#39FF14" | N/A
|-
| Publication || Yocto 1.1 release is announced || bgcolor="#39FF14" | Complete
|}
== Milestone 3 ==
{| border="1" {{table}}
| ! scope="col" bgcolor="grey" | '''Release Criteria''' || ! scope="col" bgcolor="grey" | '''Milestone 3 Target''' || ! scope="col" bgcolor="grey" | '''Milestone 3 Status'''
|-
| Functional Completion || All M3 features and BSPs are in the build. || bgcolor="" | [[File:Schedule-status-M3.png]]<br><br>see https://wiki.yoctoproject.org/wiki/Yocto_1.1_Schedule for details
|-
| Build and Release (Yocto) || All M3 features can be built with no errors. || bgcolor="#39FF14" | RC3 generated, build is good with minor issues
|-
| Build and Release (BSPs) || Core and meta-intel BSPs can be built with no errors. || bgcolor="#39FF14" | RC3 generated, build is good with minor issues
|-
| Open Bugs || All bugs have been dispositioned.  High issues have been fixed. || bgcolor="#39FF14" | [http://bugzilla.yoctoproject.org/buglist.cgi?query_format=advanced&bug_status=NEW NEW bugs] - 0 new bugs for M3.<br>[http://bugzilla.yoctoproject.org/buglist.cgi?bug_status=NEW&bug_status=ACCEPTED&bug_status=REOPENED&bug_status=NEEDINFO&bug_status=WaitForUpstream&columnlist=bug_severity%2Cpriority%2Ctarget_milestone%2Cop_sys%2Cassigned_to%2Cbug_status%2Cresolution%2Cshort_desc&priority=High&query_format=advanced&target_milestone=---&target_milestone=0.9%20M1&target_milestone=0.9%20M2&target_milestone=0.9%20M3&target_milestone=0.9%20M4&target_milestone=0.9.1&target_milestone=0.9.2&target_milestone=1.0%20M1&target_milestone=1.0%20M2&target_milestone=1.0%20M3&target_milestone=1.0%20M4&target_milestone=1.1&target_milestone=1.1%20M1&target_milestone=1.1%20M2&target_milestone=1.1%20M3&target_milestone=1.1%20M4&target_milestone=Q1&target_milestone=Q2&target_milestone=Q3&target_milestone=Q4&query_based_on= HIGH priority bugs] - 1 high bugs for M3, already fixed <br>See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
|-
| Functional Tests || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | There are known problems, but we have fix in master. Bug trend is going to the right direction. WDD is down. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
| Distros Tested || Fedora, Ubuntu, Opensuse || bgcolor="#39FF14" | Fedora15 build failed, but fixed in master, Opensuse 11.4 and Ubuntu 11.04 pass.
|-
| BSP Testing || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | We are good here. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
| Documentation || None || bgcolor="#39FF14" |
|-
| Build Performance || RFC ready || bgcolor="#39FF14" | RFC sent
|-
| Upstream Commits || Have upstream status updated on 90% of patches (so that we can have a status update) || bgcolor="#39FF14" | Target met
|-
| Marketing Deliverables || None || bgcolor="#39FF14" |
|-
| Publication || M3 release is announced || bgcolor="#39FF14" | Complete
|}
== Milestone 2 ==
{| border="1" {{table}}
| ! scope="col" bgcolor="grey" | '''Release Criteria''' || ! scope="col" bgcolor="grey" | '''Milestone 2 Target''' || ! scope="col" bgcolor="grey" | '''Milestone 2 Status'''
|-
| Functional Completion || All M2 features and BSPs are in the build. || bgcolor="" | [[File:Schedule-status-M2.png]]<br><br>see https://wiki.yoctoproject.org/wiki/Yocto_1.1_Schedule for details
|-
| Build and Release (Yocto) || All M2 features can be built with no errors. || bgcolor="#39FF14" | M2 RC3 generated, pulled in as many features as possible
|- Working
| Build and Release (BSPs) || Core and meta-intel BSPs can be built with no errors. || bgcolor="#39FF14" | Target met
|-
| Open Bugs || All bugs have been dispositioned.  High issues have been fixed. || bgcolor="#39FF14" | [http://bugzilla.yoctoproject.org/buglist.cgi?query_format=advanced&bug_status=NEW NEW bugs] - No new bugs for M2.<br>[http://bugzilla.yoctoproject.org/buglist.cgi?bug_status=NEW&bug_status=ACCEPTED&bug_status=REOPENED&bug_status=NEEDINFO&bug_status=WaitForUpstream&columnlist=bug_severity%2Cpriority%2Ctarget_milestone%2Cop_sys%2Cassigned_to%2Cbug_status%2Cresolution%2Cshort_desc&priority=High&query_format=advanced&target_milestone=---&target_milestone=0.9%20M1&target_milestone=0.9%20M2&target_milestone=0.9%20M3&target_milestone=0.9%20M4&target_milestone=0.9.1&target_milestone=0.9.2&target_milestone=1.0%20M1&target_milestone=1.0%20M2&target_milestone=1.0%20M3&target_milestone=1.0%20M4&target_milestone=1.1&target_milestone=1.1%20M1&target_milestone=1.1%20M2&target_milestone=1.1%20M3&target_milestone=1.1%20M4&target_milestone=Q1&target_milestone=Q2&target_milestone=Q3&target_milestone=Q4&query_based_on= HIGH priority bugs] - no high bugs for M2<br>See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
|-
| Functional Tests || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | Target met. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
| Distros Tested || Fedora, Ubuntu, Opensuse || bgcolor="#39FF14" | Fedora15, Opensuse 11.4 and Ubuntu 11.04.
|-
| BSP Testing || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | Target met. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
| Documentation || A reviewable draft of the Yocto Project Development Guide. || bgcolor="#39FF14" | On Track
|-
| Build Performance || Improving build performance. || bgcolor="#39FF14" | Some degradation due to many features integrated. Risk understood, has plan for improvement in M3
|-
| Upstream Commits || Have upstream status updated on 90% of patches (so that we can have a status update) || bgcolor="#39FF14" | Status updated, target met.
|-
| Marketing Deliverables || None || bgcolor="#39FF14" |
|-
| Publication || M2 release is announced || bgcolor="#39FF14" | Announced to the public via yoctoproject.org mailing list
|}
== Milestone 1 ==
{| border="1" {{table}}
{| border="1" {{table}}
| ! scope="col" bgcolor="grey" | '''Release Criteria''' || ! scope="col" bgcolor="grey" | '''Milestone 1 Target''' || ! scope="col" bgcolor="grey" | '''Milestone 1 Status'''
| ! scope="col" bgcolor="grey" | '''Release Criteria''' || ! scope="col" bgcolor="grey" | '''Milestone 1 Target''' || ! scope="col" bgcolor="grey" | '''Milestone 1 Status'''
Line 11: Line 99:
| Build and Release (BSPs) || Core and meta-intel BSPs can be built with no errors. || bgcolor="#39FF14" | Build pulled in all fixes possible.
| Build and Release (BSPs) || Core and meta-intel BSPs can be built with no errors. || bgcolor="#39FF14" | Build pulled in all fixes possible.
|-
|-
| Open Bugs || All bugs have been dispositioned.  High issues have been fixed. || bgcolor="#39FF14" | [http://bugzilla.yoctoproject.org/buglist.cgi?query_format=advanced&bug_status=NEW NEW bugs] - 2 unaccepted New bugs for 1.1 M1<br>[http://bugzilla.yoctoproject.org/buglist.cgi?bug_status=NEW&bug_status=ACCEPTED&bug_status=REOPENED&bug_status=NEEDINFO&bug_status=WaitForUpstream&columnlist=bug_severity%2Cpriority%2Ctarget_milestone%2Cop_sys%2Cassigned_to%2Cbug_status%2Cresolution%2Cshort_desc&priority=High&query_format=advanced&target_milestone=---&target_milestone=0.9%20M1&target_milestone=0.9%20M2&target_milestone=0.9%20M3&target_milestone=0.9%20M4&target_milestone=0.9.1&target_milestone=0.9.2&target_milestone=1.0%20M1&target_milestone=1.0%20M2&target_milestone=1.0%20M3&target_milestone=1.0%20M4&target_milestone=1.1&target_milestone=1.1%20M1&target_milestone=1.1%20M2&target_milestone=1.1%20M3&target_milestone=1.1%20M4&target_milestone=Q1&target_milestone=Q2&target_milestone=Q3&target_milestone=Q4&query_based_on= HIGH priority bugs] - no HIGH priority bugs for 1.1 M1<br>See trend chart at https://wiki.pokylinux.org/wiki/Yocto_Bug_Trend.
| Open Bugs || All bugs have been dispositioned.  High issues have been fixed. || bgcolor="#39FF14" | [http://bugzilla.yoctoproject.org/buglist.cgi?query_format=advanced&bug_status=NEW NEW bugs] - 1 unaccepted New bugs for 1.1 M1.<br>[http://bugzilla.yoctoproject.org/buglist.cgi?bug_status=NEW&bug_status=ACCEPTED&bug_status=REOPENED&bug_status=NEEDINFO&bug_status=WaitForUpstream&columnlist=bug_severity%2Cpriority%2Ctarget_milestone%2Cop_sys%2Cassigned_to%2Cbug_status%2Cresolution%2Cshort_desc&priority=High&query_format=advanced&target_milestone=---&target_milestone=0.9%20M1&target_milestone=0.9%20M2&target_milestone=0.9%20M3&target_milestone=0.9%20M4&target_milestone=0.9.1&target_milestone=0.9.2&target_milestone=1.0%20M1&target_milestone=1.0%20M2&target_milestone=1.0%20M3&target_milestone=1.0%20M4&target_milestone=1.1&target_milestone=1.1%20M1&target_milestone=1.1%20M2&target_milestone=1.1%20M3&target_milestone=1.1%20M4&target_milestone=Q1&target_milestone=Q2&target_milestone=Q3&target_milestone=Q4&query_based_on= HIGH priority bugs] - no HIGH priority bugs for 1.1 M1<br>See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
|-
|-
| Functional Tests || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="yellow" | Test pass in progress
| Functional Tests || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
|-
| Distros Tested || Fedora, Ubuntu, Opensuse || bgcolor="#39FF14" | Fedora 14, Ubuntu 11.04, Opensuse 11.4
| Distros Tested || Fedora, Ubuntu, Opensuse || bgcolor="#39FF14" | Fedora 14, Ubuntu 11.04, Opensuse 11.4
|-
|-
| BSP Testing || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="yellow" | Test pass in progress
| BSP Testing || 100% of planned tests are executed and results are logged in bugzilla. || bgcolor="#39FF14" | https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
|-
|-
| Documentation || M1 documentation deliverables are complete. || bgcolor="#39FF14" | Only deliverable is allowing documentation to be updated even after code freeze.  On-track.
| Documentation || M1 documentation deliverables are complete. || bgcolor="#39FF14" | Only deliverable is allowing documentation to be updated even after code freeze.  On-track.
Line 27: Line 115:
| Marketing Deliverables || Giveaway plans defined || bgcolor="#39FF14" | At least one giveaway plan has been defined and is in the process of being implemented.
| Marketing Deliverables || Giveaway plans defined || bgcolor="#39FF14" | At least one giveaway plan has been defined and is in the process of being implemented.
|-
|-
| Publication || M1 release is announced ||
| Publication || M1 release is announced ||bgcolor="#39FF14" | Complete
|}
|}

Latest revision as of 17:49, 26 October 2011

The Release Criteria for the various Yocto Project 1.1 releases are below.

Yocto Project 1.1

Milestone 4

Release Criteria Milestone 4 Target Milestone 4 Status
Functional Completion A significant part of all the 1.1 Med+ bug fixes and BSPs are in the build. Schedule-status-M4.png

see https://wiki.yoctoproject.org/wiki/Yocto_1.1_Schedule for details
Remaining Med+ bugs: 1.1 remaining bugs (Med+) Fixed 186 bugs as of 10/17/2011
Build and Release (Yocto) All M4 bug fixes can be built with no errors. RC4 generated, full test complete, no show stoppers or major issues.
Build and Release (BSPs) Core and meta-intel BSPs can be built with no errors. All BSPs build with no problem
Open Bugs All bugs have been dispositioned. High issues have been fixed. [1] - 0 new bugs for 1.1.
HIGH priority bugs - 0 high bugs for 1.1
See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
Functional Tests 100% of planned tests are executed and results are logged in bugzilla. Complete https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Distros Tested Fedora, Ubuntu, Opensuse (N+1) Fedora 15, Ubuntu 11.04, Opensuse 11.4, Fedora 16 Alpha, Ubuntu 11.10 Alpha3, Opensuse 12.1 M5: Complete and all passed
BSP Testing 100% of planned tests are executed and results are logged in bugzilla. Complete https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Documentation All documents listed in M4 feature list Doc pull request sent, complete
Build Performance None N/A
Upstream Commits Have upstream status updated on 90% of patches (so that we can have a status update) Complete
Marketing Deliverables None N/A
Publication Yocto 1.1 release is announced Complete

Milestone 3

Release Criteria Milestone 3 Target Milestone 3 Status
Functional Completion All M3 features and BSPs are in the build. Schedule-status-M3.png

see https://wiki.yoctoproject.org/wiki/Yocto_1.1_Schedule for details
Build and Release (Yocto) All M3 features can be built with no errors. RC3 generated, build is good with minor issues
Build and Release (BSPs) Core and meta-intel BSPs can be built with no errors. RC3 generated, build is good with minor issues
Open Bugs All bugs have been dispositioned. High issues have been fixed. NEW bugs - 0 new bugs for M3.
HIGH priority bugs - 1 high bugs for M3, already fixed
See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
Functional Tests 100% of planned tests are executed and results are logged in bugzilla. There are known problems, but we have fix in master. Bug trend is going to the right direction. WDD is down. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Distros Tested Fedora, Ubuntu, Opensuse Fedora15 build failed, but fixed in master, Opensuse 11.4 and Ubuntu 11.04 pass.
BSP Testing 100% of planned tests are executed and results are logged in bugzilla. We are good here. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Documentation None
Build Performance RFC ready RFC sent
Upstream Commits Have upstream status updated on 90% of patches (so that we can have a status update) Target met
Marketing Deliverables None
Publication M3 release is announced Complete

Milestone 2

Release Criteria Milestone 2 Target Milestone 2 Status
Functional Completion All M2 features and BSPs are in the build. Schedule-status-M2.png

see https://wiki.yoctoproject.org/wiki/Yocto_1.1_Schedule for details
Build and Release (Yocto) All M2 features can be built with no errors. M2 RC3 generated, pulled in as many features as possible
Build and Release (BSPs) Core and meta-intel BSPs can be built with no errors. Target met
Open Bugs All bugs have been dispositioned. High issues have been fixed. NEW bugs - No new bugs for M2.
HIGH priority bugs - no high bugs for M2
See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
Functional Tests 100% of planned tests are executed and results are logged in bugzilla. Target met. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Distros Tested Fedora, Ubuntu, Opensuse Fedora15, Opensuse 11.4 and Ubuntu 11.04.
BSP Testing 100% of planned tests are executed and results are logged in bugzilla. Target met. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Documentation A reviewable draft of the Yocto Project Development Guide. On Track
Build Performance Improving build performance. Some degradation due to many features integrated. Risk understood, has plan for improvement in M3
Upstream Commits Have upstream status updated on 90% of patches (so that we can have a status update) Status updated, target met.
Marketing Deliverables None
Publication M2 release is announced Announced to the public via yoctoproject.org mailing list

Milestone 1

Release Criteria Milestone 1 Target Milestone 1 Status
Functional Completion All M1 features and BSPs are in the build. Schedule-status.PNG
All desired features are in build. One documentation publishing fix remains.
see https://wiki.yoctoproject.org/wiki/Yocto_1.1_Schedule for details
Build and Release (Yocto) All M1 features can be built with no errors. Build pulled in all fixes possible.
Build and Release (BSPs) Core and meta-intel BSPs can be built with no errors. Build pulled in all fixes possible.
Open Bugs All bugs have been dispositioned. High issues have been fixed. NEW bugs - 1 unaccepted New bugs for 1.1 M1.
HIGH priority bugs - no HIGH priority bugs for 1.1 M1
See trend chart at https://wiki.yoctoproject.org/wiki/Yocto_Bug_Trend.
Functional Tests 100% of planned tests are executed and results are logged in bugzilla. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Distros Tested Fedora, Ubuntu, Opensuse Fedora 14, Ubuntu 11.04, Opensuse 11.4
BSP Testing 100% of planned tests are executed and results are logged in bugzilla. https://wiki.yoctoproject.org/wiki/Yocto_1.1_Milestone_Test_Report
Documentation M1 documentation deliverables are complete. Only deliverable is allowing documentation to be updated even after code freeze. On-track.
Build Performance Plan for improving performance is defined. Performance goals for M1 (mostly planning goals) were met. See schedule for details.
Build is at 102 minutes.
Upstream Commits Have upstream status updated on 90% of patches (so that we can have a status update) At 85%, which is good enough for alpha.
Marketing Deliverables Giveaway plans defined At least one giveaway plan has been defined and is in the process of being implemented.
Publication M1 release is announced Complete
Retrieved from "https://wiki.yoctoproject.org/wiki/index.php?title=Yocto_Project_v1.1_Release_Criteria&oldid=3873"