Weekly Status: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(711 intermediate revisions by 4 users not shown)
Line 1: Line 1:
== Yocto Project Weekly Status March 5, 2018 ==
== Yocto Project Weekly Status April 16th, 2024 ==
Current Dev Position: YP 5.0 preparing to build rc2 <br/>
Next Deadline: 1st April 2024 YP 5.0 M4 build<br/>


Current Dev Position: YP 2.5 M3 final close out. <br/>
'''Next Team Meetings:'''<br/>
Next Deadline: YP 2.5 M3 cut off was 2/19/18
*Bug Triage meeting Thursday April 11th at 7:30 am PDT (https://zoom.us/j/454367603?pwd=ZGxoa2ZXL3FkM3Y0bFd5aVpHVVZ6dz09)
*Weekly Engineering Sync Tuesday April 9th at 8 am PDT (https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09)
*Twitch -  See https://www.twitch.tv/theyoctojester


''' FEATURE FREEZE for 2.5 has passed '''
'''Key Status/Updates:'''<br/>
*YP 5.0 rc1 is building but has many (6+) failures in the build so will have to be abandoned.
*The final dunfell build will follow 5.0 into QA.
*The master branch has diverged from scarthgap.
*For 5.0, we were able to switch to the new hash equivalence server however the need for websockets complicated the worker configuration and needed new buildtools tarball versions which are causing various problems.
*During the rc1 build as well as pip and setuptools issues within buildtools, we also saw a qemuppc boot issue, an instance of the spdx dependency problem, an sstate mirror issue and a github network error. This highlights how important fixing these is over the release cycle. The volume of these may impact our ability to maintain the LTS.
*Thanks to everyone who sent documentation patches, we’re in much better shape with the migration guide and release notes now. Further improvements are still very welcome.
*The “Binary Distro” work is now well underway and there are PR Server passthrough and image testing patches under review. The wiki page has had a number of policy/process proposals documented, help is welcome to help improve these, or highlight where further documentation is needed.
*There are patches for improving the build performance graphs in review. Sample output from the changes is here and here.
*There are also patches under review for the patch/cve metrics page to improve the usability.
*We continue to watch the NIST NVD (CVE database) situation, the recent update didn’t clarify much. Unfortunately there doesn’t appear to be a clear path forward as yet but using data directly from MITRE may help give partial information. These issues are making it hard to know what to include in the 5.0 release as it isn’t clear which changes are security related.


SWAT team rotation: Rebecca -> Cal on March 9, 2018 <br/>
'''Ways to contribute:'''<br/>
SWAT team rotation: Cal -> Armin on March 16, 2018 <br/>
*As people are likely aware, the project has a number of components which are either unmaintained, or have people with little to no time trying to keep them alive. These components include: devtool, toaster, wic, oeqa, autobuilder, CROPs containers, pseudo and more. Many have open bugs. Help is welcome in trying to better look after these components!
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
*There are bugs identified as possible for newcomers to the project: https://wiki.yoctoproject.org/wiki/Newcomers
*There are bugs that are currently unassigned for YP 5.0. See: https://wiki.yoctoproject.org/wiki/Bug_Triage#Medium+_5.0_Unassigned_Enhancements/Bugs
*We’d welcome new maintainers for recipes in OE-Core. Please see the list at: http://git.yoctoproject.org/cgit.cgi/poky/tree/meta/conf/distro/include/maintainers.inc and discuss with the existing maintainer, or ask on the OE-Core mailing list. We will likely move a chunk of these to “Unassigned” soon to help facilitate this.
*Help is very much welcome in trying to resolve our autobuilder intermittent issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT.
*Help us resolve CVE issues: CVE metrics
*We have a growing number of bugs in bugzilla, any help with them is appreciated.


'''Key Status/Updates:'''
'''YP 5.0 Milestone Dates:'''<br/>
YP 2.5 M2 was released February 27.
*YP 5.0 is building
This milestone release includes CVE fixes and 60 recipe upgrades.  It incorporates security fixes with upgrades to gcc and kernels to all current stable versions.  Headline changes include reproducibility improvements, gettext build performance, image generation, and cmake using Ninja by default.  This release added gobject-introspection tests to testimage, integrated support for the Meson build system, Python build/packaging refactoring, and redesigned postinstall script handling.
*YP 5.0 M4 Release date 2024/04/30
YP 2.2.3 was released February 27.
A total of 97 CVE fixes and other fixes to work with GCC 7 on newer host OSs.
We have committed to a 2.2.4 release to integrate all remaining security fixes.
YP 2.4.2 RC2 came out of QA today (report at https://wiki.yoctoproject.org/wiki/WW10_-_2018-03-05-_Full_Test_Cycle_-_2.4.2_rc2)
YP 2.5 M3 is in final feature freeze. Reviewing last week’s required features:
2.27 glibc upgrade has been merged. This meant making SDK changes so they’re all ~50M larger now thanks to the need to ship locales. However the same underlying code could be reused to generate locale archives in images, which will make those smaller.
kernel-devsrc size reduction: the blocking issue has been resolved so waiting for an updated patch.
pseudo upgrade has been merged which should solve many issues, and Peter is investigating the long-standing host contamination issue.
Still need to resolve the multilib SDK patch series.
Package feed filtering has been merged.
Image EFI configuration rework under review now.
Performance metrics indicate that a recent merge has caused a slowdown in build times.  It is suspected that the glibc upgrade is the cause of this although help would be appreciated to verify this.
Flood of last-minute upgrades continuing to be reviewed and merged if low-impact.
Go upgrade/improvements are under review, possibly we’ll ship both Go 1.9.4 and 1.10 in 2.5 but do plan to drop 1.9.4 from master as soon as 1.10 doesn’t present compatibility problems.
We’re continuing to work on the autobuilder changes and for various reasons (inc. changes in people).  We would be in much better shape to switch to the new codebase before release, rather than waiting until early 2.6 to pick this work up again by which time we’d have lost people and context. If we are to switch, we need to build M3 with the new infrastructure. We plan to make this switch for M3.


Planned upcoming dot releases:
'''YP 5.1 Proposed Milestone Dates:'''<br/>
YP 2.3.4 (Pyro) will be built when we figure out gcc backports.
*YP 5.1 M1 Build date 2024-05-20
YP 2.2.4 (Morty) will be built when we figure out gcc backports.
*YP 5.1 M1 Release date 2024-05-31
YP 2.4.3 (Roko) is planned for post YP 2.5.
*YP 5.1 M2 Build date 2024-07-08
*YP 5.1 M2 Release date 2024-07-19
*YP 5.1 M3 Build date 2024-08-26
*YP 5.1 M3 Release date 2024-09-06
*YP 5.1 M4 Build date 2024-09-30
*YP 5.1 M4 Release date 2024-10-25


Key YP 2.5 Dates are:
'''Upcoming dot releases:'''<br/>
YP 2.5 M3 is in feature freeze. See status above.
*YP 4.3.4 is released.
YP 2.5 M3 was scheduled for release 3/2/18
*YP 3.1.33 build date 2024-04-15
YP 2.5 M4 cut off of 4/2/18
*YP 3.1.33 Release date 2024-04-26
YP 2.5 M4 release of 4/27/18
*YP 4.0.18 build date 2024-04-22
*YP 4.0.18 Release date 2024-05-03
*YP 4.0.19 build date 2024-06-03
*YP 4.0.19 Release date 2024-06-14


Tracking Metrics:
'''Upcoming Proposed dot releases:'''<br/>
WDD 2663 (last week 2646)
*YP 5.0.1 Build Date 2024-05-13
(https://wiki.yoctoproject.org/charts/combo.html)
*YP 5.0.1 Release Date 2024-05-24
*YP 5.0.2 Build Date 2024-06-24
*YP 5.0.2 Release Date 2024-07-05
*YP 4.0.20 Build Date 2024-07-15
*YP 4.0.20 Release Date 2024-07-26
*YP 5.0.3 Build Date 2024-08-12
*YP 5.0.3 Release Date 2024-08-23
*YP 4.0.21 Build Date 2024-09-09
*YP 4.0.21 Release Date 2024-09-20
*YP 5.0.4 Build Date 2024-09-23
*YP 5.0.4 Release Date 2024-10-04
*YP 4.0.22 Build Date 2024-10-14
*YP 4.0.22 Release Date 2024-10-25
*YP 5.0.5 Build Date 2024-11-11
*YP 5.0.5 Release Date 2024-11-22
*YP 4.0.23 Build Date 2024-11-18
*YP 4.0.23 Release Date 2024-11-29


Key Status Links for YP:
'''Tracking Metrics:'''<br/>
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
*WDD 2719 (last week 2696) (https://wiki.yoctoproject.org/charts/combo.html)
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
*OE-Core/Poky Patch Metrics
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
**Total patches found: 1173 (last week 1174)
**Patches in the Pending State: 249 (21%) [last week 249 (21%)]
*https://autobuilder.yocto.io/pub/non-release/patchmetrics/


The Status reports are now stored on the wiki at: https://wiki.yoctoproject.org/wiki/Weekly_Status
'''The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:'''<br/>
https://wiki.yoctoproject.org/wiki/TSC<br/>


[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
== Archives ==
 
*[[2024 Yocto Project Weekly Status Archive]]
== Yocto Project Weekly Status Feb. 26, 2018 ==
*[[2023 Yocto Project Weekly Status Archive]]
 
*[[2022 Yocto Project Weekly Status Archive]]
Current Dev Position: YP 2.5 M3 development
*[[2021 Yocto Project Weekly Status Archive]]
Next Deadline: YP 2.5 M3 cut off was 2/19/18
*[[2020 Yocto Project Weekly Status Archive]]
 
*[[2019 Yocto Project Weekly Status Archive]]
''' FEATURE FREEZE for 2.5 has passed '''
*[[2018 Yocto Project Weekly Status Archive]]
 
SWAT team rotation: Stephano -> Maxin John on Feb. 23, 2018
SWAT team rotation: Maxin -> Rebecca on March 2, 2018
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
YP 2.5 M2 is through QA and likely to be released early this week.
YP 2.2.3 is through QA and likely to be released early this week.
YP 2.4.2 rc2 was successfully built and is undergoing QA.
YP 2.5 M3 is feature freeze. After discussions with various people we concluded that we need:
the 2.27 glibc upgrade
kernel-devsrc size changes
to resolve some of the outstanding pseudo bugs
to resolve the multilib SDK patch series
the package feed filtering patch series (the multilib SDK series depends on it)
image EFI configuration rework
We plan to defer:
pkg-conf vs. pkgconfig issues/discussion
profile guided optimisation for python (patch series)
oe-selftest parallelization
We’re continuing to work on the autobuilder changes and for various reasons (inc. changes in people).  We would be in much better shape to switch to the new codebase before release, rather than waiting until early 2.6 to pick this work up again by which time we’d have lost people and context. If we are to switch, we need to build M3 with the new infrastructure. We’ll have to make a decision on whether we do this during this week.
 
Planned upcoming dot releases:
YP 2.4.2 (Rocko) is currently in QA 82% complete.  See: https://wiki.yoctoproject.org/wiki/2.4_QA_Status
YP 2.3.4 (Pyro) will be built when we figure out gcc backports.
YP 2.2.3 (Morty) rc2 has passed QA and is being prepared for release
YP 2.2.4 (Morty) will be built when we figure out gcc backports.
 
Key YP 2.5 Dates are:
YP 2.5 M2 has passed QA and is being prepared for release.
YP 2.5 M3 is in feature freeze.  See status above.
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics:
WDD 2646 (last week  2648)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
The Status reports are now stored on the wiki at: https://wiki.yoctoproject.org/wiki/Weekly_Status
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Feb. 20, 2018 ==
 
Current Dev Position: YP 2.5 M3 development
Next Deadline: YP 2.5 M3 cut off was 2/19/18
 
'''FEATURE FREEZE for 2.5 is imminent!'''
 
SWAT team rotation: Tracy -> Stephano on Feb. 16, 2018.
SWAT team rotation: Stephano -> Maxin John on Feb. 23, 2018
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
YP 2.5 M2 is 97% through QA. See: https://wiki.yoctoproject.org/wiki/2.5_QA_Status
YP 2.2.3 is also mostly through QA. See https://wiki.yoctoproject.org/wiki/2.2_QA_Status
We build 2.4.2 rc1 however rapidly moving kernel updates combined with QA not having started on rc1 yet meant we decided to build rc2, pulling in further kernel security fixes (as well as others like openssl). rc2 is currently being built and should enter QA today assuming a successful build.
autobuilder.yoctoproject.org continues to be unavailable as we continue to develop the new autobuilder codebase to replace the current heavily customized buildbot one.
We managed to shrink the ltp package size which unblocked some patch merging. Bruce has been working on changes to kernel-devsrc to significantly reduce its size.
The glibc change continues to be blocked on locale issues which may prove tricky to resolve and will block M3 as we need the glibc upgrade for various reasons.
We have some key decisions to make about the conflicting native of pkg-conf and pkgconfig. Maxin has a patch series which exposes the issues.
There are problems with the changes to pseudo’s master branch verses the patches we have against the recipe.
Please note that we are very close to M3 which is feature freeze, technically, feature freeze was yesterday. We’re not in a position to build M3 yet but if there are features you expect to see in 2.5, please highlight those patches ASAP. We are drawing up a list of “must haves” for the release and if we don’t know about it, it likely won’t be on it.
 
Planned upcoming dot releases:
YP 2.4.2 (Rocko) is currently being built and should enter QA today.
YP 2.3.4 (Pyro) will be built when we figure out gcc backports.
YP 2.2.3 (Morty) rc2 is in QA.
YP 2.2.4 (Morty) will be built when we figure out gcc backports.
 
Key YP 2.5 Dates are:
YP 2.5 M2 cut off is past, it is in QA.
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics:
WDD 2648 (last week  2610)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
The Status reports are now stored on the wiki at: https://wiki.yoctoproject.org/wiki/Weekly_Status
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Feb. 12, 2018 ==
 
Current Dev Position: YP 2.5 M3 development
Next Deadline: YP 2.5 M3 cut off is 2/19/18
 
SWAT team rotation: Paul -> Tracy on Feb. 9, 2018.
SWAT team rotation: Tracy -> Stephano on Feb. 16, 2018.
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
YP 2.5 M2 is currently undergoing QA and nearly complete. See: https://wiki.yoctoproject.org/wiki/2.5_QA_Status
YP 2.2.3 is also mostly through QA. See https://wiki.yoctoproject.org/wiki/2.2_QA_Status.
Holidays mean that QA is slowed, we will QA 2.4.2 as soon as they return.
autobuilder.yoctoproject.org continues to be unavailable as we continue to develop the new autobuilder codebase to replace the current heavily customized buildbot one.
Some positive performance news is that by removing the “fetchall” and “checkuriall” tasks, we were able to take “bitbake core-image-sato -g” from 20s to around 8s. The speedup comes from the runqueue calculation so most builds will benefit from this speedup. The tasks are replaced by a dedicated bitbake option, --runall=<taskname>.
Kernel updates have been blocked as some image sizes have overflowed the maximum allowed image sizes. We’re working on figuring out how to resolve that, likely by stripping ltp and/or optimising the kernel-devsrc recipe if possible.
The glibc change is blocked on various build failures the code seems to trigger as well as issues with gplv2 vs gplv3 patches for meta-gplv2.
 
Planned upcoming dot releases:
YP 2.4.2 (Rocko) will be built shortly, once there is QA bandwidth available.
YP 2.3.4 (Pyro) will be built when we figure out gcc backports.
YP 2.2.3 (Morty) rc2 is in QA.
YP 2.2.4 (Morty) will be built when we figure out gcc backports.
 
Key YP 2.5 Dates are:
YP 2.5 M2 cut off is past, it is in QA.
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics: WDD 2610 (last week 2638)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
The Status reports are now stored on the wiki at: https://wiki.yoctoproject.org/wiki/Weekly_Status
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Feb. 5, 2018 ==
 
Current Dev Position: YP 2.5 M3 development
Next Deadline: YP 2.5 M3 cut off was 2/19/18
 
SWAT team rotation: Juro -> Paul on Feb. 2, 2018.
SWAT team rotation: Paul -> Tracy on Feb. 9, 2018.
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
YP 2.5 M2 has been built and is pending QA. The M2 milestone contains the linux-yocto kernel backports and gcc upgrade for the spectre and meltdown security issues.
YP 2.2.3 is mostly through QA, some issues have been identified with newer host distro releases; however, these are likely something we’d address with 2.2.4.
autobuilder.yoctoproject.org continues to be unavailable as we continue to develop the new autobuilder codebase to replace the current heavily customized buildbot one.
There are some changes to runqueue in bitbake about to land (currently in -next) which bring some risk of dependency problems in recrdeptask and recideptask handling, it's worth keeping in mind if task dependencies issues appear shortly after those merge.
 
Planned upcoming dot releases:
YP 2.4.2 (Rocko) will be built shortly, once there is QA bandwidth available.
YP 2.3.4 (Pyro) will be built when a stable version of the spectre/meltdown patches are ready.
YP 2.2.3 (Morty) rc2 is in QA, see https://wiki.yoctoproject.org/wiki/2.2_QA_Status.  This will not contain the spectre/meltdown patches as they’re not ready yet.
 
Key YP 2.5 Dates are:
YP 2.5 M2 cut off is past, it is in QA.
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics:
WDD 2638 (last week 2630)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
The Status reports are now stored on the wiki at: https://wiki.yoctoproject.org/wiki/Weekly_Status
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Jan. 29, 2018 ==
 
Current Dev Position: YP 2.5 M2 development
Next Deadline: YP 2.5 M2 cut off was 1/15/18
 
SWAT team rotation: Ross -> Juro on Jan. 26, 2018.
SWAT team rotation: Juro -> Tracy on Feb. 2, 2018.
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
YP 2.5 M1 rc3 was released.
Fixes for spectre and meltdown are in master and also in the rocko branches for both gcc (updated to 7.3) and linux-yocto.
We will likely consolidate a few further patches (such as genericx86 and other meta-yotcto-bsp updates) and then build and QA both 2.5 M2 and 2.4.2.
Work on the autobuilder changes continues but means autobuilder.yoctoproject.org is not being used in production (autobuilder.yocto.io aka ‘the new cluster’) is.
There were a number of lock related issues with the yocto.io builder over the weekend which are being investigated.
 
Planned upcoming dot releases:
YP 2.4.2 (Rocko) will be built shortly.
YP 2.3.4 (Pyro) will be built when a stable version of the spectre/meltdown patches are ready.
YP 2.2.3 (Morty) rc1 is in QA, see https://wiki.yoctoproject.org/wiki/2.2_QA_Status.  This will not contain the spectre/meltdown patches as they’re not ready yet.
 
Key YP 2.5 Dates are:
YP 2.5 M2 cut off is past, it should be built shortly.
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics: WDD 2630 (last week 2657)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Jan. 22, 2018 ==
 
Current Dev Position: YP 2.5 M2 development
Next Deadline: YP 2.5 M2 cut off was 1/15/18
 
SWAT team rotation: Armin -> Ross on Jan. 19, 2018.
SWAT team rotation: Ross -> Juro on Jan. 26, 2018.
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
YP 2.5 M1 rc3 is out of QA and should be released imminently. There were some minor issues but we’ll address these as part of M2. See: https://wiki.yoctoproject.org/wiki/WW03_-_2018-1-18-_Full_Test_Cycle_-_2.5_M1_rc3 and see: https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status#Milestone_1_-_Target_Dec._15.2C_2017
With a round of security released fixes likely to land shortly, we’ll likely wait for these before we roll M2.
The Automatic Upgrade Helper (AUH) ran, now based on devtool functionality and testing against a wider set of architectures and build options. This looks likely to easy recipe maintenance and increase productivity for people and I’d like to thank Alex for his work on this. There is much it could do better but it is continuing to evolve and become easier to use which is great to see.
The AUH emails have triggered a good batch of recipe upgrades. QEMU was also upgraded (which can often cause problems).
I sent out a separate summary of changes which are happening to the Autobuilder, people on the SWAT team need to be especially aware of this http://lists.openembedded.org/pipermail/openembedded-architecture/2018-January/000694.html
The long queued python recipe changes including its manifest have landed. We tested this as far as we could in core and I know there is some fall out in other layers, help and patience to work through the issues is appreciated. Patches pending against the python recipes will need to be rebased and resent.
There have been some significant changes to cmake, ninja and meson and meson is now the default for some recipes. There were some significant gettext cleanups.
 
Planned upcoming dot releases:
YP 2.4.2 (Rocko) will be built when a stable version of the spectre/meltdown patches are ready.
YP 2.3.4 (Pyro) will be built when a stable version of the spectre/meltdown patches are ready.
YP 2.2.3 (Morty) rc1 is in QA, see https://wiki.yoctoproject.org/wiki/2.2_QA_Status.  This will not contain the spectre/meltdown patches as they’re not ready yet.
 
Key YP 2.5 Dates are:
YP 2.5 M2 cut off is past, it should be built as soon as a decision on the spectre/meltdown patches is made.
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics:
WDD 2657 (last week 2672)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Jan. 16, 2018 ==
 
Current Dev Position: YP 2.5 M2 development
Next Deadline: YP 2.5 M2 cut off was 1/15/18
 
SWAT team rotation: Joshua -> Armin on Jan. 12, 2018.
SWAT team rotation: Armin -> Ross on Jan. 19, 2018.
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
• 2.3.3 and 2.4.1 were released. These releases do not contain spectre/meltdown patches/fixes as those are still being worked on and haven’t merged yet.
• We are mostly up to date with patch queues although there are some bigger series which are still being tested/reviewed and are still pending
• Due to testing problems with 2.5 M1 rc3, it is still undergoing QA testing and is 90% complete. We are continuing to have some QA transition/infrastructure issues. See: https://wiki.yoctoproject.org/wiki/2.5_QA_Status.
• A separate update on the spectre/meltdown status and the project has been sent out to the oe-core mailing list.
 
Planned upcoming dot releases:
YP 2.4.2 (Rocko) will be built when a stable version of the spectre/meltdown patches has been proven ready.
YP 2.3.4 (Pyro) will be built when a stable version of the spectre/meltdown patches has been proven ready.
YP 2.2.3 (Morty) rc1 is in QA, see https://wiki.yoctoproject.org/wiki/2.2_QA_Status.  We are considering holding this release candidate and building another when a stable version of the spectre/meltdown patches has been proven ready.
 
Key YP 2.5 Dates are:
YP 2.5 M1 rc3 is in QA, see above link.
YP 2.5 M2 cut off is past, it should be built as soon as the spectre/meltdown patches are ready and have been proven ready.
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics: WDD 2672 (last week 2700)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Jan. 8, 2018 ==
 
Current Dev Position: YP 2.5 M2 development
Next Deadline: YP 2.5 M2 cut off of 1/15/18
 
SWAT team rotation: Cal -> Joshua on Jan. 5, 2018.
SWAT team rotation: Joshua -> Armin on Jan. 12, 2018.
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
• 2.3.3 and 2.4.1 are likely due to imminently release, we tracked down the performance regressions to some kind of infrastructure issue which is still being investigated.
• The automated testing issues have mostly been resolved now and this has meant we’ve run a series of builds for master and the stable release branches. As such, the backlog of patches against morty, pyro, rocko and master are substantially reduced after this weekend.
• Armin’s help with the stable patch queues is much appreciated.
• Due to testing problems with 2.5 M1 rc1, particular from the qemu APIC hangs, we have put a new build, rc3 into QA. The QA of YP 2.5 M1 rc3 is about 2% complete.  See: https://wiki.yoctoproject.org/wiki/2.5_QA_Status
• We’re aware there are some serious security issues around at the moment. We’ve been stalled partly as maintainers are returning from vacation, partly as fixes are only now becoming available. As fixes are available we will waterfall these into the branches. One of the reasons we’ve focused on clearing the other patches queued is so we can quickly test and merge these and then proceed with another set of point releases.
 
Planned upcoming dot releases:
YP 2.4.1 (Rocko) rc1 is out of QA, and should be released this week.
YP 2.3.3 (Pyro) rc1 is out of QA, and should be released this week.
YP 2.2.3 (Morty) rc1 is in QA, see https://wiki.yoctoproject.org/wiki/2.2_QA_Status.
 
Key YP 2.5 Dates are:
YP 2.5 M1 rc1 is in QA, see above link.
YP 2.5 M2 cut off of 1/15/18
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics: WDD 2700 (last week 2764)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]
 
== Yocto Project Weekly Status Jan. 2, 2018 ==
 
Current Dev Position: YP 2.5 M2 development
Next Deadline: YP 2.5 M2 cut off of 1/15/18
 
SWAT team rotation: Maxin -> Rebecca on Dec. 22, 2017.
SWAT team rotation: Rebecca -> Cal on Dec. 29, 2017.
SWAT team rotation: Cal -> Joshua on Jan. 5, 2018.
https://wiki.yoctoproject.org/wiki/Yocto_Build_Failure_Swat_Team
 
Key Status/Updates:
• Things have been slow over the holiday season but things should be back to normal by the end of this week.
• The QA of YP 2.4.1 rc1 is complete.  See: https://wiki.yoctoproject.org/wiki/WW51_-_2017-12-21-_Full_Test_Cycle_-_2.4.1_rc1.
• The QA of YP 2.3.3 rc1 is complete. See: https://wiki.yoctoproject.org/wiki/WW51_-_2017-12-20-_Full_Test_Cycle_-_2.3.3_rc1.
• For 2.3.3 and 2.4.1 we have some questions about performance issues which the QA process potentially identified and we need to investigate these before any release can be made.
• The QA of YP 2.5 M1 rc1 is about 68% complete.  See: https://wiki.yoctoproject.org/wiki/2.5_QA_Status
• The QA of YP 2.2.3 rc1 is about 24% complete. See: https://wiki.yoctoproject.org/wiki/2.2_QA_Status.
• The kvm apic hang is resolved for qemux86-64 with a workaround. The workaround doesn’t work for qemux86 but there is another patch pending to address this.
• We keep seeing phantom “inode space” issues with the NFS setup on the autobuilder across all releases. I think we’re likely to give in and change the disk space monitoring on the infrastructure to ignore this as its breaking too many builds and likely not worth tracking down further.
• There are other suspected repository concurrency issues on the infrastructure causing failures and we’ve disabled buildhistory to allow builds to work until that is resolved.
• We’re hopeful with these changes in place we can get some kind of build stability back and have a better chance at merging patches again.
 
Planned upcoming dot releases:
YP 2.4.1 (Rocko) rc1 is out of QA, see above link. 
YP 2.3.3 (Pyro) rc1 is out of QA, see above link.
YP 2.2.3 (Morty) rc1 is in QA, see above link.
 
Key YP 2.5 Dates are:
YP 2.5 M1 rc1 is in QA, see above link.
YP 2.5 M2 cut off of 1/15/18
YP 2.5 M2 release of 1/26/18
YP 2.5 M3 cut off of 2/19/18
YP 2.5 M3 release of 3/2/18
YP 2.5 M4 cut off of 4/2/18
YP 2.5 M4 release of 4/27/18
 
Tracking Metrics: WDD 2764 (last week 2719)
(https://wiki.yoctoproject.org/charts/combo.html)
 
Key Status Links for YP:
https://wiki.yoctoproject.org/wiki/Yocto_Project_v2.5_Status
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Schedule
https://wiki.yoctoproject.org/wiki/Yocto_2.5_Features
 
[If anyone has suggestions for other information you’d like to see on this weekly status update, let us know!]

Revision as of 14:37, 16 April 2024

Yocto Project Weekly Status April 16th, 2024

Current Dev Position: YP 5.0 preparing to build rc2
Next Deadline: 1st April 2024 YP 5.0 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 5.0 rc1 is building but has many (6+) failures in the build so will have to be abandoned.
  • The final dunfell build will follow 5.0 into QA.
  • The master branch has diverged from scarthgap.
  • For 5.0, we were able to switch to the new hash equivalence server however the need for websockets complicated the worker configuration and needed new buildtools tarball versions which are causing various problems.
  • During the rc1 build as well as pip and setuptools issues within buildtools, we also saw a qemuppc boot issue, an instance of the spdx dependency problem, an sstate mirror issue and a github network error. This highlights how important fixing these is over the release cycle. The volume of these may impact our ability to maintain the LTS.
  • Thanks to everyone who sent documentation patches, we’re in much better shape with the migration guide and release notes now. Further improvements are still very welcome.
  • The “Binary Distro” work is now well underway and there are PR Server passthrough and image testing patches under review. The wiki page has had a number of policy/process proposals documented, help is welcome to help improve these, or highlight where further documentation is needed.
  • There are patches for improving the build performance graphs in review. Sample output from the changes is here and here.
  • There are also patches under review for the patch/cve metrics page to improve the usability.
  • We continue to watch the NIST NVD (CVE database) situation, the recent update didn’t clarify much. Unfortunately there doesn’t appear to be a clear path forward as yet but using data directly from MITRE may help give partial information. These issues are making it hard to know what to include in the 5.0 release as it isn’t clear which changes are security related.

Ways to contribute:

YP 5.0 Milestone Dates:

  • YP 5.0 is building
  • YP 5.0 M4 Release date 2024/04/30

YP 5.1 Proposed Milestone Dates:

  • YP 5.1 M1 Build date 2024-05-20
  • YP 5.1 M1 Release date 2024-05-31
  • YP 5.1 M2 Build date 2024-07-08
  • YP 5.1 M2 Release date 2024-07-19
  • YP 5.1 M3 Build date 2024-08-26
  • YP 5.1 M3 Release date 2024-09-06
  • YP 5.1 M4 Build date 2024-09-30
  • YP 5.1 M4 Release date 2024-10-25

Upcoming dot releases:

  • YP 4.3.4 is released.
  • YP 3.1.33 build date 2024-04-15
  • YP 3.1.33 Release date 2024-04-26
  • YP 4.0.18 build date 2024-04-22
  • YP 4.0.18 Release date 2024-05-03
  • YP 4.0.19 build date 2024-06-03
  • YP 4.0.19 Release date 2024-06-14

Upcoming Proposed dot releases:

  • YP 5.0.1 Build Date 2024-05-13
  • YP 5.0.1 Release Date 2024-05-24
  • YP 5.0.2 Build Date 2024-06-24
  • YP 5.0.2 Release Date 2024-07-05
  • YP 4.0.20 Build Date 2024-07-15
  • YP 4.0.20 Release Date 2024-07-26
  • YP 5.0.3 Build Date 2024-08-12
  • YP 5.0.3 Release Date 2024-08-23
  • YP 4.0.21 Build Date 2024-09-09
  • YP 4.0.21 Release Date 2024-09-20
  • YP 5.0.4 Build Date 2024-09-23
  • YP 5.0.4 Release Date 2024-10-04
  • YP 4.0.22 Build Date 2024-10-14
  • YP 4.0.22 Release Date 2024-10-25
  • YP 5.0.5 Build Date 2024-11-11
  • YP 5.0.5 Release Date 2024-11-22
  • YP 4.0.23 Build Date 2024-11-18
  • YP 4.0.23 Release Date 2024-11-29

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Archives