Weekly Status: Difference between revisions

From Yocto Project
Jump to navigationJump to search
(11 intermediate revisions by the same user not shown)
Line 1: Line 1:
== Yocto Project Weekly Status August 15th, 2023 ==
== Yocto Project Weekly Status September 26th, 2023 ==
Current Dev Position: YP 4.3 M3<br/>
Current Dev Position: YP 4.3 M4 (Feature Freeze)<br/>
Next Deadline: 28th August 2023 YP 4.3 M3 build date<br/>
Next Deadline: 2nd October 2023 YP 4.3 M4 build date<br/>


'''Next Team Meetings:'''<br/>
'''Next Team Meetings:'''<br/>
*Bug Triage meeting Thursday August 17th 7:30 am PDT (https://zoom.us/j/454367603?pwd=ZGxoa2ZXL3FkM3Y0bFd5aVpHVVZ6dz09)
*Bug Triage meeting Thursday September 28st 7:30 am PDT (https://zoom.us/j/454367603?pwd=ZGxoa2ZXL3FkM3Y0bFd5aVpHVVZ6dz09)
*Weekly Engineering Sync Tuesday August 15th 8 am PDT (https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09)
*Weekly Engineering Sync Tuesday September 26th 8 am PDT (https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09)
*Twitch -  See https://www.twitch.tv/theyoctojester
*Twitch -  See https://www.twitch.tv/theyoctojester


'''Key Status/Updates:'''<br/>
'''Key Status/Updates:'''<br/>
*We are now two weeks away from feature freeze for 4.3.
*YP 4.3 M3 rc1 was released and work is being done on the autobuilder QA email step to improve for future releases. The regression report is still being worked on.
*YP 3.1.27 was released
*YP 3.1.28 is under review for release
*YP 4.0.12 is in QA.
*YP 4.0.13 rc2 is in QA
*The 6.4 kernel upgrade is still blocked as we’ve seen two nasty looking hangs in automated testing: https://autobuilder.yoctoproject.org/typhoon/#/builders/148/builds/349/steps/12/logs/stdio https://autobuilder.yoctoproject.org/typhoon/#/builders/148/builds/354/steps/12/logs/stdio as well as a preempt-rt boot error that appears more consistently: https://autobuilder.yoctoproject.org/typhoon/#/builders/72/builds/7616/steps/36/logs/stdio The intermittent issues are a significant risk to automated testing stability and it is hard to know how to proceed as few people are willing/able to help with them. We’ve upgraded qemu 8.0.3 -> 8.0.4 just in case that helps.
*The numpy reproducibility issue remains and is proving extremely problematic with many failed builds. We may have to merge the debug patch into master.
*The various systemd issues have mostly been resolved although the AUH did break as a result and will have to be fixed and rerun.
*The openssh ptest intermittent failure does have better logs available but we’ve yet to decode what it means: http://autobuilder.yocto.io/pub/non-release/20230917-2/testresults/qemuarm64-ptest/openssh.log
*Build layout changed slightly with the removal of PE and PR from the WORKDIR path.
*The changes to error for overlapping symlinks under sstate control have highlighted some issues, particularly in world build configurations however so far these have proven to be real issues that needed addressing in the configuration as the files overlapped and caused determinism issues.
*There are patches pending which remove source control revisions from PV and move them to PKGV, further simplifying WORKDIR paths and generally improving the code and the way AUTOREV works. This allows SRCPV to be removed as it is no longer needed.
*The number of build failures from incoming patches remains high and is causing patch review delays and headaches for the maintainers. We are not here to debug people’s patches, we’re only meant to be catching accidental/occasional issues.
*Significant fixes were made to both the binutils and gcc testsuites which avoid many of the mips toolchain test failures. The failure counts are roughly the same (few hundred) for each architecture now resulting in ~3200 failures overall.  
*Patches for enabling wider SPDX tooling and testing in core are being proposed but there are quite a few python module dependencies. We do have good tooling/class support for python modules so the maintenance overhead of these is relatively low but the number of modules in core has increased steadily. Feedback welcome.
*There are now consistently ~200 ltp ‘controllers’ failures on both arm and x86 targets.
*Since the 6.4 kernel is already EOL, we are considering a 6.5 kernel for 4.3 as the best of several difficult options.
*A new uninative version was released to add some patches to patchelf to avoid bugs.
*The project is working on improving its security processes and policies, there are emails on the mailing list discussing this. Please highlight these to any parties who may be interested or have useful feedback.
*A new test addition to oe-selftest caused another test to fail consistently on the autobuilder and this has been tracked down to one test corrupting the other if they run in the same TMPDIR. This only happens with specific parallelism settings where they happen to run together or with no parallelism.
*We continue to see intermittent ptest failures for glib-networking, mdadm and openssh, help would be much appreciated.
*CVE metrics are worrying with significant numbers of open CVEs against master, many of them kernel related. The 6.4 upgrade should help but that is blocked. Mickledore is also badly affected with a record high count. https://autobuilder.yocto.io/pub/non-release/patchmetrics/


'''Ways to contribute:'''<br/>
'''Ways to contribute:'''<br/>
Line 33: Line 30:


'''YP 4.3 Milestone Dates:'''<br/>
'''YP 4.3 Milestone Dates:'''<br/>
*YP 4.3 M3 build date  2023/08/28
*YP 4.3 M3 was released.
*YP 4.3 M3 Release date 2023/09/08
*YP 4.3 M4 build date  2023/10/02
*YP 4.3 M4 build date  2023/10/02
*YP 4.3 M4 Release date 2023/10/27
*YP 4.3 M4 Release date 2023/10/27
'''YP 5.0 Milestone Dates:'''<br/>
*YP 5.0 M1 build date 2023/12/04
*YP 5.0 M1 Release date 2023/12/15
*YP 5.0 M2 build date  2024/01/15
*YP 5.0 M2 Release date 2024/01/24
*YP 5.0 M3 build date  2024/02/19
*YP 5.0 M3 Release date 2024/03/01
*YP 5.0 M4 build date  2024/04/01
*YP 5.0 M4 Release date 2024/04/30


'''Upcoming dot releases:'''<br/>
'''Upcoming dot releases:'''<br/>
*YP 3.1.27 is released
*YP 3.1.28 is ready for release
*YP 4.0.12 is in QA
*YP 4.0.13 is in QA
*YP 4.0.12 Release date 2023/08/18
*YP 4.2.3 build date 2023/08/28
*YP 4.2.3 Release date 2023/09/08
*YP 3.1.28 build date 2023/09/18
*YP 3.1.28 Release date 2023/09/29
*YP 4.0.13 build date 2023/09/25
*YP 4.0.13 Release date 2023/10/06
*YP 3.1.29 build date 2023/10/30
*YP 3.1.29 build date 2023/10/30
*YP 3.1.29 Release date 2023/11/10
*YP 3.1.29 Release date 2023/11/10
Line 54: Line 53:
*YP 4.2.4 build date 2023/11/13
*YP 4.2.4 build date 2023/11/13
*YP 4.2.4 Release date 2023/11/24
*YP 4.2.4 Release date 2023/11/24
*YP 4.3.1 build date 2023/11/27
*YP 4.3.1 Release date 2023/12/08
*YP 3.1.30 build date 2023/12/11
*YP 3.1.30 build date 2023/12/11
*YP 3.1.30 Release date 2023/12/22
*YP 3.1.30 Release date 2023/12/22
*YP 4.0.15 build date 2023/12/18
*YP 4.0.15 build date 2023/12/18
*YP 4.0.15 Release date 2023/12/29
*YP 4.0.15 Release date 2023/12/29
*YP 4.3.2 build date 2024/01/08
*YP 4.3.2 Release date 2024/01/19
*YP 3.1.31 build date 2024/01/22
*YP 3.1.31 Release date 2024/02/02
*YP 4.0.16 build date 2024/01/29
*YP 4.0.16 Release date 2024/02/09
*YP 4.3.3 build date 2024/02/12
*YP 4.3.3 Release date 2024/02/23
*YP 3.1.32 build date 2024/03/04
*YP 3.1.32 Release date 2024/03/15
*YP 4.0.17 build date 2024/03/11
*YP 4.0.17 Release date 2024/03/22
*YP 4.3.4 build date 2024/03/25
*YP 4.3.4 Release date 2024/04/05
*YP 3.1.33 build date 2024/04/15
*YP 3.1.33 Release date 2024/04/26
*YP 4.0.18 build date 2024/04/22
*YP 4.0.18 Release date 2024/05/03
*YP 4.0.19 build date 2024/06/03
*YP 4.0.19 Release date 2024/06/14


'''Tracking Metrics:'''<br/>
'''Tracking Metrics:'''<br/>
*WDD 2463 (last week 2495) (https://wiki.yoctoproject.org/charts/combo.html)
*WDD 2475 (last week 2505) (https://wiki.yoctoproject.org/charts/combo.html)
*OE-Core/Poky Patch Metrics
*OE-Core/Poky Patch Metrics
**Total patches found: 1186 (last week 1186)
**Total patches found: 1183 (last week 1185)
**Patches in the Pending State: 255 (22%) [last week 256 (22%)]
**Patches in the Pending State: 254 (21%) [last week 255 (22%)]
*https://autobuilder.yocto.io/pub/non-release/patchmetrics/
*https://autobuilder.yocto.io/pub/non-release/patchmetrics/



Revision as of 14:52, 26 September 2023

Yocto Project Weekly Status September 26th, 2023

Current Dev Position: YP 4.3 M4 (Feature Freeze)
Next Deadline: 2nd October 2023 YP 4.3 M4 build date

Next Team Meetings:

Key Status/Updates:

  • YP 4.3 M3 rc1 was released and work is being done on the autobuilder QA email step to improve for future releases. The regression report is still being worked on.
  • YP 3.1.28 is under review for release
  • YP 4.0.13 rc2 is in QA
  • The numpy reproducibility issue remains and is proving extremely problematic with many failed builds. We may have to merge the debug patch into master.
  • The openssh ptest intermittent failure does have better logs available but we’ve yet to decode what it means: http://autobuilder.yocto.io/pub/non-release/20230917-2/testresults/qemuarm64-ptest/openssh.log
  • The changes to error for overlapping symlinks under sstate control have highlighted some issues, particularly in world build configurations however so far these have proven to be real issues that needed addressing in the configuration as the files overlapped and caused determinism issues.
  • The number of build failures from incoming patches remains high and is causing patch review delays and headaches for the maintainers. We are not here to debug people’s patches, we’re only meant to be catching accidental/occasional issues.
  • Patches for enabling wider SPDX tooling and testing in core are being proposed but there are quite a few python module dependencies. We do have good tooling/class support for python modules so the maintenance overhead of these is relatively low but the number of modules in core has increased steadily. Feedback welcome.
  • Since the 6.4 kernel is already EOL, we are considering a 6.5 kernel for 4.3 as the best of several difficult options.
  • The project is working on improving its security processes and policies, there are emails on the mailing list discussing this. Please highlight these to any parties who may be interested or have useful feedback.

Ways to contribute:

YP 4.3 Milestone Dates:

  • YP 4.3 M3 was released.
  • YP 4.3 M4 build date 2023/10/02
  • YP 4.3 M4 Release date 2023/10/27

YP 5.0 Milestone Dates:

  • YP 5.0 M1 build date 2023/12/04
  • YP 5.0 M1 Release date 2023/12/15
  • YP 5.0 M2 build date 2024/01/15
  • YP 5.0 M2 Release date 2024/01/24
  • YP 5.0 M3 build date 2024/02/19
  • YP 5.0 M3 Release date 2024/03/01
  • YP 5.0 M4 build date 2024/04/01
  • YP 5.0 M4 Release date 2024/04/30

Upcoming dot releases:

  • YP 3.1.28 is ready for release
  • YP 4.0.13 is in QA
  • YP 3.1.29 build date 2023/10/30
  • YP 3.1.29 Release date 2023/11/10
  • YP 4.0.14 build date 2023/11/06
  • YP 4.0.14 Release date 2023/11/17
  • YP 4.2.4 build date 2023/11/13
  • YP 4.2.4 Release date 2023/11/24
  • YP 4.3.1 build date 2023/11/27
  • YP 4.3.1 Release date 2023/12/08
  • YP 3.1.30 build date 2023/12/11
  • YP 3.1.30 Release date 2023/12/22
  • YP 4.0.15 build date 2023/12/18
  • YP 4.0.15 Release date 2023/12/29
  • YP 4.3.2 build date 2024/01/08
  • YP 4.3.2 Release date 2024/01/19
  • YP 3.1.31 build date 2024/01/22
  • YP 3.1.31 Release date 2024/02/02
  • YP 4.0.16 build date 2024/01/29
  • YP 4.0.16 Release date 2024/02/09
  • YP 4.3.3 build date 2024/02/12
  • YP 4.3.3 Release date 2024/02/23
  • YP 3.1.32 build date 2024/03/04
  • YP 3.1.32 Release date 2024/03/15
  • YP 4.0.17 build date 2024/03/11
  • YP 4.0.17 Release date 2024/03/22
  • YP 4.3.4 build date 2024/03/25
  • YP 4.3.4 Release date 2024/04/05
  • YP 3.1.33 build date 2024/04/15
  • YP 3.1.33 Release date 2024/04/26
  • YP 4.0.18 build date 2024/04/22
  • YP 4.0.18 Release date 2024/05/03
  • YP 4.0.19 build date 2024/06/03
  • YP 4.0.19 Release date 2024/06/14

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Archives