2021 Yocto Project Weekly Status Archive

From Yocto Project
Jump to: navigation, search

Contents

Yocto Project Weekly Status Sept. 21, 2021

Current Dev Position: YP 3.4 M4
Next Deadline: 4th Oct. 2021 YP 3.4 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3.3 was released
  • YP 3.1.11 is in QA.
  • The public hash equivalence and sstate share highlighted some issues where builds from sstate were not as optimal as they could be. There are a number of related patches on the mailing list, some are more invasive than others and are marked as RFC. They do fix and improve valid issues but some may be too invasive at this point of the release.
  • The output hash timestamp issues were resolved and this has improved state reuse.
  • Fixes for a number of open bugs in bugzilla have been posted but some have implications for other layers (e.g. accounting site info in task hashes).
  • Intermittent issues are ongoing and help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.3 is released
  • YP 3.1.11 is in QA
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Sept. 14, 2021

Current Dev Position: YP 3.4 M4
Next Deadline: 4th Oct. 2021 YP 3.4 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.4 M3 has been released
  • YP 3.3.3 rc2 is in QA.
  • YP 3.1.11 is due to build this week.
  • We now have a public hash equivalence service from the autobuilder available and instructions on testing with this are on the mailing list. With a couple of recent fixes, build from the autobuilder sstate are now possible and quite effective.
  • Issues have been found in the output task hashes related to timestamps and improvements for this are pending in master-next.
  • We have noticed bitbake was hiding deprecation warnings and plan to fix that before the release of 3.4. This may cause some warnings to become visible before release that will need fixing but some of those issues will be problematic with python 3.10 which will be released in the lifetime of 3.4.
  • Fixes for task failure handling on the console were merged into bitbake to reduce duplicate output where log files may be printed multiple times.
  • Expansion errors in bitbake should now print variable dependency chains making them easier to understand/debug.
  • Intermittent issues are ongoing and help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M3 is released
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.3 built and in QA
  • YP 3.3.3 release date 2021/09/17
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Sept. 7, 2021

Current Dev Position: YP 3.4 M4
Next Deadline: 4th Oct. 2021 YP 3.4 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.4 M3 is built and now in QA. This means we are now feature complete for 3.4 and will be working on stabilization.
  • YP 3.3.3 has been built and is waiting in the queue for QA after 3.4 M3. This includes the override syntax compatibility changes.
  • SBOM generation work was merged in and will be in the release as preliminary work on this topic, there will likely be some further tweaks during M4.
  • Further rust issues were resolved such as the centos7 build issues.
  • A work around for the glibc 2.34 clone3 syscalls in uninative was added and a new uninative built/released.
  • A fix for some of the multiconfig issues where deadlocked tasks and tasks were showing errors being on both the “covered and not covered lists” is available in master-next for review, hopefully addressing the issues that were being reported. This was possible from a better test case that was submitted enabling debugging.
  • Intermittent issues are ongoing and help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M3 built and in QA
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.3 built and in QA
  • YP 3.3.3 release date 2021/10/1
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Aug. 31, 2021

Current Dev Position: YP 3.4 M3 (Feature Freeze)
Next Deadline: 23rd Aug. 2021 YP 3.4 M3 build (Feature Freeze)

Next Team Meetings:

Key Status/Updates:

  • We are now at feature freeze for YP 3.4
  • Rust was merged into core, it was touch and go whether we could/would or not. Unfortunately there was an error found after merging with cargo-native on centos7 hosts which we still need to resolve before building M3.
  • Fixes for glibc 2.34 and pseudo were merged however this uses a binary shim and isn’t an ideal way to solve the issues. We need to find a way to have active development on pseudo with investigation into possible replacement approaches.
  • A kernel issue introduced in recent kernel module versioning changes needs to resolved before we can build M3.
  • The glibc 2.34 upgrade caused issues with docker and the clone3 syscall returning EPERM instead of ENOSYS. We will likely have to add a workaround to our glibc until released versions of docker have the upstream fix.
  • Intermittent issues are ongoing and help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Aug. 24, 2021

Current Dev Position: YP 3.4 M3 (Feature Freeze)
Next Deadline: 23rd Aug. 2021 YP 3.4 M3 build (Feature Freeze)

Next Team Meetings:

Key Status/Updates:

  • We are now at feature freeze for YP 3.4
  • Read-only PRServ and switch to asyncio was merged
  • Rust merging to core is proving problematic due to issues interacting with uninative. These cause many strange autobuilder failures so this issue would have to be addressed in the next day or two in order to be in 3.4.
  • glibc 2.34 and the merge of the various libraries into libc is causing significant problems for pseudo. This issue is causing significant worry as the project will struggle as distros adopt the new glibc version unless we work out how to fix things.
  • The tune file layout change was merged.
  • We are still hoping to get some of the planned SBOM work into 3.4
  • Intermittent issues are ongoing and help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Aug. 17, 2021

Current Dev Position: YP 3.4 M3
Next Deadline: 23rd Aug. 2021 YP 3.4 M3 build (Feature Freeze)

Next Team Meetings:

Key Status/Updates:

  • YP 3.1.10 was released
  • Next week is feature freeze for YP 3.4
  • Known pending work for YP 3.4 includes rust support in core and the prserv changes.
  • OE-Core has moved to the new override syntax and is now only compatible with the honister release series. Other layers will need to migrate to the new syntax to work with it. There is documentation about handling migration to the new syntax in the migration section of the manual:

http://docs.yoctoproject.org/migration-guides/migration-3.4.html#override-syntax-changes

  • There continue to be small bug fixes from the override syntax change but most of the core layers tested on the autobuilder now seem to be working ok.
  • We merged the upgrade to glibc to 2.34. Unfortunately this version makes some changes which have broken uninative and pseudo. Fixes for those issues are being investigated.
  • Kernel changes to drop 5.4 and switch to 5.10 and 5.13 are pending, mainly on other layers being ready for the change to the default versions.
  • There also appear to be issues in the buildtools tarball on aarch64, probably from the gcc 11 upgrade.
  • There is a plan to migrate the tune files into architecture specific directories. This patch will likely merge in the next few days and will need BSP layers to be updated as the tune files will no longer be found.
  • The bitbake fetcher no longer ignores SSL certificates by default (this wasn’t a huge problem as we separately checksum input files).
  • LTO linker flags handling changes were merged now the reproducibility issues it introduced were fixed meaning LTO builds should be more reproducible.
  • Overlayfs class changes were merged.
  • Intermittent issues are ongoing and help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.10 is released
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Aug. 10, 2021

Current Dev Position: YP 3.4 M3
Next Deadline: 23rd Aug. 2021 YP 3.4 M3 build (Feature Freeze)

Next Team Meetings:

Key Status/Updates:

  • YP 3.3.2 was released
  • YP 3.1.10 is due to be released imminently
  • OE-Core has moved to the new override syntax and is now only compatible with the honister release series. Other layers will need to migrate to the new syntax to work with it. There is documentation about handling migration to the new syntax in the migration section of the manual: http://docs.yoctoproject.org/migration-guides/migration-3.4.html#override-syntax-changes
  • There has been at least one important bug fix to the overrides syntax change in OE-Core but in general layers do seem to be migrating over and there has been a lot of positive feedback about making this change from a readability perspective. Some additional variables were converted for consistency too.
  • In the last week long standing bugs were fixed, such as being able to use the devupstream class with natively extended recipes, some bitbake hangs in unusual situations with cleanups to the error paths around this and improvements to LTO with regard to binary reproducibility.
  • The prserv rewrite is making progress but still has some issues with python asyncio.
  • Intermittent issues are ongoing, particularly ptest ones. Help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • The multiconfig changes pending in master-next for a long time were merged as the approach used is better overall. If anyone still sees multiconfig scheduling bugs, please report those.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.2 is released
  • YP 3.1.10 is out of QA.
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Aug. 3, 2021

Current Dev Position: YP 3.4 M3
Next Deadline: 23rd Aug. 2021 YP 3.4 M3 build (Feature Freeze)

Next Team Meetings:

Key Status/Updates:

  • YP 3.4 M2 was released
  • YP 3.3.2 has been through QA and is pending release approval
  • YP 3.1.10 is in QA
  • OE-Core has moved to the new override syntax and is now only compatible with the honister release series. Other layers will need to migrate to the new syntax to work with it. There is documentation about handling migration to the new syntax in the migration section of the manual:

http://docs.yoctoproject.org/migration-guides/migration-3.4.html#override-syntax-changes

  • The new override syntax is now also supported by older releases of bitbake on the 1.50, 1.48 and 1.46 branches, which mean this applies to dunfell. It will be part of the 3.1.11 release.
  • There is a fix to bitbake’s datastore pending which may cause a variable only set with conditional appends to change value from “” to None. DRIDRIVERS in the mesa recipe was the only example found in OE-Core and it is hoped this issue is rare. The fix is important due to interaction issues with other variables in some other use cases and this makes things consistent.
  • The prserv rewrite is making progress but still has some issues with python asyncio.
  • Intermittent issues are ongoing, particularly ptest ones. Help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others and current test cases are very slow to work with.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M2 was released
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.2 is out of QA
  • YP 3.1.10 is in QA
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status July 27, 2021

Current Dev Position: YP 3.4 M3
Next Deadline: 23rd Aug. 2021 YP 3.4 M3 build (Feature Freeze)

Next Team Meetings:

Key Status/Updates:

  • YP 3.4 M2 was built and has been through QA however there were two reported QA issues which have open questions that are being discussed
  • YP 3.3.2 is being built and YP 3.1.10 will follow that into QA
  • Support for the new override syntax was added to bitbake, for now just translating to the old syntax. This means we can start converting metadata to the new format. The plan would be to allow the new syntax with older bitbake too using the same patch, allowing wider compatibility of metadata layers.
  • We will likely start converting metadata to the new syntax over the next week as test builds are starting to be fairly successful with OE-Core.
  • There are proposals to add lz4c, zstd and pzstd as required host commands which we hope will allow better data archiving for license information and possibly for bitbake hash debugging too. The groundwork for this change has merged with the autobuilder workers being updated and the tools added to buildtools-tarball.
  • The prserv rewrite is making progress but still has some issues with python asyncio.
  • Intermittent issues are ongoing, particularly ptest ones. Help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others and current test cases are very slow to work with.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M2 is out of QA being reviewed.
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.2 is being built.
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status July 20, 2021

Current Dev Position: YP 3.4 M2
Next Deadline: 12th July 2021 YP 3.4 M2 build

Next Team Meetings:

Key Status/Updates:

  • We plan to build M2 this week once we have pzstd included in the buildtools tarball
  • Once M2 is built, 3.3.2 will follow into QA.
  • There are proposals to add lz4c, zstd and pzstd as required host commands which we hope will allow better data archiving for license information and possibly for bitbake hash debugging too.
  • There are proposals and discussions on the architecture list around improving the syntax for overrides in the metadata. This would be a major change of a type we haven’t make in a while. The proposal includes the option of allowing the syntax in older bitbake versions to make metadata compatibility easier. Please comment on those discussions on the list if you have opinions on this.
  • The prserv rewrite is still pending on resolving the issues with python asyncio.
  • Intermittent issues are ongoing, particularly ptest ones. Help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others and current test cases are very slow to work with.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status July 13, 2021

Current Dev Position: YP 3.4 M2
Next Deadline: 12th July 2021 YP 3.4 M2 build

Next Team Meetings:

Key Status/Updates:

  • An issue with eSDK being host specific due to pseudo-native host dependencies has been resolved and this should resolve a number of bugs being reported by the community around use of the eSDK.
  • The prserv rewrite is still pending on resolving the issues with python asyncio.
  • We are continuing to make progress on the intermittent autobuilder failures. A race was identified in the qemu networking lock handling and there were some reproducibility fixes. Tweaks have been made to the autobuilder configuration such as avoiding key generation in more cases which it is believed may have been running into entropy shortages on the hosts, or just hitting CPU load issues. Some ptest improvements have also been made.
  • Despite this progress, we continue to see intermittent issues, particularly ptest ones. Help is very much welcome on these issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others and current test cases are very slow to work with.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status July 6, 2021

Current Dev Position: YP 3.4 M2
Next Deadline: 12th July 2021 YP 3.4 M2 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.1.9 was released.
  • The prserv rewrite is still pending on resolving the issues with python asyncio.
  • Alexandre Belloni/Bootlin have been taking over some of the patch testing/queuing work over the last couple of weeks, feedback to either Richard/Alexandre or the TSC on how this is working is welcome.
  • Intermittent autobuilder issues continue to occur, about 50% of the open issues are now ptest failures, many occurring more frequently on arm and the rest are various other races or timeouts. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • We have made progress on a couple of the race issues and on one of the ptest issues (util-linux), some of the ptest issues and the bitbake server timeout issue are now our most frequently encountered issues.
  • A rootfs license race issue (#14123) now has reproduction steps which should allow a fix to follow.
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others and current test cases are very slow to work with.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.9 is released
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status June 29, 2021

Current Dev Position: YP 3.4 M2
Next Deadline: 12th July 2021 YP 3.4 M2 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.1.9 has been through QA and is awaiting release approval, no blocking issues were identified.
  • YP 3.4 M1 was released.
  • Significantly for the project, we have now identified a kernel hang caused from RCU stalls which has been plaguing our autobuilder testing for months. The issue is still open in upstream mainline kernels but there is a patch queued in the rcu tree for it. Since applying this patch to linux-yocto, our builds have been noticeably greener and more stable. We have closed out many of the related AB-INT bugs and will be creating new ones for any remaining issues as they occur since it is hard to tell some other bugs apart from the RCU issue.
  • The prserv rewrite to use asyncio is stuck on autobuilder hangs when testing at larger scale. We’d welcome help from anyone with more details asyncio knowledge/experience as it is looking like the new code isn’t entirely stable in python 3.5/3.6 and may have “at exit” issues, as well as perhaps issues mixing async io code on the client side with multiprocessing during parsing.
  • There does still seem to be an arm specific LTP hang reading /proc/kmsg now tracked by bug 14460.
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others. Richard is trying to fix but trying to fix autobuilder issues and other problems and these are slow builds to debug.
  • Intermittent autobuilder issues continue to occur, about 50% of the open issues are now ptest failures and the rest are various other races or timeouts. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 is released
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.9 is under review
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status June 22, 2021

Current Dev Position: YP 3.4 M2
Next Deadline: 12th July 2021 YP 3.4 M2 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.4 M1 has been through QA pending release approval with two QA issues highlighted.
  • YP 3.1.9 is being built ready for QA.
  • Big thanks to Paul Gortmaker for tracking down the cause of an LTP null pointer dereference (and other errors) within the cgroups mount code which was responsible for several of our LTP hangs. The issue was introduced in new code between 5.0 and 5.1 in the kernel and had been present for a while. The fix is now making its way through various kernel trees upstream.
  • Sadly, the above fix did not resolve the “rcu” autobuilder VM hangs we are seeing occasionally. These are odd in that they affect kvm and non-kvm builds (x86 and arm seen on x86-64 hosts), they pin the VM at 300-400% CPU usage and the VM will respond to pings but no ssh or console output. The rcu dumps from the kernel are likely a symptom that something is wrong rather than the cause and often look incomplete. It is as if some instantaneous host load breaks timers in a way the guest cannot recover or continue execution from. We’re continuing to try and narrow this down but it is proving elusive and progress is slow, any insight anyone may have would be welcome.
  • There are new manual sections that have recently been added on http://docs.yoctoproject.org/test-manual/reproducible-builds.html and http://docs.yoctoproject.org/test-manual/yocto-project-compatible.html.
  • We continue to deal with an issue with centos8 kernels having what looks like bad bounds checking on the utimensat_time64 32 bit syscalls where the syscall was backported into a kernel point release. We’re working on reporting it upstream.
  • We have a 10th anniversary T-shirt and some other Yocto Project items (hoody, stickers, mugs etc.) now available at https://yoctoproject.org/shop (EU and Americas sources)
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others. Richard is trying to fix but trying to fix autobuilder issues and other problems and these are slow builds to debug.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 is in review
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.9 is being built
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status June 15, 2021

Current Dev Position: YP 3.4 M2
Next Deadline: 12th July 2021 YP 3.4 M2 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.4 M1 was built and is in the QA process.
  • The intermittent ltp hanging issue is continuing to be tracked down, currently thought to be a kernel bug introduced around the 5.0 -> 5.1 kernel version window. We ended up unblocking M1 since it is clear the LTP issue will take longer to unravel. Whilst aufs was initially thought to be a possible cause, it wasn’t the issue.
  • We are working around the autobuilder centos8 issue which is an issue with the upstream centos kernel where syscalls were backported in the latest version and don’t work properly.
  • We have a 10th anniversary T-shirt and some other Yocto Project items (hoody, stickers, mugs etc.) now available at https://yoctoproject.org/shop (EU and Americas sources)
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others. Richard is trying to fix but trying to fix autobuilder issues and other problems and these are slow builds to debug.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 is in QA
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status June 8, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • 3.4, M1 is due to build this week (but see below).
  • YP 3.1.8 was released.
  • A possible cause for some of the intermittent issues we’ve been seeing has been identified as some of the kernel patches in linux-yocto, particularly aufs. We’re investigating this and will likely hold M1 until it is resolved.
  • A second intermittent issue has appeared with the latest kernel upgrade on centos8 causing testsdk to fail. This will also likely block M1 as builds fail with the issue and we’d have to disable autobuilder workers to make a release build.
  • We have a 10th anniversary T-shirt and some other Yocto Project items (hoody, stickers, mugs etc.) now available at https://yoctoproject.org/shop (EU and Americas sources)
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others. Richard is trying to fix but trying to fix autobuilder issues and other problems and these are slow builds to debug.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.8 was released
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status June 1, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • The first milestone of 3.4, M1 is due to be built next week.
  • YP 3.1.8 is has passed QA with one minor/intermittent ptest issue found and awaits final approval for release
  • We have a 10th anniversary T-shirt and some other Yocto Project items (hoody, stickers, mugs etc.) now available at https://yoctoproject.org/shop (EU and Americas sources)
  • The Yocto Project Virtual Summit was held last week and seemed successful, thanks to everyone who helped organize it or participated.
  • Master is now at 6 open CVE issues (one should be fixed by the curl upgrade) and hardknott is now at 14 open issues. Some pending patches to hardknott should reduce the count further.
  • We are going to trial running the AUH more regularly to try and keep on top of recipe upgrade issues and reduce the size of the batches being processed.
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others. Richard is trying to fix but trying to fix autobuilder issues and other problems and these are slow builds to debug.
  • We have cleaned up the ptest images to be built around the minimal image rather than being tied to sato.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.8 is being reviewed for release
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status May 25, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3.1 was released
  • YP 3.1.8 is being built, an autobuilder glitch meant we’re building rc2.
  • We’ve seen a significant reduction in CVE counts for master and the stable releases this week. For master this brings us down to 5 CVEs compared to 63 a couple of weeks ago. This should mean real/open issues are much clearer and old/obsolete issues no longer contribute noise to the output of the tools.
  • Help with the problematic recipe upgrades would be much appreciated.
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others. Richard is trying to fix but trying to fix autobuilder issues and other problems and these are slow builds to debug.
  • We have identified ltp issues with some tests causing hangs which have been disabled as well as issues with the 5.10.37 kernel which seem to be fixed in 5.10.38.
  • We’re seeing odd looking rcu stalls in qemu automated testing. This seems to occur more often with 5.10 kernel but also with 5.12 and with kvm-clock disabled and we have seen it with 5.4. It is unclear whether these are kernel issues or qemu issues, we’re struggling to debug them and any insight would be welcome.
  • Some debugging of these intermittent hangs has been posted to the swat mailing list.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.3.1 is in released
  • YP 3.1.8 is being built
  • YP 3.1.8 release date 2021/06/04
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status May 18, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.2.4 was released
  • YP 3.3.1 is in QA
  • Patch merging to master is continuing and we now have a round of AUH upgrades to process. We’ve tried to merge some of the easier ones as there was autobuilder testing availability. This allows people to concentrate on the areas where there are issues with the automated upgrade and where we most need the help.
  • Anuj is unavailable for a few weeks so Richard will be acting as maintainer for hardknott until he returns (assistance welcome).
  • An open letter about open source project work was sent to various mailing lists highlighting some of the challenges established project face from a resourcing perspective: https://lists.openembedded.org/g/openembedded-architecture/topic/open_source_maintainers_an/82722442
  • The multiconfig changes in bitbake continue to cause problems, we still need simpler test cases to reproduce issues rather than huge builds. The existing patches seem to fix some workloads and break others. Richard is trying to fix but trying to fix autobuilder issues and other problems and these are slow builds to debug.
  • We saw a significant drop in open CVEs reported by the tooling against master this week (63 down to 18) and hopefully many more of these have resolutions “in flight”. This will allow us to focus on the real issues and filter out the legacy noise.
  • SMP was enabled for qemu on arm/x86 and we switched x86 to a more modern cpu/platform
  • One source of the OOM issues on the autobuilder appears to be glibc usermode testing going out of control and using up all system memory. We are investigating the best way to mitigate that but it accounts for some of our intermittent issues.
  • When OOM issues occur an issue was identified in bitbake’s heartbeat events causing bitbake to hang. Ironically this was being heavily used by the recent autobuilder load debugging code. There is a patch pending to address this.
  • A rare sstate manifest corruption bug was tracked down thanks to information from Martin Jansa, a fix has been merged.
  • We have enabled more resource control on the autobuilder for xz memory/thread usage as that was contributing to the OOM issues. More investigation is needed into the rpm/deb controls for xz, help there would be appreciated.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.2.4 is in released
  • YP 3.3.1 is in QA
  • YP 3.3.1 release date 2021/05/28
  • YP 3.1.8 build date 2021/05/24
  • YP 3.1.8 release date 2021/06/04
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status May 11, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.2.4 is in QA and will be the final release in the 3.2 series.
  • We’re continuing to merge significant changes into master as patches are tested and reviewed. This included many version upgrades(thanks Alex) bringing us back up to date after the pause during stabilization.
  • The multiconfig changes in bitbake continue to cause problems, we could do with simpler test cases to reproduce issues rather than huge builds.
  • There is an effort underway to triage the remaining reported CVEs against master and improve our presentation with regard to CVE tracking.
  • We have patches in review to enable SMP for qemu for arm and x86 machines
  • We also have a proposal to change the default x86 QEMU emulation configuration to something more recent/modern
  • We appear to have serial IRQ handling issues with qemuppc and would welcome help from anyone with knowledge in that area.
  • We have switched some gnome components from gtk-doc to gi-docgen in line with upstream
  • Several of the PRServ rework patches have now merged (thanks Paul).
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.2.4 is in QA
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/24
  • YP 3.1.8 release date 2021/06/04
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status May 4, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.2.4 is due to build this week which would be the final release in the 3.2 series.
  • We are pleased to announce that our April 2022 release (potentially 3.5) will be the next LTS as per our original two year schedule. If there are features desired in the next LTS, now is the time to get them submitted and stabilized ready.
  • Patches are now flowing into master for 3.4 for M1 which is now undergoing active development.
  • We upgraded to gcc 11, thanks Khem for a lot of work in getting up ready to do that!
  • A couple of key fixes for multiconfig builds were added to bitbake.
  • A new uninative version was released to address issues found in patchelf with some native binaries, particularly when gold was used as a linker due to differing note section alignment values.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/24
  • YP 3.1.8 release date 2021/06/04
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Apr. 27, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.1.7 was released.
  • Patches are now flowing into master for 3.4 for M1 which is now undergoing active development.
  • We added automated yocto-check-layer testing to the YP autobuilder for key project layers which include meta-openembedded and meta-virtualization as well as member layers. The aim is to ensure key project layers interoperate well with each other and we’d like to thank the layer maintainers who’ve helped ensure these layers started passing tests.
  • Libseccomp has moved to OE-Core due to its widespread use and becoming a hard requirement for some software. As such its now in the default DISTRO_FEATURES.
  • There is a potentially controversial proposal to add opengl to the default DISTRO_FEATURES as part of the move to wayland rather than X11 Xserver based systems which people may wish to review carefully.
  • Elections for the two OE positions on the YP TSC are ongoing on the openembedded-members list. Please contact the OE board if you are not a member but would like to be.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.7 has been released.
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/24
  • YP 3.1.8 release date 2021/06/04
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.3.2 build date 2021/07/19
  • YP 3.3.2 release date 2021/07/30
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Apr. 20, 2021

Current Dev Position: YP 3.4 M1
Next Deadline: 7th June 2021 YP 3.4 M1 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 has been released. Thanks go to everyone who contributed to it!
  • YP 3.1.7 has come cleanly through QA and is pending TSC approval for release.
  • The YP TSC has now served for two years, thanks go to the outgoing TSC (Armin, Denys, Khem, Richard, Ross) who have been instrumental in a number of significant project developments over that time such as the LTS, definition of processes and resourcing the project. Some of the work isn’t immediately obvious but has shaped the project and should ensure a stable and positive future direction.
  • New TSC members are now being chosen for the next two years. Three of the TSC seats have now been (re-)elected by the YP members and those seats are being filled by Richard (chair), Khem and Ross. Two are elected by the OE community and there will be a call for candidates coming soon from the OE board to the OE membership.
  • The master branch has opened for 3.4 development and a number of patches queued during release of 3.3 have now merged.
  • There may be interest in a new command, “bitbake-getvar” being proposed on the bitbake mailing list and in master-next. This makes it easier to see the history of a single variable and also makes a neat example of using the tinfoil API. We are also considering other similar helper commands (maybe along the lines of the ‘bb’ tool) with a view to making things easier for new users.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 is released.

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.7 is out of QA.
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28
  • YP 3.3.1 build date 2021/05/24
  • YP 3.3.1 release date 2021/06/04
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.3.2 build date 2021/08/09
  • YP 3.3.2 release date 2021/08/20
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Apr. 13, 2021

Current Dev Position: YP 3.3 M4 (Feature Freeze)
Next Deadline: 5th April 2021 YP 3.3 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 rc2 has a clean bill of health from QA so pending TSC approval and release notes/migration guide, it's looking likely to release. rc1 was abandoned due to a couple of intermittent autobuilder issues accounted on the first build.
  • YP 3.1.7 is being built today
  • There are a number of pending patches queued in master-next waiting for 3.4 to open for development.
  • We do have some development series undergoing review now such as the PRServ rework and changes to the git fetcher to make it more efficient.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M4 is out of QA.

YP 3.4 Milestone Dates:

  • YP 3.4 M1 build date 2021/06/07
  • YP 3.4 M1 Release date 2021/06/18
  • YP 3.4 M2 build date 2021/07/12
  • YP 3.4 M2 Release date 2021/07/23
  • YP 3.4 M3 build date 2021/08/23
  • YP 3.4 M3 Release date 2021/09/03
  • YP 3.4 M4 build date 2021/10/04
  • YP 3.4 M4 Release date 2021/10/29

Planned upcoming dot releases:

  • YP 3.1.7 is being built.
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28
  • YP 3.3.1 build date 2021/05/24
  • YP 3.3.1 release date 2021/06/04
  • YP 3.1.9 build date 2021/06/21
  • YP 3.1.9 release date 2021/07/02
  • YP 3.1.10 build date 2021/07/26
  • YP 3.1.10 release date 2021/08/06
  • YP 3.3.2 build date 2021/08/09
  • YP 3.3.2 release date 2021/08/20
  • YP 3.1.11 build date 2021/09/13
  • YP 3.1.11 release date 2021/9/24

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Apr. 6, 2021

Current Dev Position: YP 3.3 M4 (Feature Freeze)
Next Deadline: 5th April 2021 YP 3.3 M4 build

Next Team Meetings:

Key Status/Updates:

  • We are now close to building YP 3.3 rc1 for the final release. That build may happen later today if three are no more urgent pending changes. The biggest blockers on release may be the changelog/release notes and migration guide as those have not been started yet.
  • YP 3.2.3 was released.
  • We did merge a change to oeqa/runqemu to allow the qemu images to be run from a tmpfs. This should mean writes aren’t held up in the IO queue which we believe may have been a cause of the intermittent failures. Unfortunately we can’t use cgroups as the versions on most of the autobuilder workers isn’t recent enough for IO priorities, even ignoring the permission issues so this tmpfs solution seemed like the best option and was not very invasive to implement. It does mean we now see the “qemu didn’t start in 120s” error instead much more regularly if the copy into tmpfs is locked.
  • There are a number of patches queued in master-next but most are version upgrades which will wait for 3.4 to open for development.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.3 has been released.
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Mar. 30, 2021

Current Dev Position: YP 3.3 M4 (Feature Freeze)
Next Deadline: 5th April 2021 YP 3.3 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 M3 has been released, the issue with beaglebone was resolved.
  • YP 3.2.3 has been built and is in QA.
  • It was a quiet week for patches whilst the M3 issues were resolved. We’re not taking non-essential version upgrades at this point. There are some tweaks to meson’s native build handling and some selftest parallelism unittest output handling fixes pending.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 has been released.
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.3 is in QA.
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Mar. 23, 2021

Current Dev Position: YP 3.3 M4 (Feature Freeze)
Next Deadline: 5th April 2021 YP 3.3 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 M3 rc1 had an issue with the beaglebone reference platform. As such, we plan to build an rc2 when this has been fixed.
  • The release series name for core has been bumped to “hardknott” and the previous one, “gatesgarth” has now been removed. We do this so that layers being actively maintained can be clearly identified compared to those which are not. *Layers will need to be updated to show compatibility with the 3.3 core.
  • We’ve taken a number of version upgrades and other changes as the benefits to taking them seem to outweigh the potential risk.
  • There is a pending change to remove ‘stale’ sstate task output before the main build starts in master-next. This has been testing for a while with no reports of issues and seems to perform well so will likely be included in M3 rc2.
  • “Pending” state patch review is still needed, we have some really old stale ones which really need decisions to be made about their future. It would help a lot if recipe maintainers could review recipe patchsets and upstream them or remove them if they are no longer relevant.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • We are working to identify the load pattern on the infrastructure that seems to trigger these.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 will go back to QA for rc2 soon.
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.3 build date 2021/03/22
  • YP 3.2.3 release date 2021/04/02
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Mar. 16, 2021

Current Dev Position: YP 3.3 M4 (Feature Freeze)
Next Deadline: 5th April 2021 YP 3.3 M4 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 M3 has been built and is now in QA.
  • We were able to track down the parsing performance regressions and patches in master have addressed those (thanks Peter).
  • We have merged REQUIRED_VERSION support to bitbake which works in a similar way to PREFERRED_VERSION but is a mandatory directive rather than optional.
  • Reproducibility has improved again with ltp fixed, perf fixed and fixes pending for meson and ovmf. This leaves ruby-docs and the Go Language issues,

https://www.yoctoproject.org/reproducible-build-results/

  • qemuppc64 and qemuriscv32 machines were added. These are not officially supported/tested but have been added to oe-core to allow development to focus around them rather than happening ad hoc externally. For official support of these platforms there would need to be some funding for the autobuilder resources needed through project members sponsoring that work.
  • A new Azure Storage fetcher was added to bitbake.
  • “Pending” state patch review is still needed, we have some really old stale ones which really need decisions to be made about their future. It would help a lot if recipe maintainers could review recipe patchsets and upstream them or remove them if they are no longer relevant.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT We are working to identify the load pattern on the infrastructure that seems to trigger these. We have seen a sharp rise in numbers of issues with the new more rigorous swat process.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 is in QA
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.3 build date 2021/03/22
  • YP 3.2.3 release date 2021/04/02
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Mar. 9, 2021

Current Dev Position: YP 3.3 Feature Freeze
Next Deadline: 1st March 2021 YP 3.3 M3 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 M3 is due to build soon, we are now at feature freeze
  • M3 has not been built yet whilst the status of various pending patches was ascertained and several bugs investigated. A key runqueue bug in bitbake was finally identified and resolved, other seeming state manifest issues were traced to a bad patch. There is a performance regression which still needs debugging and fixing. We also need to get a better understanding of autobuilder load issues triggering intermittent failures although that may be deferred to M4.
  • It looks like the rust addition patches will be deferred to 3.4, as will the PR server changes.
  • Reproducibility is trending well for this release at 99.83% with a remaining intermittent issue in ltp due to be fixed imminently. Meson and ruby have intermittent issues, ovmf has a hardcoded path and much progress has been made in resolving the perf issues so hopefully that will be fixed soon. The only other issue is Go Language related. https://www.yoctoproject.org/reproducible-build-results/ We had a mention in Reproducible Builds newsletter: https://reproducible-builds.org/reports/2021-02/
  • “Pending” state patch review is still needed, we have some really old stale ones which really need decisions to be made about their future. It would help a lot if recipe maintainers could review recipe patchsets and upstream them or remove them if they are no longer relevant.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.3 build date 2021/03/08
  • YP 3.2.3 release date 2021/03/19
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Mar. 2, 2021

Current Dev Position: YP 3.3 Feature Freeze
Next Deadline: 1st March 2021 YP 3.3 M3 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.2.2 and YP 3.1.6 were released.
  • YP 3.3 M3 is due to build soon, we are now at feature freeze
  • Reproducibility has improved over the last week with a number of fixes added meaning the exclusion list has been significantly reduced. Many of the fixes were accepted by upstream projects too. The remaining reproducibility issues now have bugs open in bugzilla. In particular, meson and ruby have intermittent issues, perf and ovmf have hardcoded path problems and ltp whilst improved, still appears to have issues. https://www.yoctoproject.org/reproducible-build-results/
  • Infrastructure issues around diffoscope and performance of reproducibility tests have been fixed, both by us and upstream diffoscope which should resolve delays in builds and improve testing throughput.
  • Looking through some of the patches in the “Pending” state, we have some really old stale ones which really need decisions to be made about their future. It would help a lot if recipe maintainers could review recipe patchsets and upstream them or remove them if they are no longer relevant.
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.2 is released.
  • YP 3.1.6 is released.
  • YP 3.2.3 build date 2021/03/08
  • YP 3.2.3 release date 2021/03/19
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09
  • YP 3.2.4 build date 2021/05/3
  • YP 3.2.4 release date 2021/05/14
  • YP 3.1.8 build date 2021/05/17
  • YP 3.1.8 release date 2021/05/28

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Feb. 23, 2021

Current Dev Position: YP 3.3 M3 development
Next Deadline: 1st March 2021 YP 3.3 M3 build and YP 3.3 Feature Freeze

Next Team Meetings:

Key Status/Updates:

  • YP 3.2.2 has passed QA cleanly and awaiting final release approval.
  • YP 3.1.6 has been built and is in QA.
  • We have one week left before M3 is due to be built. This marks our feature freeze point for YP 3.3.
  • We are trying to add rpm to reproducibility testing however there are several issues we need to resolve before that can merge.
  • Looking through some of the patches in the “Pending” state, we have some really old stale ones which really need decisions to be made about their future. It would help a lot if recipe maintainers could review recipe patchsets and upstream them or remove them if they are no longer relevant.
  • The glibc 2.33 issues encountered should now hopefully be resolved with the latest pseudo changes.
  • Most of the successful AUH (Automatic Upgrade Helper) patches are now merged or queued however many of the failed upgrades have yet to be handled
  • Intermittent autobuilder issues continue to occur and are now at a record high level. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.2 being reviewed for release.
  • YP 3.1.6 is in QA.
  • YP 3.2.3 build date 2021/03/08
  • YP 3.2.3 release date 2021/03/19
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Feb. 16, 2021

Current Dev Position: YP 3.3 M3 development
Next Deadline: 1st March 2021 YP 3.3 M3 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.2.2 is currently building.
  • We’ve been upgrading uninative and buildtools-extended-tarball however glibc 2.33 has caused issues with build in containers and with pseudo. Hopefully these issues are now resolved or worked around with the latest patches.
  • There is apparently a reputation that Yocto Project is not reproducible. It’s builds are! We now have an live status report on our website for this: https://www.yoctoproject.org/reproducible-build-results/ showing the status live from the autobuilder (thanks Joshua and Michael)
  • Given the above, we’ve managed to improve the reproducible selftest by separating to its own autobuilder target and showing which exclusions are no longer needed.
  • We have also fixed reproducibility issues in a number of recipes. There are still some low hanging issues in the current exclusion list.
  • The AUH (Automatic Upgrade Helper) has run and was relatively successful, please help us get the version upgrades in before M3 builds on the 1st.
  • We’ve changed the default umask applying to tasks in builds to make it easier to avoid reproducibility issues (bitbake now has a BB_DEFAULT_UMASK variable).
  • Intermittent autobuilder issues continue to occur. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.2 is building
  • YP 3.2.2 release date 2021/02/19
  • YP 3.1.6 build date 2021/02/22
  • YP 3.1.6 release date 2021/03/05
  • YP 3.2.3 build date 2021/03/08
  • YP 3.2.3 release date 2021/03/19
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Feb. 9, 2021

Current Dev Position: YP 3.3 M3 development
Next Deadline: 1st March 2021 YP 3.3 M3 build

Next Team Meetings:

Key Status/Updates:

  • We’ve merged a number of key upgrades to glibc, binutils and autoconf in particular which has caused some issues in other layers. Thanks to everyone helping work through those issues.
  • We’ve upgraded uninative, with a final 2.32 version containing an upstream fix and then a version with 2.33. There are early reports there may be a build issue with kernels and 2.33.
  • Intermittent autobuilder issues continue to occur. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • There are some interesting insights from the SWAT status reports that are now being generated, in particular they show the frequency that some bugs are occurring which should help us try and target the most problematic failures: https://lists.yoctoproject.org/g/swat/topic/swat_statistics_for_week_05/80466229 The reports can be seen on the swat mailing list (which anyone can join).

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.2 build date 2021/02/08
  • YP 3.2.2 release date 2021/02/19
  • YP 3.1.6 build date 2021/02/22
  • YP 3.1.6 release date 2021/03/05
  • YP 3.2.3 build date 2021/03/08
  • YP 3.2.3 release date 2021/03/19
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Feb. 2, 2021

Current Dev Position: YP 3.3 M3 development
Next Deadline: 1st March 2021 YP 3.3 M3 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 M2 was released
  • We have a new simple system to help with the SWAT process, “SwatBot”, https://swatbot.yoctoproject.org/ which has quickly evolved over the last week and is now taking over from the wiki BuildLog for the SWAT process.
  • We’re due to merge autoconf 2.71 which is now working for the core layers and automated tests but will need work to make meta-openembedded work with it.
  • We managed a small performance improvement to builds over the last week (5-7% overall) which appears to be from some of the GL native tools changes rather surprisingly
  • There were also significant reductions in the numbers of files being installed into the recipe sysroots (around 14,000 fewer files for some recipes for each workdir) which should aid overall build performance (and e.g. ease of build directory deletion)
  • There was a fix for pseudo to improve handling of renamed files which may account for some of the pseudo issues we’ve seen recently, it certainly caused problems with the new binutils release (not yet merged).

Intermittent autobuilder issues continue to occur. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M2 was released.
  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.2 build date 2021/02/08
  • YP 3.2.2 release date 2021/02/19
  • YP 3.1.6 build date 2021/02/22
  • YP 3.1.6 release date 2021/03/05
  • YP 3.2.3 build date 2021/03/08
  • YP 3.2.3 release date 2021/03/19
  • YP 3.1.7 build date 2021/03/29
  • YP 3.1.7 release date 2021/04/09

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Jan. 26, 2021

Current Dev Position: YP 3.3 M3 development
Next Deadline: 1st March 2021 YP 3.3 M3 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 M2 is currently in QA and we are now in the final development milestone M3 for 3.3
  • YP 3.1.5 was released.
  • We have a new simple system to help with the SWAT process, “SwatBot”, https://swatbot.yoctoproject.org/ . This aims to simplify the SWAT process by listing the exact list of issues which need to be triaged and tracks the resolutions. *It will mainly be of use to anyone participating in the SWAT process but mentioned here as people may see mention of it.
  • Intermittent autobuilder issues continue to occur and with more invasive changes and higher rebuild rates, the numbers are increasing again. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • An interesting idea came up in discussion with Kernel CI about potentially sharing YP autobuilder results into their system. There is an open bug for anyone interested in helping with or tracking this: https://bugzilla.yoctoproject.org/show_bug.cgi?id=14196. It could also be an interesting use case for generating an SBOM with our output artefacts.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M2 was built and is in QA.
  • YP 3.3 M2 Release date 2021/01/29
  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.1.5 was released.
  • YP 3.2.2 build date 2021/02/08
  • YP 3.2.2 release date 2021/02/19
  • YP 3.1.6 build date 2021/02/22
  • YP 3.1.6 release date 2021/03/05
  • YP 3.1.7 build date 2021/03/22
  • YP 3.1.7 release date 2021/04/02

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Jan. 19, 2021

Current Dev Position: YP 3.3 M2 development
Next Deadline: 18th January 2021 YP 3.3 M2 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.3 M2 is due to be built once the currently queued patches are stalised.
  • YP 3.1.5 has been built and is through QA and likely to be released imminently after TSC review.
  • We’re pleased to announce that Bootlin are going to be helping with the build and integration work for the project, we’d like to welcome them on board and also thank the projects member companies for making this possible.
  • Builds are continuing to show some intermittent instability. Unfortunately we also suffered NAS issues and whilst there has been no data loss, recovery of the system is slowing the autobuilder temporarily.
  • Intermittent autobuilder issues continue to occur and with more invasive changes and higher rebuild rates, the numbers are increasing again. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M2 build date 2021/01/18
  • YP 3.3 M2 Release date 2021/01/29
  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.1.5 is out of QA
  • YP 3.2.2 build date 2021/02/08
  • YP 3.2.2 release date 2021/02/19
  • YP 3.1.6 build date 2021/02/22
  • YP 3.1.6 release date 2021/03/05
  • YP 3.1.7 build date 2021/03/22
  • YP 3.1.7 release date 2021/04/02

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Jan. 12, 2021

Current Dev Position: YP 3.3 M2 development
Next Deadline: 18th January 2021 YP 3.3 M2 build

Next Team Meetings:

Key Status/Updates:

  • Patches for 3.3 M2 development are being tested and merged. We have one week left before M2 is due to be built.
  • It was a mixed week for builds and patches, several reproducibility issues appeared and issues also appeared after patches had merged in the second or third build after that due to state reuse and differences between worker distros. This makes merging the patches challenging.
  • In particular, an upgrade to qemu 5.2.0 did merge. That upgrade includes a change to the underlying build system and the patchset was significantly rationalised which may cause issues. In particular, issues on centos hosts were eventually traced to the mmap_min_addr setting being too low (65536 now seems to be the useful minimum).
  • We are now tracking intermittent ptest failures and a number of bugs have been opened for these, we don’t as yet have people able to work on them though.
  • CVE metrics are starting to trend down again but we still have 56 “open” CVEs against master and more in gatesgath/dunfell so help in further reducing the number would be appreciated.
  • Intermittent autobuilder issues continue to occur and with more invasive changes and higher rebuild rates, the numbers are increasing again. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M2 build date 2021/01/18
  • YP 3.3 M2 Release date 2021/01/29
  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.1.5 build date 2021/01/11
  • YP 3.1.5 release date 2021/01/22
  • YP 3.2.2 build date 2021/02/08
  • YP 3.2.2 release date 2021/02/19
  • YP 3.1.6 build date 2021/02/22
  • YP 3.1.6 release date 2021/03/05
  • YP 3.1.7 build date 2021/03/22
  • YP 3.1.7 release date 2021/04/02

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status Jan. 5, 2021

Current Dev Position: YP 3.3 M2 development
Next Deadline: 18th January 2021 YP 3.3 M2 build

Next Team Meetings:

Key Status/Updates:

  • YP 3.2.1 and YP 3.3 M1 were released
  • Patches for 3.3 M2 development are being tested and merged. We have two weeks before M2 is due to be built.
  • Many version upgrades have been merged and the project has worked closely with the upcoming autoconf and ppp releases to reduce our patch deficit and ensure we’re ready for them.
  • We have seen a number of reproducibility failures from the increased test coverage on the autobuilder, several of the issues have had fixes.
  • We are now tracking intermittent ptest failures and a number of bugs have been opened for these, we don’t as yet have people able to work on them though.
  • CVE metrics have trended slowly downwards, thanks to everyone sending patches and quietly improving things either through patches or better CVE definitions upstream.
  • Intermittent autobuilder issues continue to occur. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT
  • The LTS release has changed documentation format from docbook over to sphinx to match master as it should be more maintainable and consistent with the project over the planned life of the LTS.
  • For the LTS, there is also discussion on whether the wider reproducibility testing should be enabled as recently done in master due to the number of potential issues which may need to be fixed (master isn’t 100% working yet) as well as whether the pseudo path filtering should be backported. Please do give input to discussions on these topics on the mailing lists.

Ways to contribute:

YP 3.3 Milestone Dates:

  • YP 3.3 M1 is released
  • YP 3.3 M2 build date 2021/01/18
  • YP 3.3 M2 Release date 2021/01/29
  • YP 3.3 M3 build date 2021/03/01
  • YP 3.3 M3 Release date 2021/03/12
  • YP 3.3 M4 build date 2021/04/05
  • YP 3.3 M4 Release date 2021/04/30

Planned upcoming dot releases:

  • YP 3.2.1 is released
  • YP 3.1.5 build date 2021/01/11
  • YP 3.1.5 release date 2021/01/22
  • YP 3.2.2 build date 2021/02/08
  • YP 3.2.2 release date 2021/02/19
  • YP 3.1.6 build date 2021/02/22
  • YP 3.1.6 release date 2021/03/05
  • YP 3.1.7 build date 2021/03/22
  • YP 3.1.7 release date 2021/04/02

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Personal tools