2023 Yocto Project Weekly Status Archive: Difference between revisions

From Yocto Project
Jump to navigationJump to search
Line 1: Line 1:
== Yocto Project Weekly Status January 31st, 2023 ==
Current Dev Position: YP 4.2 M3<br/>
Next Deadline: 20th February 2023 YP 4.2 M3 Build<br/>
'''Next Team Meetings:'''<br/>
*Bug Triage meeting Thursday February 2nd 7:30 am PDT (https://zoom.us/j/454367603?pwd=ZGxoa2ZXL3FkM3Y0bFd5aVpHVVZ6dz09)
*Weekly Engineering Sync Tuesday January 31st 8 am PDT (https://zoom.us/j/990892712?pwd=cHU1MjhoM2x6ck81bkcrYjRrcmJsUT09)
*Twitch -  See https://www.twitch.tv/theyoctojester
'''Key Status/Updates:'''<br/>
*YP 4.0.7 and YP 4.2 M2 are in QA
*We switched to the 6.1 kernel by default for M2. Unfortunately there are a couple of intermittent issues that seem to have crept in. One is a reproducibility issue in perf, likely with some host component causing it as it only occurs on second builds. The second appears to be an intermittent networking issue accessing a python http-server for testing dnf which appeared after the kernel version change.
*We are continuing to see other intermittent failures which are limiting how quickly we can merge changes. A summary of some of the key issues was sent to the mailing list: https://lists.openembedded.org/g/openembedded-core/message/176476
*There have been changes to the way the codeparser cache in bitbake stores data which should reduce cache size, reduce the times data needs to be written out and generally help performance.
*CVE levels in master are still high but there are patches in progress for most issues as I understand it.
*We have a growing number of bugs in bugzilla, any help with them is appreciated.
'''Ways to contribute:'''<br/>
*As people are likely aware, the project has a number of components which are either unmaintained, or have people with little to no time trying to keep them alive. These components include: patchtest, layerindex, devtool, toaster, wic, oeqa, autobuilder, CROPs containers, pseudo and more. Many have open bugs. Help is welcome in trying to better look after these components!
*There are bugs identified as possible for newcomers to the project: https://wiki.yoctoproject.org/wiki/Newcomers
*There are bugs that are currently unassigned for YP 4.2. See: https://wiki.yoctoproject.org/wiki/Bug_Triage#Medium.2B_4.2_Unassigned_Enhancements.2FBugs
*We’d welcome new maintainers for recipes in OE-Core. Please see the list at: http://git.yoctoproject.org/cgit.cgi/poky/tree/meta/conf/distro/include/maintainers.inc and discuss with the existing maintainer, or ask on the OE-Core mailing list. We will likely move a chunk of these to “Unassigned” soon to help facilitate this.
*Help is very much welcome in trying to resolve our autobuilder intermittent issues. You can see the list of failures we’re continuing to see by searching for the “AB-INT” tag in bugzilla: https://bugzilla.yoctoproject.org/buglist.cgi?quicksearch=AB-INT.
*Help us resolve CVE issues: CVE metrics
'''YP 4.2 Milestone Dates:'''<br/>
*YP 4.2 M2 built and in QA
*YP 4.2 M3 build date 2023/02/20
*YP 4.2 M3 Release date 2023/03/03
*YP 4.2 M4 build date 2023/04/03
*YP 4.2 M4 Release date 2023/04/28
'''Upcoming dot releases:'''<br/>
*YP 4.0.7 built and in QA
*YP 3.1.23 build date 2023/02/13
*YP 3.1.23 Release date 2023/02/24
*YP 4.0.8 build date 2023/02/27
*YP 4.0.8 Release date 2023/03/10
*YP 4.1.3 build date 2023/03/06
*YP 4.1.3 Release date 2023/03/17
*YP 3.1.24 build date 2023/03/20
*YP 3.1.24 Release date 2023/03/31
*YP 4.0.9 build date 2023/04/10
*YP 4.0.9 Release date 2023/04/21
*YP 4.1.4 build date 2023/05/01
*YP 4.1.4 Release date 2023/05/13
*YP 3.1.25 build date 2023/05/08
*YP 3.1.25 Release date 2023/05/19
*YP 4.0.10 build date 2023/05/15
*YP 4.0.10 Release date 2023/05/26
'''Tracking Metrics:'''<br/>
*WDD 2447 (last week 2442) (https://wiki.yoctoproject.org/charts/combo.html)
*OE-Core/Poky Patch Metrics
**Total patches found: 1205 (last week 1190)
**Patches in the Pending State: 280 (23%) [last week 279 (23%)]
*https://autobuilder.yocto.io/pub/non-release/patchmetrics/
'''The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:'''<br/>
https://wiki.yoctoproject.org/wiki/TSC<br/>
== Yocto Project Weekly Status January 24th, 2023 ==
== Yocto Project Weekly Status January 24th, 2023 ==
Current Dev Position: YP 4.2 M2<br/>
Current Dev Position: YP 4.2 M2<br/>
Line 64: Line 124:
'''The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:'''<br/>
'''The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:'''<br/>
https://wiki.yoctoproject.org/wiki/TSC<br/>
https://wiki.yoctoproject.org/wiki/TSC<br/>
== Yocto Project Weekly Status January 17th, 2023 ==
== Yocto Project Weekly Status January 17th, 2023 ==
Current Dev Position: YP 4.2 M2<br/>
Current Dev Position: YP 4.2 M2<br/>

Revision as of 14:21, 31 January 2023

Yocto Project Weekly Status January 31st, 2023

Current Dev Position: YP 4.2 M3
Next Deadline: 20th February 2023 YP 4.2 M3 Build

Next Team Meetings:

Key Status/Updates:

  • YP 4.0.7 and YP 4.2 M2 are in QA
  • We switched to the 6.1 kernel by default for M2. Unfortunately there are a couple of intermittent issues that seem to have crept in. One is a reproducibility issue in perf, likely with some host component causing it as it only occurs on second builds. The second appears to be an intermittent networking issue accessing a python http-server for testing dnf which appeared after the kernel version change.
  • We are continuing to see other intermittent failures which are limiting how quickly we can merge changes. A summary of some of the key issues was sent to the mailing list: https://lists.openembedded.org/g/openembedded-core/message/176476
  • There have been changes to the way the codeparser cache in bitbake stores data which should reduce cache size, reduce the times data needs to be written out and generally help performance.
  • CVE levels in master are still high but there are patches in progress for most issues as I understand it.
  • We have a growing number of bugs in bugzilla, any help with them is appreciated.

Ways to contribute:

YP 4.2 Milestone Dates:

  • YP 4.2 M2 built and in QA
  • YP 4.2 M3 build date 2023/02/20
  • YP 4.2 M3 Release date 2023/03/03
  • YP 4.2 M4 build date 2023/04/03
  • YP 4.2 M4 Release date 2023/04/28

Upcoming dot releases:

  • YP 4.0.7 built and in QA
  • YP 3.1.23 build date 2023/02/13
  • YP 3.1.23 Release date 2023/02/24
  • YP 4.0.8 build date 2023/02/27
  • YP 4.0.8 Release date 2023/03/10
  • YP 4.1.3 build date 2023/03/06
  • YP 4.1.3 Release date 2023/03/17
  • YP 3.1.24 build date 2023/03/20
  • YP 3.1.24 Release date 2023/03/31
  • YP 4.0.9 build date 2023/04/10
  • YP 4.0.9 Release date 2023/04/21
  • YP 4.1.4 build date 2023/05/01
  • YP 4.1.4 Release date 2023/05/13
  • YP 3.1.25 build date 2023/05/08
  • YP 3.1.25 Release date 2023/05/19
  • YP 4.0.10 build date 2023/05/15
  • YP 4.0.10 Release date 2023/05/26

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status January 24th, 2023

Current Dev Position: YP 4.2 M2
Next Deadline: 23rd January 2023 YP 4.2 M2 Build

Next Team Meetings:

Key Status/Updates:

  • YP 4.1.2 is due to be released and YP 3.1.22 is in QA
  • We had a few annoying intermittent autobuilder bug fixes this week, thanks to anyone who helped fix those!
  • Failures on the autobuilder slowed down patch testing and merging as builds took a long time to stabilize. Thankfully we believe the most frequently occurring issues have been fixed so things should speed up again a little this week.
  • CVE levels in master are becoming worrying again, help would be appreciated to address the open issues.
  • We have a growing number of bugs in bugzilla, any help with them is appreciated.

Ways to contribute:

  • YP 4.1.2 and YP 3.1.22 were released
  • YP 4.2 M2 is due to build this week.
  • Stable builds have been proving hard to obtain due to varying issues over many of the submitted patches. This has limited patch flow over the last week.
  • We were able to merge 6.1 kernel improvements and a number of good bug fixes in other areas too.
  • There has been an improvement to the configurability of patch warnings/errors and patch fuzz issues will now error and stop builds by default.
  • Warning/errors over missing Upstream-Status details in non-core layers appears too controversial to enable by default but the option is now available should users wish to.
  • CVE levels in master are becoming worrying again, Ross helpfully summarized the situation and submitted CPE changes for some of the issues being highlighted, thanks!
  • We have a growing number of bugs in bugzilla, any help with them is appreciated.

YP 4.2 Milestone Dates:

  • YP 4.2 M2 build date 2023/01/23
  • YP 4.2 M2 Release date 2023/02/03
  • YP 4.2 M3 build date 2023/02/20
  • YP 4.2 M3 Release date 2023/03/03
  • YP 4.2 M4 build date 2023/04/03
  • YP 4.2 M4 Release date 2023/04/28

Upcoming dot releases:

  • YP 4.1.2 is released
  • YP 3.1.22 is released
  • YP 4.0.7 build date 2023/01/30
  • YP 4.0.7 Release date 2023/02/10
  • YP 3.1.23 build date 2023/02/13
  • YP 3.1.23 Release date 2023/02/24
  • YP 4.0.8 build date 2023/02/27
  • YP 4.0.8 Release date 2023/03/10
  • YP 4.1.3 build date 2023/03/06
  • YP 4.1.3 Release date 2023/03/17
  • YP 3.1.24 build date 2023/03/20
  • YP 3.1.24 Release date 2023/03/31
  • YP 4.0.9 build date 2023/04/10
  • YP 4.0.9 Release date 2023/04/21
  • YP 4.1.4 build date 2023/05/01
  • YP 4.1.4 Release date 2023/05/13
  • YP 3.1.25 build date 2023/05/08
  • YP 3.1.25 Release date 2023/05/19
  • YP 4.0.10 build date 2023/05/15
  • YP 4.0.10 Release date 2023/05/26

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status January 17th, 2023

Current Dev Position: YP 4.2 M2
Next Deadline: 23rd January 2023 YP 4.2 M2 Build

Next Team Meetings:

Key Status/Updates:

  • YP 4.1.2 is due to be released and YP 3.1.22 is in QA
  • We had a few annoying intermittent autobuilder bug fixes this week, thanks to anyone who helped fix those!
  • Failures on the autobuilder slowed down patch testing and merging as builds took a long time to stabilize. Thankfully we believe the most frequently occurring issues have been fixed so things should speed up again a little this week.
  • CVE levels in master are becoming worrying again, help would be appreciated to address the open issues.
  • We have a growing number of bugs in bugzilla, any help with them is appreciated.

Ways to contribute:

YP 4.2 Milestone Dates:

  • YP 4.2 M2 build date 2023/01/23
  • YP 4.2 M2 Release date 2023/02/03
  • YP 4.2 M3 build date 2023/02/20
  • YP 4.2 M3 Release date 2023/03/03
  • YP 4.2 M4 build date 2023/04/03
  • YP 4.2 M4 Release date 2023/04/28

Upcoming dot releases:

  • YP 4.1.2 ready for release
  • YP 3.1.22 built and in QA
  • YP 3.1.22 Release date 2023/01/27
  • YP 4.0.7 build date 2023/01/30
  • YP 4.0.7 Release date 2023/02/10
  • YP 3.1.23 build date 2023/02/13
  • YP 3.1.23 Release date 2023/02/24
  • YP 4.0.8 build date 2023/02/27
  • YP 4.0.8 Release date 2023/03/10
  • YP 4.1.3 build date 2023/03/06
  • YP 4.1.3 Release date 2023/03/17
  • YP 3.1.24 build date 2023/03/20
  • YP 3.1.24 Release date 2023/03/31
  • YP 4.0.9 build date 2023/04/10
  • YP 4.0.9 Release date 2023/04/21
  • YP 4.1.4 build date 2023/05/01
  • YP 4.1.4 Release date 2023/05/13
  • YP 3.1.25 build date 2023/05/08
  • YP 3.1.25 Release date 2023/05/19
  • YP 4.0.10 build date 2023/05/15
  • YP 4.0.10 Release date 2023/05/26

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status January 10th, 2023

Current Dev Position: YP 4.2 M2
Next Deadline: 23rd January 2023 YP 4.2 M2 Build

Next Team Meetings:

Key Status/Updates:

  • YP 4.1.2 is in QA
  • A large number of package upgrades have merged bringing us up to date with various upstreams.
  • We have started moving code out of core bbclass files into the function libraries to help reduce parsing memory use, volumes of data transfer and sstate signature data sizes. Help is welcome in developing further patches to improve our function libraries.
  • The autobuilder controller has been relocated to deal with connectivity issues, we do have some issues to iron out before things are back to normal service. We were unable to upgrade the buildbot version as there were too many other moving pieces.
  • We are trying to upgrade uninative to include libgcc to deal with pthread_cancel failures. Newer versions of patchelf are proving problematic and appear to be causing segfaults and we’re trying to untangle this from other issues.
  • We have reverted the tune for qemux86-64 back to corei7-64 since we still have v2 hardware that won’t work properly with v3 under KVM and similar.
  • A uninative bug has been exposed by recent bitbake datastore improvements which could cause sstate to be missed/duplicated.
  • We merged a number of neat rust improvements which add on target cargo support and added automated QA tests for this functionality so we can ensure it continues to work and doesn’t regress. Thanks Alex Kiernan, we hope to see more series like this one!
  • CVE levels in master are becoming worrying again, help would be appreciated to address the open issues.
  • The autobuilder maintenance window now occurs on Mondays.
  • We have a growing number of bugs in bugzilla, any help with them is appreciated.

Ways to contribute:

YP 4.2 Milestone Dates:

  • YP 4.2 M2 build date 2023/01/23
  • YP 4.2 M2 Release date 2023/02/03
  • YP 4.2 M3 build date 2023/02/20
  • YP 4.2 M3 Release date 2023/03/03
  • YP 4.2 M4 build date 2023/04/03
  • YP 4.2 M4 Release date 2023/04/28

Upcoming dot releases:

  • YP 4.1.2 built and in QA
  • YP 4.1.2 Release date 2023/01/20
  • YP 3.1.22 build date 2023/01/16
  • YP 3.1.22 Release date 2023/01/27
  • YP 4.0.7 build date 2023/01/30
  • YP 4.0.7 Release date 2023/02/10
  • YP 3.1.23 build date 2023/02/13
  • YP 3.1.23 Release date 2023/02/24
  • YP 4.0.8 build date 2023/02/27
  • YP 4.0.8 Release date 2023/03/10
  • YP 4.1.3 build date 2023/03/06
  • YP 4.1.3 Release date 2023/03/17
  • YP 3.1.24 build date 2023/03/20
  • YP 3.1.24 Release date 2023/03/31
  • YP 4.0.9 build date 2023/04/10
  • YP 4.0.9 Release date 2023/04/21
  • YP 4.1.4 build date 2023/05/01
  • YP 4.1.4 Release date 2023/05/13
  • YP 3.1.25 build date 2023/05/08
  • YP 3.1.25 Release date 2023/05/19
  • YP 4.0.10 build date 2023/05/15
  • YP 4.0.10 Release date 2023/05/26

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC

Yocto Project Weekly Status January 3rd, 2023

Current Dev Position: YP 4.2 M2
Next Deadline: 23rd January 2023 YP 4.2 M2 Build

Next Team Meetings:

Key Status/Updates:

  • YP 4.2 M1 and YP 4.0.6 were released.
  • Builds on the autobuilder are problematic at present due to connection losses with the controller machine. We understand the cause and will be migrating the controller to a new server/location in the next maintenance window to address this.
  • A number of invasive bitbake changes have merged including a change to add threading to bitbake’s server/cooker. This will allow us to attempt to resolve various UI/server hang related open bugs and to improve the user experience, e.g. Ctrl+C handling. If people do see issues with hangs, please report them and include the tail end of the bitbake-cookerdaemon.log file.
  • The bitbake cache changes to optionally include more hash debugging information did merge. This currently triggers only for the bitbake -S operations but once that mode is triggered for memory resident bitbake, it is “sticky” and will remain set until it unloads. We have seen some OOM issues on autobuilder workers which may be related to this, more debugging is needed to check on bitbake’s memory usage.
  • Automatic bitbake function library dependency code has also merged and is active. This should let us migrate class code to become library code for performance improvements.
  • A bug in the layer.conf variable changes was identified which was causing re-parsing when it wasn’t necessary. A fix has been merged to address that.
  • The OE TSC decided in favour of adding export flag expansion despite the performance impact so that patch will be queued.
  • We merged a number of neat rust improvements which add on target cargo support and added automated QA tests for this functionality so we can ensure it continues to work and doesn’t regress. Thanks Alex Kiernan, we hope to see more series like this one!
  • CVE levels in master have improved but still need a little work
  • The autobuilder maintenance window is moving from Friday to Monday.
  • We have a growing number of bugs in bugzilla, any help with them is appreciated.

Ways to contribute:

YP 4.2 Milestone Dates:

  • YP 4.2 M1 is released
  • YP 4.2 M2 build date 2023/01/23
  • YP 4.2 M2 Release date 2023/02/03
  • YP 4.2 M3 build date 2023/02/20
  • YP 4.2 M3 Release date 2023/03/03
  • YP 4.2 M4 build date 2023/04/03
  • YP 4.2 M4 Release date 2023/04/28

Upcoming dot releases:

  • YP 4.0.6 is released
  • YP 4.1.2 build date 2023/01/09
  • YP 4.1.2 Release date 2023/01/20
  • YP 3.1.22 build date 2023/01/16
  • YP 3.1.22 Release date 2023/01/27
  • YP 4.0.7 build date 2023/01/30
  • YP 4.0.7 Release date 2023/02/10
  • YP 3.1.23 build date 2023/02/13
  • YP 3.1.23 Release date 2023/02/24
  • YP 4.0.8 build date 2023/02/27
  • YP 4.0.8 Release date 2023/03/10
  • YP 4.1.3 build date 2023/03/06
  • YP 4.1.3 Release date 2023/03/17
  • YP 3.1.24 build date 2023/03/20
  • YP 3.1.24 Release date 2023/03/31
  • YP 4.0.9 build date 2023/04/10
  • YP 4.0.9 Release date 2023/04/21
  • YP 4.1.4 build date 2023/05/01
  • YP 4.1.4 Release date 2023/05/13
  • YP 3.1.25 build date 2023/05/08
  • YP 3.1.25 Release date 2023/05/19
  • YP 4.0.10 build date 2023/05/15
  • YP 4.0.10 Release date 2023/05/26

Tracking Metrics:

The Yocto Project’s technical governance is through its Technical Steering Committee, more information is available at:
https://wiki.yoctoproject.org/wiki/TSC