[OE-Core][kirkstone][PATCH] openssh: Add CVE-2023-51767 to CVE_CHECK_IGNORE

2024-04-03 Thread sana kazi
From: Sana Kazi 

Add CVE-2023-51767 to CVE_CHECK_IGNORE to avoid in cve-check reports
as upstream does not consider CVE-2023-51767 a bug underlying in
OpenSSH and does not intent to address it in OpenSSH.

Signed-off-by: Sana Kazi 
Signed-off-by: Sana Kazi 
---
 meta/recipes-connectivity/openssh/openssh_8.9p1.bb | 5 +
 1 file changed, 5 insertions(+)

diff --git a/meta/recipes-connectivity/openssh/openssh_8.9p1.bb 
b/meta/recipes-connectivity/openssh/openssh_8.9p1.bb
index bc8e2d81b8..6411a64eff 100644
--- a/meta/recipes-connectivity/openssh/openssh_8.9p1.bb
+++ b/meta/recipes-connectivity/openssh/openssh_8.9p1.bb
@@ -49,6 +49,11 @@ CVE_CHECK_IGNORE += "CVE-2014-9278"
 # CVE only applies to some distributed RHEL binaries
 CVE_CHECK_IGNORE += "CVE-2008-3844"
 
+# Upstream does not consider CVE-2023-51767 a bug underlying in OpenSSH and
+# does not intent to address it in OpenSSH
+# https://security-tracker.debian.org/tracker/CVE-2023-51767
+CVE_CHECK_IGNORE += "CVE-2023-51767"
+
 PAM_SRC_URI = "file://sshd"
 
 inherit manpages useradd update-rc.d update-alternatives systemd
-- 
2.17.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197946): 
https://lists.openembedded.org/g/openembedded-core/message/197946
Mute This Topic: https://lists.openembedded.org/mt/105324404/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] util-linux: Set the license for util-linux-fcntl-lock to MIT

2024-04-03 Thread Alexandre Belloni via lists.openembedded.org
Hello,

This caused:

https://autobuilder.yoctoproject.org/typhoon/#/builders/117/builds/4604/steps/12/logs/stdio
https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20240403-u_hyp_wv/packages/diff-html/

I guess we need to bump PR?

On 02/04/2024 06:56:54+0200, Peter Kjellerstedt wrote:
> This avoids problems if BSD-4-Clause is in INCOMPATIBLE_LICENSE since
> util-linux-fcntl-lock is now a dependency of run-postinsts.
> 
> Signed-off-by: Peter Kjellerstedt 
> ---
>  meta/recipes-core/util-linux/util-linux.inc | 1 +
>  1 file changed, 1 insertion(+)
> 
> diff --git a/meta/recipes-core/util-linux/util-linux.inc 
> b/meta/recipes-core/util-linux/util-linux.inc
> index f4b547215e..d506783f9a 100644
> --- a/meta/recipes-core/util-linux/util-linux.inc
> +++ b/meta/recipes-core/util-linux/util-linux.inc
> @@ -7,6 +7,7 @@ disk partitioning, kernel message management, filesystem 
> creation, and system lo
>  SECTION = "base"
>  
>  LICENSE = "GPL-1.0-or-later & GPL-2.0-or-later & LGPL-2.1-or-later & 
> BSD-2-Clause & BSD-3-Clause & BSD-4-Clause & MIT"
> +LICENSE:${PN}-fcntl-lock = "MIT"
>  LICENSE:${PN}-fdisk = "GPL-1.0-or-later"
>  LICENSE:${PN}-libblkid = "LGPL-2.1-or-later"
>  LICENSE:${PN}-libfdisk = "LGPL-2.1-or-later"

> 
> 
> 


-- 
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197945): 
https://lists.openembedded.org/g/openembedded-core/message/197945
Mute This Topic: https://lists.openembedded.org/mt/105282531/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH v5 1/3] nfs-utils: clean up startup

2024-04-03 Thread Dan McGregor
Thanks. All my local testing against the defaults is now working as of v7.
New upstream statuses in patches and fixed packaging errors I had
introduced.

On Sun, Mar 31, 2024, 15:34 Alexandre Belloni 
wrote:

> This still fails on the AB:
>
>
> https://autobuilder.yoctoproject.org/typhoon/#/builders/23/builds/9115/steps/14/logs/stdio
>
> On 28/03/2024 19:24:10-0600, Dan McGregor wrote:
> > From: Daniel McGregor 
> >
> > Change the sysvinit script to start at the S runlevel, this matches
> > Debian, and prevents systemd from generating a unit file for it.
> > Also have the nfsd systemd service request the nfsd kernel filesystem
> > mountpoint. This avoids startup failures in unpriviled containers
> > or other setups that don't support the filesystem.
> >
> > Signed-off-by: Daniel McGregor 
> > ---
> >  meta/recipes-connectivity/nfs-utils/nfs-utils/nfscommon | 4 ++--
> >  meta/recipes-connectivity/nfs-utils/nfs-utils_2.6.4.bb  | 9 -
> >  2 files changed, 6 insertions(+), 7 deletions(-)
> >
> > diff --git a/meta/recipes-connectivity/nfs-utils/nfs-utils/nfscommon
> b/meta/recipes-connectivity/nfs-utils/nfs-utils/nfscommon
> > index 992267d5a16..4c1ad17c3c6 100644
> > --- a/meta/recipes-connectivity/nfs-utils/nfs-utils/nfscommon
> > +++ b/meta/recipes-connectivity/nfs-utils/nfs-utils/nfscommon
> > @@ -3,7 +3,7 @@
> >  # Provides:  nfs-common
> >  # Required-Start:$portmap hwclock
> >  # Required-Stop: $portmap hwclock
> > -# Default-Start: 2 3 4 5
> > +# Default-Start: S
> >  # Default-Stop:  0 1 6
> >  # Short-Description: NFS support for both client and server
> >  # Description:   NFS is a popular protocol for file sharing across
> > @@ -20,7 +20,7 @@
> >  . /etc/init.d/functions
> >
> >  test -x "$NFS_STATD" || NFS_STATD=/usr/sbin/rpc.statd
> > -test -z "$STATD_PID" && STATD_PID=/var/run/rpc.statd.pid
> > +test -z "$STATD_PID" && STATD_PID=/run/rpc.statd.pid
> >  #
> >  # The default state directory is /var/lib/nfs
> >  test -n "$NFS_STATEDIR" || NFS_STATEDIR=/var/lib/nfs
> > diff --git a/meta/recipes-connectivity/nfs-utils/nfs-utils_2.6.4.bb
> b/meta/recipes-connectivity/nfs-utils/nfs-utils_2.6.4.bb
> > index 2f2644f9a83..527fcd609c1 100644
> > --- a/meta/recipes-connectivity/nfs-utils/nfs-utils_2.6.4.bb
> > +++ b/meta/recipes-connectivity/nfs-utils/nfs-utils_2.6.4.bb
> > @@ -132,15 +132,14 @@ do_install:append () {
> >   install -m 0644 ${WORKDIR}/nfs-server.service
> ${D}${systemd_system_unitdir}/
> >   install -m 0644 ${WORKDIR}/nfs-mountd.service
> ${D}${systemd_system_unitdir}/
> >   install -m 0644 ${WORKDIR}/nfs-statd.service
> ${D}${systemd_system_unitdir}/
> > + install -m 0644 ${WORKDIR}/proc-fs-nfsd.mount
> ${D}${systemd_system_unitdir}/
> >   sed -i -e 's,@SBINDIR@,${sbindir},g' \
> >   -e 's,@SYSCONFDIR@,${sysconfdir},g' \
> >   -e 's,@HIGH_RLIMIT_NOFILE@,${HIGH_RLIMIT_NOFILE},g' \
> >   ${D}${systemd_system_unitdir}/*.service
> > - if
> ${@bb.utils.contains('DISTRO_FEATURES','systemd','true','false',d)}; then
> > - install -m 0644 ${WORKDIR}/proc-fs-nfsd.mount
> ${D}${systemd_system_unitdir}/
> > - install -d
> ${D}${systemd_system_unitdir}/sysinit.target.wants/
> > - ln -sf ../proc-fs-nfsd.mount
> ${D}${systemd_system_unitdir}/sysinit.target.wants/proc-fs-nfsd.mount
> > - fi
> > + # Add compatibility symlinks for the sysvinit scripts
> > + ln -s nfs-server.service
> ${D}${systemd_system_unitdir}/nfsserver.service
> > + ln -s /dev/null ${D}${systemd_system_unitdir}/nfscommon.service
> >
> >   # kernel code as of 3.8 hard-codes this path as a default
> >   install -d ${D}/var/lib/nfs/v4recovery
> > --
> > 2.41.0
> >
>
> >
> > 
> >
>
>
> --
> Alexandre Belloni, co-owner and COO, Bootlin
> Embedded Linux and Kernel engineering
> https://bootlin.com
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197944): 
https://lists.openembedded.org/g/openembedded-core/message/197944
Mute This Topic: https://lists.openembedded.org/mt/105209254/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] OE-core and meta-openembedded: a vulnerability in HTTP servers

2024-04-03 Thread Marta Rybczynska
Details: https://kb.cert.org/vuls/id/421644

Affected (amongst others): nodejs, oghttp, nghttp2, Apache httpd, go

Multiple CVEs have been issued.

Quoting from the description:

HTTP allows messages to include named fields in both header and
trailer sections. These header and trailer fields are serialised as
field blocks in HTTP/2, so that they can be transmitted in multiple
fragments to the target implementation. Many HTTP/2 implementations do
not properly limit or sanitize the amount of CONTINUATION frames sent
within a single stream. An attacker that can send packets to a target
server can send a stream of CONTINUATION frames that will not be
appended to the header list in memory but will still be processed and
decoded by the server or will be appended to the header list, causing
an out of memory (OOM) crash.

Marta

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197943): 
https://lists.openembedded.org/g/openembedded-core/message/197943
Mute This Topic: https://lists.openembedded.org/mt/105317551/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core][kirkstone][PATCH 1/1] perl: ignore CVE-2023-47100

2024-04-03 Thread Alex Stewart
CVE-2023-47100 is a duplicate of CVE-2023-47038. They have the same
advertised fix commit, which has already been merged into the
perl_5.34.3 sources used in kirkstone.

Signed-off-by: Alex Stewart 
---
 meta/recipes-devtools/perl/perl_5.34.3.bb | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/meta/recipes-devtools/perl/perl_5.34.3.bb 
b/meta/recipes-devtools/perl/perl_5.34.3.bb
index e8b518adc9..215990c8fa 100644
--- a/meta/recipes-devtools/perl/perl_5.34.3.bb
+++ b/meta/recipes-devtools/perl/perl_5.34.3.bb
@@ -48,6 +48,9 @@ PACKAGECONFIG[gdbm] = ",-Ui_gdbm,gdbm"
 # Don't generate comments in enc2xs output files. They are not reproducible
 export ENC2XS_NO_COMMENTS = "1"
 
+# Duplicate of CVE-2023-47038, which has already been patched as of perl_5.34.3
+CVE_CHECK_IGNORE:append = " CVE-2023-47100"
+
 do_configure:prepend() {
 cp -rfp ${STAGING_DATADIR_NATIVE}/perl-cross/* ${S}
 }
-- 
2.43.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197942): 
https://lists.openembedded.org/g/openembedded-core/message/197942
Mute This Topic: https://lists.openembedded.org/mt/105316085/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core][kirkstone][PATCH 0/1] Ignore CVE-2023-47100

2024-04-03 Thread Alex Stewart
CVE-2023-47100 is an NVD 9.8 vulnerability filed against perl 5.30.0,
through 5.38.2 - which includes the 5.34.3 version used in OE-core
kirkstone.

But the issue and reported fix are the same as CVE-2023-47038, whose fix
has already been merged into the 5.34.3 source. Further, both CVEs have
inaccurate configuration ranges reported on NVD. NI filed several
requests to MITRE to correct the duplication weeks ago, but there hasn't
been any action.

I manually checked the kirkstone perl sources and confirmed that the
common fix for both CVEs is in place.

-47038 is already correctly-reported as 'patched' (due to the erroneous
configuration string). This patchset further ignores the duplicate
-47100 filing.

Alex Stewart (1):
  perl: ignore CVE-2023-47100

 meta/recipes-devtools/perl/perl_5.34.3.bb | 3 +++
 1 file changed, 3 insertions(+)

-- 
2.43.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197941): 
https://lists.openembedded.org/g/openembedded-core/message/197941
Mute This Topic: https://lists.openembedded.org/mt/105316082/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 3/5] ninja: build modified version with GNU Make jobserver support

2024-04-03 Thread Martin Hundeb?ll
On Wed, 2024-04-03 at 17:58 +0200, Alexander Kanavin wrote:
> We can't carry this mass of patches. It has to land upstream first.

Understandable.

> Are you able/willing to drive the upstream pull request to
> completion?

No, I don't think so. I'm not familiar with the ninja codebase, and the
pull requests has been lingering for too long.

Another option might be to propose adding the fifo feature to the
kitware fork of ninja:
https://github.com/Kitware/ninja

They have forked ninja to get the jobserver feature in, but haven't
taken the fifo part so far.

The kitware fork is also used by buildroot:
https://gitlab.com/buildroot.org/buildroot/-/blob/master/package/ninja/ninja.mk

// Martin

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197940): 
https://lists.openembedded.org/g/openembedded-core/message/197940
Mute This Topic: https://lists.openembedded.org/mt/105304230/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core][dunfell][PATCH] licenses.conf: Add missing LGPLv2.0+ license

2024-04-03 Thread Colin McAllister via lists.openembedded.org
Adds LGPLv2.0+ license variation to match LGPLv2+.

Signed-off-by: Colin McAllister 
---
This is a much smaller change that fixes the primary issue I've hit
with SPDX generation on Dunfell, where pango_1.46.7 uses "LGPLv2.0+"
for a license, which doesn't exist in the SPDXLICENSEMAP and causes
build errors when spdx generation is enabled.

If backporting all the license changes from master is too much, I
was hoping this smaller change would be considered acceptable.
Allowing this change to merge to Dunfell before dropping support
would be greatly appreciated. :)

 meta/conf/licenses.conf | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta/conf/licenses.conf b/meta/conf/licenses.conf
index d14c365977..c78823e847 100644
--- a/meta/conf/licenses.conf
+++ b/meta/conf/licenses.conf
@@ -37,6 +37,7 @@ SPDXLICENSEMAP[GPL-3.0-only] = "GPL-3.0"
 SPDXLICENSEMAP[LGPLv2] = "LGPL-2.0"
 SPDXLICENSEMAP[LGPLv2+] = "LGPL-2.0+"
 SPDXLICENSEMAP[LGPLv2.0] = "LGPL-2.0"
+SPDXLICENSEMAP[LGPLv2.0+] = "LGPL-2.0+"
 SPDXLICENSEMAP[LGPL-2.0-only] = "LGPL-2.0"
 SPDXLICENSEMAP[LGPL2.1] = "LGPL-2.1"
 SPDXLICENSEMAP[LGPLv2.1] = "LGPL-2.1"
-- 
2.43.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197939): 
https://lists.openembedded.org/g/openembedded-core/message/197939
Mute This Topic: https://lists.openembedded.org/mt/105314896/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH][dunfell] linux-yocto/5.4: update to v5.4.273

2024-04-03 Thread Bruce Ashfield
From: Bruce Ashfield 

Updating linux-yocto/5.4 to the latest korg -stable release that comprises
the following commits:

24489321d0cd Linux 5.4.273
b37f030486d5 regmap: Add missing map->bus check
55f8ea6731aa spi: spi-mt65xx: Fix NULL pointer access in interrupt handler
59426454b812 bpf: report RCU QS in cpumap kthread
3ffe591b27fc rcu: add a helper to report consolidated flavor QS
2531f907d3e4 netfilter: nf_tables: do not compare internal table flags on 
updates
71002d9eb1ca ARM: dts: sun8i-h2-plus-bananapi-m2-zero: add regulator nodes 
vcc-dram and vcc1v2
94cb17e5cf3a octeontx2-af: Use separate handlers for interrupts
4f37d3a7e004 net/bnx2x: Prevent access to a freed page in page_pool
69f9f55891ef hsr: Handle failures in module init
f781fb5177cd rds: introduce acquire/release ordering in 
acquire/release_in_xmit()
84c510411e32 packet: annotate data-races around ignore_outgoing
889ed056eae7 hsr: Fix uninit-value access in hsr_get_node()
48cef94b6910 s390/vtime: fix average steal time calculation
305c31b9707d octeontx2-af: Use matching wake_up API variant in CGX command 
interface
b63362b317a8 usb: gadget: net2272: Use irqflags in the call to 
net2272_probe_fin
254b27c4ae2d staging: greybus: fix get_channel_from_mode() failure path
f6bf49e76f05 serial: 8250_exar: Don't remove GPIO device on suspend
8dd52ab78fd3 rtc: mt6397: select IRQ_DOMAIN instead of depending on it
ca6279d1a1ee kconfig: fix infinite loop when expanding a macro at the end 
of file
a8cc354a8155 tty: serial: samsung: fix tx_empty() to return TIOCSER_TEMT
f1c9a0c33814 serial: max310x: fix syntax error in IRQ error message
bd2f4df25945 tty: vt: fix 20 vs 0x20 typo in EScsiignore
854ebf45a4dd afs: Revert "afs: Hide silly-rename files from userspace"
afcbba70bf55 NFS: Fix an off by one in root_nfs_cat()
bcc3ec2bdbda watchdog: stm32_iwdg: initialize default timeout
e95eeb7f7d8c net: sunrpc: Fix an off by one in rpc_sockaddr2uaddr()
3b8415daaad2 scsi: bfa: Fix function pointer type mismatch for hcb_qe->cbfn
2b38dbd7facd RDMA/device: Fix a race between mad_client and cm_client init
39b1af7bc99d scsi: csiostor: Avoid function pointer casts
6d5dc96b154b ALSA: usb-audio: Stop parsing channels bits when all channels 
are found.
d7ae7d126568 clk: Fix clk_core_get NULL dereference
a1129b09228f sparc32: Fix section mismatch in leon_pci_grpci
c8c038beb40c backlight: lp8788: Fully initialize backlight_properties 
during probe
8c351a9ef5f5 backlight: lm3639: Fully initialize backlight_properties 
during probe
12a0153f78c7 backlight: da9052: Fully initialize backlight_properties 
during probe
1c8d8c6b4e70 backlight: lm3630a: Don't set bl->props.brightness in 
get_brightness
40a89f1bc42d backlight: lm3630a: Initialize backlight_properties on init
bb9981f915b9 powerpc/embedded6xx: Fix no previous prototype for 
avr_uart_send() etc.
a6e96cc26560 drm/msm/dpu: add division of drm_display_mode's hskew parameter
41eec45c7126 powerpc/hv-gpci: Fix the H_GET_PERF_COUNTER_INFO hcall return 
value checks
dfde84cc6c58 drm/mediatek: Fix a null pointer crash in 
mtk_drm_crtc_finish_page_flip
af37aed04997 media: ttpci: fix two memleaks in budget_av_attach
353f980a5d7a media: media/pci: rename VFL_TYPE_GRABBER to _VIDEO
fa83fca55cbe media: rename VFL_TYPE_GRABBER to _VIDEO
25f576552133 media: v4l2-core: correctly validate video and metadata ioctls
291cda0b805f media: go7007: fix a memleak in go7007_load_encoder
fa8b472952ef media: dvb-frontends: avoid stack overflow warnings with clang
d29ed08964ce media: pvrusb2: fix uaf in pvr2_context_set_notify
86c10c56f253 drm/amdgpu: Fix missing break in ATOM_ARG_IMM Case of 
atom_get_src_int()
23d57b99ca3f ASoC: meson: axg-tdm-interface: fix mclk setup without mclk-fs
8df143c608fc mtd: rawnand: lpc32xx_mlc: fix irq handler prototype
d9d4d1363bb1 mtd: maps: physmap-core: fix flash size larger than 32-bit
a8c73f0439f3 crypto: arm/sha - fix function cast warnings
4b6569e14226 mfd: altera-sysmgr: Call of_node_put() only when 
of_parse_phandle() takes a ref
ac1170674d54 mfd: syscon: Call of_node_put() only when of_parse_phandle() 
takes a ref
3472fa83d97e drm/tegra: put drm_gem_object ref on error in tegra_fb_create
f27aaaecf747 clk: hisilicon: hi3519: Release the correct number of gates in 
hi3519_clk_unregister()
44163c73b0dd PCI: Mark 3ware-9650SE Root Port Extended Tags as broken
9b074f2ed117 drm/mediatek: dsi: Fix DSI RGB666 formats and definitions
2e1120e48062 clk: qcom: dispcc-sdm845: Adjust internal GDSC wait times
d2f3c762bad0 media: pvrusb2: fix pvr2_stream_callback casts
e9d391cc70d3 media: pvrusb2: remove redundant NULL check
013fb5051821 media: go7007: add check of return value of go7007_read_addr()
8c2e4efe1278 media: imx: csc/scaler: fix v4l2_ctrl_handler memory leak

[OE-core] [PATCH 2/2] lttng-modules: update to v2.13.12

2024-04-03 Thread Bruce Ashfield
From: Bruce Ashfield 

We drop our previously backported patches for v6.8 kernels as they are
part of the 2.13.12 release of lttng and we add backports for v6.9+
kernels.

Bumping lttng-modules to version v2.13.12-7-g52eb2ee9, which comprises the 
following commits:

52eb2ee9 Fix: dev_base_lock removed in linux 6.9-rc1
175fe77c Fix: mm_compaction_migratepages changed in linux 6.9-rc1
303434ab Fix: ASoC add component to set_bias_level events in linux 6.9-rc1
88c4e0fe Fix: ASoC snd_doc_dapm on linux 6.9-rc1
578ab207 Fix: build kvm probe on EL 8.4+
057ad399 Fix: support ext4_journal_start on EL 8.4+
3ca21738 Fix: correct RHEL range for kmem_cache_free define
4ba4f0ec Version 2.13.12
1124749b docs: Add supported versions and fix-backport policy
c302cf1d docs: Add links to project resources
d6b75831 Fix: Correct minimum version in jbd2 SLE kernel range
9e6736d6 Fix: Handle recent SLE major version codes
5d331562 Fix: build on sles15sp4
f6800492 Compile fixes for RHEL 9.3 kernels
d988f04a Fix: ext4_discard_preallocations changed in linux 6.8.0-rc3
616c60b9 Fix: btrfs_get_extent flags and compress_type changed in linux 
6.8.0-rc1
8d195927 Fix: btrfs_chunk tracepoints changed in linux 6.8.0-rc1
7e8d89d1 Fix: strlcpy removed in linux 6.8.0-rc1
f4c1678d Fix: timer_start changed in linux 6.8.0-rc1
60a1e809 Fix: sched_stat_runtime changed in linux 6.8.0-rc1

Signed-off-by: Bruce Ashfield 
---
 ...x-ASoC-snd_doc_dapm-on-linux-6.9-rc1.patch |  93 
 ...t_runtime-changed-in-linux-6.8.0-rc1.patch |  70 --
 ...ponent-to-set_bias_level-events-in-l.patch | 132 ++
 ...mer_start-changed-in-linux-6.8.0-rc1.patch | 100 -
 ...n_migratepages-changed-in-linux-6.9-.patch |  81 +++
 ...-strlcopy-removed-in-linux-6.8.0-rc1.patch |  46 --
 ...tracepoints-changed-in-linux-6.8.0-r.patch | 124 
 ...v_base_lock-removed-in-linux-6.9-rc1.patch |  57 
 ...tent-flags-and-compress_type-changed.patch |  88 
 ..._preallocations-changed-in-linux-6.8.patch |  52 ---
 ...es_2.13.11.bb => lttng-modules_2.13.12.bb} |  12 +-
 11 files changed, 368 insertions(+), 487 deletions(-)
 create mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0001-Fix-ASoC-snd_doc_dapm-on-linux-6.9-rc1.patch
 delete mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0001-Fix-sched_stat_runtime-changed-in-linux-6.8.0-rc1.patch
 create mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0002-Fix-ASoC-add-component-to-set_bias_level-events-in-l.patch
 delete mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0002-Fix-timer_start-changed-in-linux-6.8.0-rc1.patch
 create mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0003-Fix-mm_compaction_migratepages-changed-in-linux-6.9-.patch
 delete mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0003-Fix-strlcopy-removed-in-linux-6.8.0-rc1.patch
 delete mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0004-Fix-btrfs_chunk-tracepoints-changed-in-linux-6.8.0-r.patch
 create mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0004-Fix-dev_base_lock-removed-in-linux-6.9-rc1.patch
 delete mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0005-Fix-btrfs_get_extent-flags-and-compress_type-changed.patch
 delete mode 100644 
meta/recipes-kernel/lttng/lttng-modules/0006-Fix-ext4_discard_preallocations-changed-in-linux-6.8.patch
 rename meta/recipes-kernel/lttng/{lttng-modules_2.13.11.bb => 
lttng-modules_2.13.12.bb} (72%)

diff --git 
a/meta/recipes-kernel/lttng/lttng-modules/0001-Fix-ASoC-snd_doc_dapm-on-linux-6.9-rc1.patch
 
b/meta/recipes-kernel/lttng/lttng-modules/0001-Fix-ASoC-snd_doc_dapm-on-linux-6.9-rc1.patch
new file mode 100644
index 00..9d5fd0de60
--- /dev/null
+++ 
b/meta/recipes-kernel/lttng/lttng-modules/0001-Fix-ASoC-snd_doc_dapm-on-linux-6.9-rc1.patch
@@ -0,0 +1,93 @@
+From fec007d9630e010062cf5699a08460f71f46b527 Mon Sep 17 00:00:00 2001
+From: Kienan Stewart 
+Date: Mon, 25 Mar 2024 08:54:42 -0400
+Subject: [PATCH 1/4] Fix: ASoC snd_doc_dapm on linux 6.9-rc1
+
+See upstream commit:
+
+commit 7df3eb4cdb6bbfa482f51548b9fd47c2723c68ba
+Author: Luca Ceresoli 
+Date:   Wed Mar 6 10:30:01 2024 +0100
+
+ASoC: trace: add event to snd_soc_dapm trace events
+
+Add the event value to the snd_soc_dapm_start and snd_soc_dapm_done 
trace
+events to make them more informative.
+
+Trace before:
+
+   aplay-229   [000]   250.140309: snd_soc_dapm_start:   
card=vscn-2046
+   aplay-229   [000]   250.167531: snd_soc_dapm_done:
card=vscn-2046
+   aplay-229   [000]   251.169588: snd_soc_dapm_start:   
card=vscn-2046
+   aplay-229   [000]   251.195245: snd_soc_dapm_done:
card=vscn-2046
+
+Trace after:
+
+   aplay-214   [000]   693.290612: snd_soc_dapm_start:   
card=vscn-2046 event=1
+   aplay

[OE-core] [PATCH 1/2] linux-yocto-dev: bump to v6.9

2024-04-03 Thread Bruce Ashfield
From: Bruce Ashfield 

6.9-rc2 is available, so we bump linux-yocto-dev to track.

Signed-off-by: Bruce Ashfield 
---
 meta/recipes-kernel/linux/linux-yocto-dev.bb | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-kernel/linux/linux-yocto-dev.bb 
b/meta/recipes-kernel/linux/linux-yocto-dev.bb
index bd3e5a9406..9bd219825e 100644
--- a/meta/recipes-kernel/linux/linux-yocto-dev.bb
+++ b/meta/recipes-kernel/linux/linux-yocto-dev.bb
@@ -14,7 +14,7 @@ require recipes-kernel/linux/linux-yocto.inc
 # provide this .inc to set specific revisions
 include recipes-kernel/linux/linux-yocto-dev-revisions.inc
 
-KBRANCH = "v6.8/standard/base"
+KBRANCH = "v6.9/standard/base"
 KMETA = "kernel-meta"
 
 SRC_URI = 
"git://git.yoctoproject.org/linux-yocto-dev.git;branch=${KBRANCH};name=machine;protocol=https
 \
@@ -28,7 +28,7 @@ SRC_URI = 
"git://git.yoctoproject.org/linux-yocto-dev.git;branch=${KBRANCH};name
 SRCREV_machine ?= 
'${@oe.utils.conditional("PREFERRED_PROVIDER_virtual/kernel", 
"linux-yocto-dev", "${AUTOREV}", "29594404d7fe73cd80eaa4ee8c43dcc53970c60e", 
d)}'
 SRCREV_meta ?= '${@oe.utils.conditional("PREFERRED_PROVIDER_virtual/kernel", 
"linux-yocto-dev", "${AUTOREV}", "29594404d7fe73cd80eaa4ee8c43dcc53970c60e", 
d)}'
 
-LINUX_VERSION ?= "6.8"
+LINUX_VERSION ?= "6.9"
 LINUX_VERSION_EXTENSION ?= "-yoctodev-${LINUX_KERNEL_TYPE}"
 PV = "${LINUX_VERSION}+git"
 
-- 
2.39.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197936): 
https://lists.openembedded.org/g/openembedded-core/message/197936
Mute This Topic: https://lists.openembedded.org/mt/105314387/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH v2 2/2] acpica: update to 20240322 release

2024-04-03 Thread Jon Mason
Update acpica to the latest version, comprised of the following commits:

170fc3076a86 Update changes.txt for new ACPICA release 20240322
718374cd1bc2 Update acpixf.h for new ACPICA release 20240322
d0349632b625 Update osunixxf.c license header from 2023 to 2024
c929bc0d5028 Update osunixmap.c license header from 2023 to 2024
78c34e3738bd Update osunixdir.c license header from 2023 to 2024
193a3dda90e2 Update oslinuxtbl.c license header from 2023 to 2024
edaf61c8a97d Update oszephyr.c license header from 2023 to 2024
1c5331ede7ec Update osgendbg.c license header from 2015 to 2024
ab10380db037 Update osbsdtbl.c license header from 2023 to 2024
815db2de4317 Update osefixf.c license header from 2023 to 2024
a4dab90c90a4 Update osefitbl.c license header from 2023 to 2024
4f9205ae4283 Update oseficlib.c license header from 2023 to 2024
68bc01cec3b9 Update efihello.c license header from 2023 to 2024
f71b9942deeb Update acdragonfly.h license header from 2003 to 2024
74fb08369867 Update acgetline.c license header from 2023 to 2024
c18edfb1abfb Update the copyright year in the license header from 2023 
to 2024
d58f24933d2f Get rid of MSVC warnings that arise actually due to GCC's 
new dangling pointer warning and also tGCC's blindspot to work with nested 
named structs/unions resulting in breaking of ACPI event-handling
ba8a36b5c734 events/evgpeinit: don't forget to increment registered GPE 
count
8affc87afd28 events/evxfgpe: correctly clear GPE_AUTO_ENABLED in 
AcpiSetupGpeForWake
69f81815f830 Fix Capabilities[1024] mess
3e89d40e19fc Update actbl2.h to get rid of the MSVC error C2233
a0ad1ed5105f Fix CXL 3.0 structure (RDPAS) in the CEDT table
9061cd9aa131 ACPICA: debugger: check status of AcpiEvaluateObject in 
AcpiDbWalkForFields
b9423c1d35b0 SRAT: Add dump and compiler support for RINTC affinity 
structure
93caddbf2f62 SRAT: Add RISC-V RINTC affinity structure
9788e0dc955b Modify ACPI_OBJECT_COMMON_HEADER
a6a236c44c7d Fix spelling and typos: Clean up the fix for Issue #900
b6b38edb0c18 Clean up the fix for Issue #900
8f789f356fb5 tests/common: use CopyObject instead of Store for NRMT
bce7c55e99a0 acgcc: Fix C++ issue with ACPI_FLEX_ARRAY
e3afd8e17bc8 MADT: Add new MADT GICC/GICR/ITS non-coherent flags 
handling
453a5f675677 MADT: Add GICC online capable bit handling
6cd47047aca6 Fix various spelling mistakes in text files and code 
comments
31a16a32e7f3 acpisrc: Add identifiers for the NHLT table
32260f5ce519 NHLT: Reintroduce types the table consists of
6ab5a3bb1608 AdDisassemblerHeader: omit timestamp for deterministic 
output
471de8b63a98 Fix build indeterminism for asm compiler header.
50aec3ad9364 os_specific: zephyr: update AcpiOsGetTimer with arch 
specific timer
10ae1038e51e osal: zephyr: Fix write access for mapped memory
3944ce4dd104 osal: zephyr: Fix AcpiOsPrintf implementation
a97db76b5f1c Fix issue #896
f5910dd1ab60 Attempt 1 to fix issue #900
c581606cf49b ACPI 6.5: RAS2: Add support for RAS2 table
673fc21311ff Add port definitions for CDAT SSLBIS
9c5649bd2c65 dmtbdump2: remove redundant failure check on Status
544938c98a7a dmtbdump: remove duplicated code for both paths of an if 
statement
0c7379eae2a0 NHLT: Drop preliminary support
7b10fafca61f Revert "NHLT: Declare device configuration types"
0333c2af1317 os_specific: zephyr: add generic platform support
2872257aab53 Fix segfault when error-checking mixed table types
c7171588a9f6 actbl1.h: Add EINJ CXL error types
da740d8d27ff Get rid of // style comments
75635cb363c6 NHLT: Declare device configuration types
bbd7aee285ca dmtbinfo2.c: RISC-V: Remove redundant Flags print

License-Update: copyright years

Signed-off-by: Jon Mason 
---
 .../acpica/{acpica_20230628.bb => acpica_20240322.bb} | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
 rename meta/recipes-extended/acpica/{acpica_20230628.bb => acpica_20240322.bb} 
(93%)

diff --git a/meta/recipes-extended/acpica/acpica_20230628.bb 
b/meta/recipes-extended/acpica/acpica_20240322.bb
similarity index 93%
rename from meta/recipes-extended/acpica/acpica_20230628.bb
rename to meta/recipes-extended/acpica/acpica_20240322.bb
index 16b3054c3a2b..90e3599d3243 100644
--- a/meta/recipes-extended/acpica/acpica_20230628.bb
+++ b/meta/recipes-extended/acpica/acpica_20240322.bb
@@ -10,14 +10,14 @@ HOMEPAGE = 
"https://www.intel.com/content/www/us/en/developer/topic-technology/o
 SECTION = "console/tools"
 
 LICENSE = "Intel | BSD-3-Clause | GPL-2.0-only"
-LIC_FILES_CHKSUM = 
"file://source/compiler/aslcompile.c;beginline=7;endline=150;md5=79a69059b499bccc70a484459549758f

[OE-core] [PATCH v2 1/2] acpica: use github for SRC_URI

2024-04-03 Thread Jon Mason
Github is now the location of the ACPICA source code, per
https://www.intel.com/content/www/us/en/developer/topic-technology/open/acpica/download.html
Update to this location.  Also, this allows for devtool check for new
versions (in theory), and allows for an easier collection of the
changelog when updating versions.

Using the SRCREV SHA that matches the tarball release.  So, this should
match what is currently being used.

Signed-off-by: Jon Mason 
---
 meta/recipes-extended/acpica/acpica_20230628.bb | 9 +++--
 1 file changed, 3 insertions(+), 6 deletions(-)

diff --git a/meta/recipes-extended/acpica/acpica_20230628.bb 
b/meta/recipes-extended/acpica/acpica_20230628.bb
index 8974bdc1f1a6..16b3054c3a2b 100644
--- a/meta/recipes-extended/acpica/acpica_20230628.bb
+++ b/meta/recipes-extended/acpica/acpica_20230628.bb
@@ -16,13 +16,10 @@ COMPATIBLE_HOST = "(i.86|x86_64|arm|aarch64).*-linux"
 
 DEPENDS = "m4-native flex-native bison-native"
 
-SRC_URI = "https://downloadmirror.intel.com/783534/acpica-unix-${PV}.tar.gz";
-SRC_URI[sha256sum] = 
"86876a745e3d224dcfd222ed3de465b47559e85811df2db9820ef09a9dff5cce"
+SRC_URI = "git://github.com/acpica/acpica;protocol=https;branch=master"
+SRCREV = "f16a0b4d0f0edd7b78a332fcf507be2187fac21e"
 
-UPSTREAM_CHECK_URI = 
"https://www.intel.com/content/www/us/en/download/776303/acpi-component-architecture-downloads-unix-format-source-code-and-build-environment-with-an-intel-license.html";
-UPSTREAM_VERSION_UNKNOWN = "1"
-
-S = "${WORKDIR}/acpica-unix-${PV}"
+S = "${WORKDIR}/git"
 
 inherit update-alternatives
 
-- 
2.30.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197934): 
https://lists.openembedded.org/g/openembedded-core/message/197934
Mute This Topic: https://lists.openembedded.org/mt/105312924/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH 1/2] acpica: use github for SRC_URI

2024-04-03 Thread Jon Mason
Fixed! v2 coming

On Wed, Apr 3, 2024 at 12:01 PM Alexander Kanavin
 wrote:
>
> On Wed, 3 Apr 2024 at 17:27, Jon Mason  wrote:
> > -UPSTREAM_CHECK_URI = 
> > "https://www.intel.com/content/www/us/en/download/776303/acpi-component-architecture-downloads-unix-format-source-code-and-build-environment-with-an-intel-license.html";
> > -UPSTREAM_VERSION_UNKNOWN = "1"
> > +UPSTREAM_CHECK_URI = "https://github.com/${BPN}/${BPN}/releases/";
> > +UPSTREAM_CHECK_REGEX = "releases/tag/G?(?P\d+(\.\d+)+)"
>
> It is not necessary to add these lines. By default git upstream check
> will get all the tags with git itself, then sort them and pick what
> came on top, subject to UPSTREAM_CHECK_GITTAGREGEX if that is set.
>
> Alex

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197933): 
https://lists.openembedded.org/g/openembedded-core/message/197933
Mute This Topic: https://lists.openembedded.org/mt/105310932/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core][Patch v1 1/2] perf: fix build with latest kernel

2024-04-03 Thread Bruce Ashfield
On Thu, Mar 28, 2024 at 1:55 PM Max Krummenacher  wrote:
>
> On Tue, Mar 26, 2024 at 6:48 PM Bruce Ashfield  
> wrote:
> >
> >
> >
> > On Tue, Mar 26, 2024 at 1:46 PM Bruce Ashfield  
> > wrote:
> >>
> >>
> >>
> >> On Mon, Mar 25, 2024 at 6:21 AM  wrote:
> >>>
> >>> From: Max Krummenacher 
> >>>
> >>> Kernel commit 9eea8fafe33e ("libbpf: fix __arg_ctx type enforcement for
> >>> perf_event programs") added with 6.9-rc1 
> >>> tools/include/uapi/asm/bpf_perf_event.h
> >>> which for arc, arm64, loongarch, riscv and s390 includes headers from
> >>> the arch/${ARCH}/... directories.
> >>> Thus the build in OE fails as those headers are not present.
> >>>
> >>> Fix this by additioanly copying all files in arch/${ARCH}/include/.
> >>>
> >>> Fixes:
> >>> ERROR: perf-1.0-r0 do_compile: oe_runmake failed
> >>> | In file included from 
> >>> work/verdin_imx8mm-tdx-linux/perf/1.0/perf-1.0/tools/include/uapi/linux/bpf_perf_event.h:11,
> >>> |  from libbpf.c:36:
> >>> | 
> >>> work/verdin_imx8mm-tdx-linux/perf/1.0/perf-1.0/tools/include/uapi/asm/bpf_perf_event.h:2:10:
> >>>  fatal error: ../../arch/arm64/include/uapi/asm/bpf_perf_event.h: No such 
> >>> file or directory
> >>> | 2 | #include "../../arch/arm64/include/uapi/asm/bpf_perf_event.h"
> >>> |   |  ^~~~
> >>>
> >>> Signed-off-by: Max Krummenacher 
> >>> ---
> >>>  meta/recipes-kernel/perf/perf.bb | 1 +
> >>>  1 file changed, 1 insertion(+)
> >>>
> >>> diff --git a/meta/recipes-kernel/perf/perf.bb 
> >>> b/meta/recipes-kernel/perf/perf.bb
> >>> index 4f26813de0..6408c65462 100644
> >>> --- a/meta/recipes-kernel/perf/perf.bb
> >>> +++ b/meta/recipes-kernel/perf/perf.bb
> >>> @@ -139,6 +139,7 @@ PERF_SRC ?= "Makefile \
> >>>   tools/scripts \
> >>>   scripts/ \
> >>>   arch/arm64/tools \
> >>> + arch/${ARCH}/include \
> >>
> >>
> >> We've always tried to stay within the tools/ source umbrella since we 
> >> really
> >> don't want to copy any more of the kernel than we have to, since otherwise,
> >> we might as well go back to simplifying things and just building against 
> >> the
> >> entire kernel source tree.
> >>
> >> I'd like to see if there's a way that we could limit this to the uapi (and 
> >> hence
> >> use our uapi headers), and avoid needing to make the copy. If we need a
> >> copy, then being as specific as possible would be the goal.
>
> I was too lazy to limit this when I came up with the patch.
> Currently the only header missing is
> ../../arch/arm64/include/uapi/asm/bpf_perf_event.h,
> so limiting to arch/${ARCH}/include/uapi should work fine, I'm unsure if
> the header file itself exists for every ${ARCH} so only copying the one
> file is probably a dangerous way forward.
>
> >
> >
> >
> > I meant to also add that I'm not talking about the libc-headers for the
> > uapi bits, as they are not tracking the latest kernel by design. Although
> > it would be interesting to see how perf does treat the older uapi against
> > the new kernel, so we can document the tested combinations.
> >
> > Bruce
>
> Let's wait till you give linux-yocto-dev a try run.Happy Easter.

I have linux-yocto-dev on 6.9-rc2 now.

I have a few non-perf packages to fix before I can send it to the list,
but to finish up this thread.

I tested with your patch, as well as the finer grained included, and
that does indeed fix the problem.

At a minimum, we should go with the uapi as the include addition.

I'm tempted to experiment with just the single file, and ensure that
our source copy routines in perf can handle it. The reason why I'm
focused on it, is that this is just temporary until I upgrade our
libc-headers recipe in the next release cycle, after that, it should
provide what is needed for perf and we'll have what is essentially
an extra copy (although harmless).

I agree that the best place for the perl dependency is on the -tests
package, as I don't see big gains on creating a perl-tests package
for the dependency .. since if it is used to process the other results,
most everything would just have the dependency anyway.

Bruce

> Max
> >
> >
> >>
> >>
> >> I'm not moving linux-yocto-dev to the latest -dev until next week, but I  
> >> can
> >> look into this more then.
> >>
> >> Bruce
> >>
> >>
> >>>
> >>>   arch/${ARCH}/Makefile \
> >>>  "
> >>>
> >>> --
> >>> 2.42.0
> >>>
> >>
> >>
> >> --
> >> - Thou shalt not follow the NULL pointer, for chaos and madness await thee 
> >> at its end
> >> - "Use the force Harry" - Gandalf, Star Trek II
> >>
> >
> >
> > --
> > - Thou shalt not follow the NULL pointer, for chaos and madness await thee 
> > at its end
> > - "Use the force Harry" - Gandalf, Star Trek II
> >



-- 
- Thou shalt not follow the NULL pointer, for chaos and madness await
thee at its end
- "Use the force Harry" - Gandalf, Star Trek II

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#

Re: [OE-core] [PATCH 1/2] acpica: use github for SRC_URI

2024-04-03 Thread Alexander Kanavin
On Wed, 3 Apr 2024 at 17:27, Jon Mason  wrote:
> -UPSTREAM_CHECK_URI = 
> "https://www.intel.com/content/www/us/en/download/776303/acpi-component-architecture-downloads-unix-format-source-code-and-build-environment-with-an-intel-license.html";
> -UPSTREAM_VERSION_UNKNOWN = "1"
> +UPSTREAM_CHECK_URI = "https://github.com/${BPN}/${BPN}/releases/";
> +UPSTREAM_CHECK_REGEX = "releases/tag/G?(?P\d+(\.\d+)+)"

It is not necessary to add these lines. By default git upstream check
will get all the tags with git itself, then sort them and pick what
came on top, subject to UPSTREAM_CHECK_GITTAGREGEX if that is set.

Alex

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197931): 
https://lists.openembedded.org/g/openembedded-core/message/197931
Mute This Topic: https://lists.openembedded.org/mt/105310932/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe-core][PATCH] vte: update 0.74.2 -> 0.76.0

2024-04-03 Thread Alexandre Belloni via lists.openembedded.org
https://autobuilder.yoctoproject.org/typhoon/#/builders/57/builds/8655/steps/12/logs/stdio

| configure: error: Package requirements (glib-2.0 gtk+-3.0 vte-2.91) were not 
met:
| 
| No package 'vte-2.91' found
| 
| Consider adjusting the PKG_CONFIG_PATH environment variable if you
| installed software in a non-standard prefix.
| 
| Alternatively, you may set the environment variables MBTERM_CFLAGS
| and MBTERM_LIBS to avoid the need to call pkg-config.
| See the pkg-config man page for more details.
| NOTE: The following config.log files may provide further information.
| NOTE: 
/home/pokybuild/yocto-worker/qemux86-64-x32/build/build/tmp/work/x86_64_x32-poky-linux-gnux32/matchbox-terminal/0.2+git/build/config.log
| ERROR: configure failed
| WARNING: 
/home/pokybuild/yocto-worker/qemux86-64-x32/build/build/tmp/work/x86_64_x32-poky-linux-gnux32/matchbox-terminal/0.2+git/temp/run.do_configure.1616482:285
 exit 1 from 'exit 1'
| WARNING: Backtrace (BB generated script):
|   #1: bbfatal_log, 
/home/pokybuild/yocto-worker/qemux86-64-x32/build/build/tmp/work/x86_64_x32-poky-linux-gnux32/matchbox-terminal/0.2+git/temp/run.do_configure.1616482,
 line 285
|   #2: oe_runconf, 
/home/pokybuild/yocto-worker/qemux86-64-x32/build/build/tmp/work/x86_64_x32-poky-linux-gnux32/matchbox-terminal/0.2+git/temp/run.do_configure.1616482,
 line 261
|   #3: autotools_do_configure, 
/home/pokybuild/yocto-worker/qemux86-64-x32/build/build/tmp/work/x86_64_x32-poky-linux-gnux32/matchbox-terminal/0.2+git/temp/run.do_configure.1616482,
 line 231
|   #4: do_configure, 
/home/pokybuild/yocto-worker/qemux86-64-x32/build/build/tmp/work/x86_64_x32-poky-linux-gnux32/matchbox-terminal/0.2+git/temp/run.do_configure.1616482,
 line 151
|   #5: main, 
/home/pokybuild/yocto-worker/qemux86-64-x32/build/build/tmp/work/x86_64_x32-poky-linux-gnux32/matchbox-terminal/0.2+git/temp/run.do_configure.1616482,
 line 289
NOTE: recipe matchbox-terminal-0.2+git-r0: task do_configure: Failed
ERROR: Task 
(/home/pokybuild/yocto-worker/qemux86-64-x32/build/meta/recipes-sato/matchbox-terminal/matchbox-terminal_0.2.bb:do_configure)
 failed with exit code '1'

On 31/03/2024 18:06:55+0200, Markus Volk wrote:
> - add missing lz4 dependency
> - add PACKAGECONFIG for gtk+3
> - if wayland and opengl are available, gtk4 will be used
> - for plain x11 it can be built with or without opengl depending on 
> DISTRO_FEATURE
> 
> Signed-off-by: Markus Volk 
> ---
>  meta/recipes-support/vte/{vte_0.74.2.bb => vte_0.76.0.bb} | 7 ---
>  1 file changed, 4 insertions(+), 3 deletions(-)
>  rename meta/recipes-support/vte/{vte_0.74.2.bb => vte_0.76.0.bb} (87%)
> 
> diff --git a/meta/recipes-support/vte/vte_0.74.2.bb 
> b/meta/recipes-support/vte/vte_0.76.0.bb
> similarity index 87%
> rename from meta/recipes-support/vte/vte_0.74.2.bb
> rename to meta/recipes-support/vte/vte_0.76.0.bb
> index d8eafde2fb..701b7417e3 100644
> --- a/meta/recipes-support/vte/vte_0.74.2.bb
> +++ b/meta/recipes-support/vte/vte_0.76.0.bb
> @@ -11,7 +11,7 @@ LIC_FILES_CHKSUM = " \
>  file://COPYING.XTERM;md5=d7fc3a23c16c039afafe2e042030f057 \
>  "
>  
> -DEPENDS = "glib-2.0 glib-2.0-native gtk+3 libpcre2 libxml2-native 
> gperf-native icu"
> +DEPENDS = "glib-2.0 glib-2.0-native lz4 libpcre2 libxml2-native gperf-native 
> icu"
>  
>  GIR_MESON_OPTION = 'gir'
>  GIDOCGEN_MESON_OPTION = "docs"
> @@ -19,7 +19,7 @@ GIDOCGEN_MESON_OPTION = "docs"
>  inherit gnomebase gi-docgen features_check upstream-version-is-even 
> gobject-introspection systemd vala
>  
>  SRC_URI += "file://0001-Add-W_EXITCODE-macro-for-non-glibc-systems.patch"
> -SRC_URI[archive.sha256sum] = 
> "a535fb2a98fea8a2449cd1a02cccf5190131dddff52e715afdace3feb536eae7"
> +SRC_URI[archive.sha256sum] = 
> "bbce30b8f504370b12d6439c07a82993e97d7e9afe2dd367817cd58ff029ffda"
>  
>  ANY_OF_DISTRO_FEATURES = "${GTK3DISTROFEATURES}"
>  
> @@ -29,9 +29,10 @@ EXTRA_OEMESON:append = " 
> ${@bb.utils.contains('GI_DATA_ENABLED', 'False', '-Ddoc
>  PACKAGECONFIG ??= " \
>   gnutls \
>   ${@bb.utils.filter('DISTRO_FEATURES', 'systemd', d)} \
> - ${@bb.utils.contains('DISTRO_FEATURES', 'opengl', 'gtk4', '', d)} \
> + ${@bb.utils.contains('DISTRO_FEATURES', 'wayland opengl', 'gtk4', 
> 'gtk3', d)} \
>  "
>  PACKAGECONFIG[fribidi] = "-Dfribidi=true,-Dfribidi=false,fribidi"
> +PACKAGECONFIG[gtk3] = "-Dgtk3=true,-Dgtk3=false,gtk+3"
>  PACKAGECONFIG[gtk4] = "-Dgtk4=true,-Dgtk4=false,gtk4"
>  PACKAGECONFIG[gnutls] = "-Dgnutls=true,-Dgnutls=false,gnutls"
>  PACKAGECONFIG[systemd] = "-D_systemd=true,-D_systemd=false,systemd"
> -- 
> 2.44.0
> 

> 
> 
> 


-- 
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197929): 
https://lists.openembedded.org/g/openembedded-core/message/197929
Mute This Topic: https://lists.openembedded.org/mt/105249434/21656
Group Owner: openembedded-core+ow...@list

[OE-core] Patchtest results for [PATCH 2/2] acpica: update to 20240322 release

2024-04-03 Thread Patchtest
Thank you for your submission. Patchtest identified one
or more issues with the patch. Please see the log below for
more information:

---
Testing patch 
/home/patchtest/share/mboxes/2-2-acpica-update-to-20240322-release.patch

FAIL: test lic files chksum modified not mentioned: LIC_FILES_CHKSUM changed 
without "License-Update:" tag and description in commit message 
(test_metadata.TestMetadata.test_lic_files_chksum_modified_not_mentioned)

PASS: test CVE check ignore (test_metadata.TestMetadata.test_cve_check_ignore)
PASS: test Signed-off-by presence 
(test_mbox.TestMbox.test_signed_off_by_presence)
PASS: test author valid (test_mbox.TestMbox.test_author_valid)
PASS: test commit message presence 
(test_mbox.TestMbox.test_commit_message_presence)
PASS: test max line length (test_metadata.TestMetadata.test_max_line_length)
PASS: test mbox format (test_mbox.TestMbox.test_mbox_format)
PASS: test non-AUH upgrade (test_mbox.TestMbox.test_non_auh_upgrade)
PASS: test shortlog format (test_mbox.TestMbox.test_shortlog_format)
PASS: test shortlog length (test_mbox.TestMbox.test_shortlog_length)
PASS: test target mailing list (test_mbox.TestMbox.test_target_mailing_list)

SKIP: pretest pylint: No python related patches, skipping test 
(test_python_pylint.PyLint.pretest_pylint)
SKIP: pretest src uri left files: Patch cannot be merged 
(test_metadata.TestMetadata.pretest_src_uri_left_files)
SKIP: test CVE tag format: No new CVE patches introduced 
(test_patch.TestPatch.test_cve_tag_format)
SKIP: test Signed-off-by presence: No new CVE patches introduced 
(test_patch.TestPatch.test_signed_off_by_presence)
SKIP: test Upstream-Status presence: No new CVE patches introduced 
(test_patch.TestPatch.test_upstream_status_presence_format)
SKIP: test bugzilla entry format: No bug ID found 
(test_mbox.TestMbox.test_bugzilla_entry_format)
SKIP: test lic files chksum presence: No added recipes, skipping test 
(test_metadata.TestMetadata.test_lic_files_chksum_presence)
SKIP: test license presence: No added recipes, skipping test 
(test_metadata.TestMetadata.test_license_presence)
SKIP: test pylint: No python related patches, skipping test 
(test_python_pylint.PyLint.test_pylint)
SKIP: test series merge on head: Merge test is disabled for now 
(test_mbox.TestMbox.test_series_merge_on_head)
SKIP: test src uri left files: Patch cannot be merged 
(test_metadata.TestMetadata.test_src_uri_left_files)
SKIP: test summary presence: No added recipes, skipping test 
(test_metadata.TestMetadata.test_summary_presence)

---

Please address the issues identified and
submit a new revision of the patch, or alternatively, reply to this
email with an explanation of why the patch should be accepted. If you
believe these results are due to an error in patchtest, please submit a
bug at https://bugzilla.yoctoproject.org/ (use the 'Patchtest' category
under 'Yocto Project Subprojects'). For more information on specific
failures, see: https://wiki.yoctoproject.org/wiki/Patchtest. Thank
you!

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197928): 
https://lists.openembedded.org/g/openembedded-core/message/197928
Mute This Topic: https://lists.openembedded.org/mt/10537/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 2/2] acpica: update to 20240322 release

2024-04-03 Thread Jon Mason
Update acpica to the latest version, comprised of the following commits:

170fc3076a86 Update changes.txt for new ACPICA release 20240322
718374cd1bc2 Update acpixf.h for new ACPICA release 20240322
d0349632b625 Update osunixxf.c license header from 2023 to 2024
c929bc0d5028 Update osunixmap.c license header from 2023 to 2024
78c34e3738bd Update osunixdir.c license header from 2023 to 2024
193a3dda90e2 Update oslinuxtbl.c license header from 2023 to 2024
edaf61c8a97d Update oszephyr.c license header from 2023 to 2024
1c5331ede7ec Update osgendbg.c license header from 2015 to 2024
ab10380db037 Update osbsdtbl.c license header from 2023 to 2024
815db2de4317 Update osefixf.c license header from 2023 to 2024
a4dab90c90a4 Update osefitbl.c license header from 2023 to 2024
4f9205ae4283 Update oseficlib.c license header from 2023 to 2024
68bc01cec3b9 Update efihello.c license header from 2023 to 2024
f71b9942deeb Update acdragonfly.h license header from 2003 to 2024
74fb08369867 Update acgetline.c license header from 2023 to 2024
c18edfb1abfb Update the copyright year in the license header from 2023 
to 2024
d58f24933d2f Get rid of MSVC warnings that arise actually due to GCC's 
new dangling pointer warning and also tGCC's blindspot to work with nested 
named structs/unions resulting in breaking of ACPI event-handling
ba8a36b5c734 events/evgpeinit: don't forget to increment registered GPE 
count
8affc87afd28 events/evxfgpe: correctly clear GPE_AUTO_ENABLED in 
AcpiSetupGpeForWake
69f81815f830 Fix Capabilities[1024] mess
3e89d40e19fc Update actbl2.h to get rid of the MSVC error C2233
a0ad1ed5105f Fix CXL 3.0 structure (RDPAS) in the CEDT table
9061cd9aa131 ACPICA: debugger: check status of AcpiEvaluateObject in 
AcpiDbWalkForFields
b9423c1d35b0 SRAT: Add dump and compiler support for RINTC affinity 
structure
93caddbf2f62 SRAT: Add RISC-V RINTC affinity structure
9788e0dc955b Modify ACPI_OBJECT_COMMON_HEADER
a6a236c44c7d Fix spelling and typos: Clean up the fix for Issue #900
b6b38edb0c18 Clean up the fix for Issue #900
8f789f356fb5 tests/common: use CopyObject instead of Store for NRMT
bce7c55e99a0 acgcc: Fix C++ issue with ACPI_FLEX_ARRAY
e3afd8e17bc8 MADT: Add new MADT GICC/GICR/ITS non-coherent flags 
handling
453a5f675677 MADT: Add GICC online capable bit handling
6cd47047aca6 Fix various spelling mistakes in text files and code 
comments
31a16a32e7f3 acpisrc: Add identifiers for the NHLT table
32260f5ce519 NHLT: Reintroduce types the table consists of
6ab5a3bb1608 AdDisassemblerHeader: omit timestamp for deterministic 
output
471de8b63a98 Fix build indeterminism for asm compiler header.
50aec3ad9364 os_specific: zephyr: update AcpiOsGetTimer with arch 
specific timer
10ae1038e51e osal: zephyr: Fix write access for mapped memory
3944ce4dd104 osal: zephyr: Fix AcpiOsPrintf implementation
a97db76b5f1c Fix issue #896
f5910dd1ab60 Attempt 1 to fix issue #900
c581606cf49b ACPI 6.5: RAS2: Add support for RAS2 table
673fc21311ff Add port definitions for CDAT SSLBIS
9c5649bd2c65 dmtbdump2: remove redundant failure check on Status
544938c98a7a dmtbdump: remove duplicated code for both paths of an if 
statement
0c7379eae2a0 NHLT: Drop preliminary support
7b10fafca61f Revert "NHLT: Declare device configuration types"
0333c2af1317 os_specific: zephyr: add generic platform support
2872257aab53 Fix segfault when error-checking mixed table types
c7171588a9f6 actbl1.h: Add EINJ CXL error types
da740d8d27ff Get rid of // style comments
75635cb363c6 NHLT: Declare device configuration types
bbd7aee285ca dmtbinfo2.c: RISC-V: Remove redundant Flags print

The md5 checksum change is related to the relevant file having the year
updated in the copyright.

Signed-off-by: Jon Mason 
---
 .../acpica/{acpica_20230628.bb => acpica_20240322.bb} | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)
 rename meta/recipes-extended/acpica/{acpica_20230628.bb => acpica_20240322.bb} 
(94%)

diff --git a/meta/recipes-extended/acpica/acpica_20230628.bb 
b/meta/recipes-extended/acpica/acpica_20240322.bb
similarity index 94%
rename from meta/recipes-extended/acpica/acpica_20230628.bb
rename to meta/recipes-extended/acpica/acpica_20240322.bb
index e63faebf0901..27de28c5ddcf 100644
--- a/meta/recipes-extended/acpica/acpica_20230628.bb
+++ b/meta/recipes-extended/acpica/acpica_20240322.bb
@@ -10,14 +10,14 @@ HOMEPAGE = 
"https://www.intel.com/content/www/us/en/developer/topic-technology/o
 SECTION = "console/tools"
 
 LICENSE = "Intel | BSD-3-Clause | GPL-2.0-only"
-LIC_FILES_CHKSUM = 
"file://source/compiler/aslcomp

[OE-core] [PATCH 0/2] acpica: switch to github and update version

2024-04-03 Thread Jon Mason
While going down the rabbit hole of UPSTREAM_CHECK, I came across this
package needing updates.  I found the switch to github on the webpage
and updated, etc.  With the first patch, I get:
acpica2023062820240322Ross Burton 
 170fc3076a86777077637f10b05c32ac21ac13aa

Please note, this is only "compile tested".  So, I did not verify it
works, just doesn't throw any compile errors/warnings.

Thanks,
Jon


Jon Mason (2):
  acpica: use github for SRC_URI
  acpica: update to 20240322 release

 .../{acpica_20230628.bb => acpica_20240322.bb}   | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)
 rename meta/recipes-extended/acpica/{acpica_20230628.bb => acpica_20240322.bb} 
(75%)

-- 
2.30.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197925): 
https://lists.openembedded.org/g/openembedded-core/message/197925
Mute This Topic: https://lists.openembedded.org/mt/105310930/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 1/2] acpica: use github for SRC_URI

2024-04-03 Thread Jon Mason
Github is now the location of the ACPICA source code, per
https://www.intel.com/content/www/us/en/developer/topic-technology/open/acpica/download.html
Update to this location.  Also, this allows for devtool check for new
versions (in theory), and allows for an easier collection of the
changelog when updating versions.

Using the SRCREV SHA that matches the tarball release.  So, this should
match what is currently being used.

Signed-off-by: Jon Mason 
---
 meta/recipes-extended/acpica/acpica_20230628.bb | 10 +-
 1 file changed, 5 insertions(+), 5 deletions(-)

diff --git a/meta/recipes-extended/acpica/acpica_20230628.bb 
b/meta/recipes-extended/acpica/acpica_20230628.bb
index 8974bdc1f1a6..e63faebf0901 100644
--- a/meta/recipes-extended/acpica/acpica_20230628.bb
+++ b/meta/recipes-extended/acpica/acpica_20230628.bb
@@ -16,13 +16,13 @@ COMPATIBLE_HOST = "(i.86|x86_64|arm|aarch64).*-linux"
 
 DEPENDS = "m4-native flex-native bison-native"
 
-SRC_URI = "https://downloadmirror.intel.com/783534/acpica-unix-${PV}.tar.gz";
-SRC_URI[sha256sum] = 
"86876a745e3d224dcfd222ed3de465b47559e85811df2db9820ef09a9dff5cce"
+SRC_URI = "git://github.com/acpica/acpica;protocol=https;branch=master"
+SRCREV = "f16a0b4d0f0edd7b78a332fcf507be2187fac21e"
 
-UPSTREAM_CHECK_URI = 
"https://www.intel.com/content/www/us/en/download/776303/acpi-component-architecture-downloads-unix-format-source-code-and-build-environment-with-an-intel-license.html";
-UPSTREAM_VERSION_UNKNOWN = "1"
+UPSTREAM_CHECK_URI = "https://github.com/${BPN}/${BPN}/releases/";
+UPSTREAM_CHECK_REGEX = "releases/tag/G?(?P\d+(\.\d+)+)"
 
-S = "${WORKDIR}/acpica-unix-${PV}"
+S = "${WORKDIR}/git"
 
 inherit update-alternatives
 
-- 
2.30.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197926): 
https://lists.openembedded.org/g/openembedded-core/message/197926
Mute This Topic: https://lists.openembedded.org/mt/105310932/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [PATCH] package: fix issue converting PR to string

2024-04-03 Thread Richard Purdie
On Wed, 2024-04-03 at 15:57 +0200, Michael Opdenacker via 
lists.openembedded.org wrote:
> From: Michael Opdenacker 
> 
> The upcoming introduction of "passthrough" PR servers
> will add non integer PR values, such as '0.3'.
> 
> With such a value, the current conversion of this
> value to a string, to define the package file name,
> can result in incorrect strings such as "0.30004"!
> 
> Introduce a safe_str() function which, when given a float
> value, rounds it up to the 6th decimal first, before the
> conversion to string.
> 
> Signed-off-by: Michael Opdenacker 
> CC: thomas.petazz...@bootlin.com
> 
> ---
> 
> Notes: this has been tested successfully on the "master" branch.
> No obvious regression was found and the package file names
> look normal.

Shouldn't this be happening at the bitbake level in the prserv code? I
doubt we should be passing float types around in the first place?

Cheers,

Richard



-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197924): 
https://lists.openembedded.org/g/openembedded-core/message/197924
Mute This Topic: https://lists.openembedded.org/mt/105308894/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [dunfell][PATCH] shadow: fix CVE-2023-4641

2024-04-03 Thread Steve Sakoman
On Wed, Apr 3, 2024 at 2:29 AM Hugo Simeliere via
lists.openembedded.org
 wrote:
>
> From: Hugo SIMELIERE 
>
> Upstream-Status: Backport 
> [https://github.com/shadow-maint/shadow/commit/65c88a43a23c2391dcc90c0abda3e839e9c57904]
>
> Signed-off-by: Hugo SIMELIERE 
> ---
>  .../shadow/files/CVE-2023-4641.patch  | 145 ++
>  meta/recipes-extended/shadow/shadow.inc   |   1 +
>  2 files changed, 146 insertions(+)
>  create mode 100644 meta/recipes-extended/shadow/files/CVE-2023-4641.patch
>
> diff --git a/meta/recipes-extended/shadow/files/CVE-2023-4641.patch 
> b/meta/recipes-extended/shadow/files/CVE-2023-4641.patch
> new file mode 100644
> index 00..709813ab31
> --- /dev/null
> +++ b/meta/recipes-extended/shadow/files/CVE-2023-4641.patch
> @@ -0,0 +1,145 @@
> +From 51731b01fd9a608397da22b7b9164e4996f3d4c6 Mon Sep 17 00:00:00 2001
> +From: Alejandro Colomar 
> +Date: Sat, 10 Jun 2023 16:20:05 +0200
> +Subject: [PATCH] gpasswd(1): Fix password leak
> +
> +CVE: CVE-2023-4641
> +Upstream-Status: Backport 
> [https://github.com/shadow-maint/shadow/commit/65c88a43a23c2391dcc90c0abda3e839e9c57904]

Missing Signed-off-by in the patch file, please submit a V2

Thanks,

Steve

> +
> +How to trigger this password leak?
> +~~
> +
> +When gpasswd(1) asks for the new password, it asks twice (as is usual
> +for confirming the new password).  Each of those 2 password prompts
> +uses agetpass() to get the password.  If the second agetpass() fails,
> +the first password, which has been copied into the 'static' buffer
> +'pass' via STRFCPY(), wasn't being zeroed.
> +
> +agetpass() is defined in <./libmisc/agetpass.c> (around line 91), and
> +can fail for any of the following reasons:
> +
> +-  malloc(3) or readpassphrase(3) failure.
> +
> +   These are going to be difficult to trigger.  Maybe getting the system
> +   to the limits of memory utilization at that exact point, so that the
> +   next malloc(3) gets ENOMEM, and possibly even the OOM is triggered.
> +   About readpassphrase(3), ENFILE and EINTR seem the only plausible
> +   ones, and EINTR probably requires privilege or being the same user;
> +   but I wouldn't discard ENFILE so easily, if a process starts opening
> +   files.
> +
> +-  The password is longer than PASS_MAX.
> +
> +   The is plausible with physical access.  However, at that point, a
> +   keylogger will be a much simpler attack.
> +
> +And, the attacker must be able to know when the second password is being
> +introduced, which is not going to be easy.
> +
> +How to read the password after the leak?
> +
> +
> +Provoking the leak yourself at the right point by entering a very long
> +password is easy, and inspecting the process stack at that point should
> +be doable.  Try to find some consistent patterns.
> +
> +Then, search for those patterns in free memory, right after the victim
> +leaks their password.
> +
> +Once you get the leak, a program should read all the free memory
> +searching for patterns that gpasswd(1) leaves nearby the leaked
> +password.
> +
> +On 6/10/23 03:14, Seth Arnold wrote:
> +> An attacker process wouldn't be able to use malloc(3) for this task.
> +> There's a handful of tools available for userspace to allocate memory:
> +>
> +> -  brk / sbrk
> +> -  mmap MAP_ANONYMOUS
> +> -  mmap /dev/zero
> +> -  mmap some other file
> +> -  shm_open
> +> -  shmget
> +>
> +> Most of these return only pages of zeros to a process.  Using mmap of an
> +> existing file, you can get some of the contents of the file demand-loaded
> +> into the memory space on the first use.
> +>
> +> The MAP_UNINITIALIZED flag only works if the kernel was compiled with
> +> CONFIG_MMAP_ALLOW_UNINITIALIZED.  This is rare.
> +>
> +> malloc(3) doesn't zero memory, to our collective frustration, but all the
> +> garbage in the allocations is from previous allocations in the current
> +> process.  It isn't leftover from other processes.
> +>
> +> The avenues available for reading the memory:
> +> -  /dev/mem and /dev/kmem (requires root, not available with Secure Boot)
> +> -  /proc/pid/mem (requires ptrace privileges, mediated by YAMA)
> +> -  ptrace (requires ptrace privileges, mediated by YAMA)
> +> -  causing memory to be swapped to disk, and then inspecting the swap
> +>
> +> These all require a certain amount of privileges.
> +
> +How to fix it?
> +~~
> +
> +memzero(), which internally calls explicit_bzero(3), or whatever
> +alternative the system provides with a slightly different name, will
> +make sure that the buffer is zeroed in memory, and optimizations are not
> +allowed to impede this zeroing.
> +
> +This is not really 100% effective, since compilers may place copies of
> +the string somewhere hidden in the stack.  Those copies won't get zeroed
> +by explicit_bzero(3).  However, that's arguably a compiler bug, since
> +compilers should make everything possible to avoid optimizing strin

Re: [OE-core] [yocto] [Openembedded-architecture] New mailing list for layer patches

2024-04-03 Thread Josef Holzmayr
Thanks for that initiative Michael and Paul, this is very helpful for the
greater community!

Greets,
Josef

On Wed, Apr 3, 2024 at 4:59 PM Michael Opdenacker via lists.yoctoproject.org
 wrote:

> Hi Paul,
>
> On 4/2/24 at 10:38, Paul Barker wrote:
> > On 28/03/2024 14:36, Ross Burton wrote:
> >> Hi,
> >>
> >> At the moment if a layer doesn’t have enough volume to justify a
> dedicated mailing list for patches (see, for example,
> meta-...@lists.yoctoproject.org )
> then the convention is that the patches can be sent to
> yo...@lists.yoctoproject.org .
> >>
> >> However, that’s also the list that we encourage users of Yocto to use
> for help, so the list has a mix of patches for various layers and people
> asking for help, which isn’t ideal: users who want help don’t want to be
> flooded with patches for layers they’re not using, layer maintainers may
> not want to see the requests for help, and people who want the status
> reports have to receive patches and support.
> >>
> >> The Yocto TSC has been discussing this, and as a solution to this we’ve
> just created a new mailing list: yocto-patc...@lists.yoctoproject.org
> .  This list is specifically
> for Yocto-related projects which don’t have their own mailing list or other
> patch submission process.   We ask that all layers currently using yocto@
> for patches move to yocto-patches@, so that yocto@ can be used purely for
> discussion and other non-patch related subjects.
> > I think this is a great change, along with the new yocto-status@ list
> it will make things easier to follow :)
> >
> > Do you know if yocto-patches@ will be available via lore.kernel.org?
>
> I've just asked them to index the new lists as well as these important
> ones which are missing too:
> https://lists.yoctoproject.org/g/yocto-announce
> http://lists.openembedded.org/mailman/listinfo/openembedded-architecture
> https://lists.yoctoproject.org/g/automated-testing
> https://lists.yoctoproject.org/g/yocto-security
>
> Cheers
> Michael.
>
> --
> Michael Opdenacker, Bootlin
> Embedded Linux and Kernel engineering
> https://bootlin.com
>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197922): 
https://lists.openembedded.org/g/openembedded-core/message/197922
Mute This Topic: https://lists.openembedded.org/mt/105310355/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [yocto] [Openembedded-architecture] New mailing list for layer patches

2024-04-03 Thread Michael Opdenacker via lists.openembedded.org

Hi Paul,

On 4/2/24 at 10:38, Paul Barker wrote:

On 28/03/2024 14:36, Ross Burton wrote:

Hi,

At the moment if a layer doesn’t have enough volume to justify a dedicated mailing list for 
patches (see, for example, meta-...@lists.yoctoproject.org 
) then the convention is that the patches can 
be sent to yo...@lists.yoctoproject.org .

However, that’s also the list that we encourage users of Yocto to use for help, 
so the list has a mix of patches for various layers and people asking for help, 
which isn’t ideal: users who want help don’t want to be flooded with patches 
for layers they’re not using, layer maintainers may not want to see the 
requests for help, and people who want the status reports have to receive 
patches and support.

The Yocto TSC has been discussing this, and as a solution to this we’ve just created 
a new mailing list: yocto-patc...@lists.yoctoproject.org 
.  This list is specifically for 
Yocto-related projects which don’t have their own mailing list or other patch 
submission process.   We ask that all layers currently using yocto@ for patches move 
to yocto-patches@, so that yocto@ can be used purely for discussion and other 
non-patch related subjects.

I think this is a great change, along with the new yocto-status@ list it will 
make things easier to follow :)

Do you know if yocto-patches@ will be available via lore.kernel.org?


I've just asked them to index the new lists as well as these important 
ones which are missing too:

https://lists.yoctoproject.org/g/yocto-announce
http://lists.openembedded.org/mailman/listinfo/openembedded-architecture
https://lists.yoctoproject.org/g/automated-testing
https://lists.yoctoproject.org/g/yocto-security

Cheers
Michael.

--
Michael Opdenacker, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197921): 
https://lists.openembedded.org/g/openembedded-core/message/197921
Mute This Topic: https://lists.openembedded.org/mt/105310355/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH] package: fix issue converting PR to string

2024-04-03 Thread Michael Opdenacker via lists.openembedded.org
From: Michael Opdenacker 

The upcoming introduction of "passthrough" PR servers
will add non integer PR values, such as '0.3'.

With such a value, the current conversion of this
value to a string, to define the package file name,
can result in incorrect strings such as "0.30004"!

Introduce a safe_str() function which, when given a float
value, rounds it up to the 6th decimal first, before the
conversion to string.

Signed-off-by: Michael Opdenacker 
CC: thomas.petazz...@bootlin.com

---

Notes: this has been tested successfully on the "master" branch.
No obvious regression was found and the package file names
look normal.
---
 meta/classes-global/package.bbclass | 13 ++---
 1 file changed, 10 insertions(+), 3 deletions(-)

diff --git a/meta/classes-global/package.bbclass 
b/meta/classes-global/package.bbclass
index aa1eb5e901..82747d5467 100644
--- a/meta/classes-global/package.bbclass
+++ b/meta/classes-global/package.bbclass
@@ -250,6 +250,13 @@ package_get_auto_pr[vardeps] += "PRSERV_ACTIVE"
 python package_get_auto_pr() {
 import oe.prservice
 
+def safe_str(pr):
+# Avoids turning 0.3 to 0.30004 (for example)
+# during the conversion of a float to a string
+if type(pr) == float:
+pr = round(pr, 6)
+return str(pr)
+
 def get_do_package_hash(pn):
 if d.getVar("BB_RUNTASK") != "do_package":
 taskdepdata = d.getVar("BB_TASKDEPDATA", False)
@@ -289,7 +296,7 @@ python package_get_auto_pr() {
 auto_pr = d.getVar('PRAUTO_' + version + '_' + pkgarch) or 
d.getVar('PRAUTO_' + version) or None
 if auto_pr is None:
 bb.fatal("Can NOT get PRAUTO from lockdown exported file")
-d.setVar('PRAUTO',str(auto_pr))
+d.setVar('PRAUTO', safe_str(auto_pr))
 return
 
 try:
@@ -299,7 +306,7 @@ python package_get_auto_pr() {
 srcpv = bb.fetch2.get_srcrev(d)
 base_ver = "AUTOINC-%s" % version[:version.find(srcpv)]
 value = conn.getPR(base_ver, pkgarch, srcpv)
-d.setVar("PRSERV_PV_AUTOINC", str(value))
+d.setVar("PRSERV_PV_AUTOINC", safe_str(value))
 
 auto_pr = conn.getPR(version, pkgarch, checksum)
 conn.close()
@@ -307,7 +314,7 @@ python package_get_auto_pr() {
 bb.fatal("Can NOT get PRAUTO, exception %s" %  str(e))
 if auto_pr is None:
 bb.fatal("Can NOT get PRAUTO from remote PR service")
-d.setVar('PRAUTO',str(auto_pr))
+d.setVar('PRAUTO', safe_str(auto_pr))
 }
 
 #
-- 
2.34.1


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197920): 
https://lists.openembedded.org/g/openembedded-core/message/197920
Mute This Topic: https://lists.openembedded.org/mt/105308894/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [yocto] [Openembedded-architecture] New mailing list for layer patches

2024-04-03 Thread Richard Purdie
On Tue, 2024-04-02 at 22:33 +, Peter Kjellerstedt wrote:
> 
> To whoever is responsible for updating 
> https://www.yoctoproject.org/community/mailing-lists/: the links for
> the two new lists both refer to yocto-announce rather than yocto-
> status and yocto-patches.

That should be fixed now, thanks.

Cheers,

Richard

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#62882): https://lists.yoctoproject.org/g/yocto/message/62882
Mute This Topic: https://lists.yoctoproject.org/mt/105308714/21656
Group Owner: yocto+ow...@lists.yoctoproject.org
Unsubscribe: https://lists.yoctoproject.org/g/yocto/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [kirkstone][PATCH] cups: fix typo in CVE-2023-32360 backport patch

2024-04-03 Thread Jonathan GUILLOT
Typo prevents cupsd to start correctly with following error:
Unable to read "/etc/cups/cupsd.conf" due to errors.

Using `/usr/sbin/cupsd -t` to check the configuration:
Unknown authorization type Defaul on line 77 of /etc/cups/cupsd.conf.
Unknown Policy Limit directive AuthType on line 77 of /etc/cups/cupsd.conf.

Signed-off-by: Jonathan GUILLOT 
---
 meta/recipes-extended/cups/cups/CVE-2023-32360.patch | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-extended/cups/cups/CVE-2023-32360.patch 
b/meta/recipes-extended/cups/cups/CVE-2023-32360.patch
index f1b0f9f918..c3db722f1f 100644
--- a/meta/recipes-extended/cups/cups/CVE-2023-32360.patch
+++ b/meta/recipes-extended/cups/cups/CVE-2023-32360.patch
@@ -27,7 +27,7 @@ index b258849..08f5070 100644
 +  
 +
 +  
-+AuthType Defaul
++AuthType Default
  Require user @OWNER @SYSTEM
  Order deny,allow

-- 
2.43.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197918): 
https://lists.openembedded.org/g/openembedded-core/message/197918
Mute This Topic: https://lists.openembedded.org/mt/105307801/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core] [yocto] New mailing list for layer patches

2024-04-03 Thread Neal Caidin
Hi Peter,

Fixed by the YPE team (Yocto Project Elves).

Thanks for noticing and reporting!

Best,
Neal

*Neal Caidin*
Program Manager
The Linux Foundation
Durham, NC, U.S.A. - Eastern time zone
+1 (919) 238-9104 (w/h)
+1 (919) 949-1861 (m)
ncai...@linuxfoundation.org
https://meetings.hubspot.com/ncaidin




On Tue, Apr 2, 2024 at 6:33 PM Peter Kjellerstedt <
peter.kjellerst...@axis.com> wrote:

> > -Original Message-
> > From: yo...@lists.yoctoproject.org  On
> > Behalf Of Ross Burton
> > Sent: den 28 mars 2024 15:37
> > To: openembedded-architecture  > architect...@lists.openembedded.org>; Yocto-mailing-list
> > ; OE-core  > c...@lists.openembedded.org>
> > Subject: [yocto] New mailing list for layer patches
> >
> > Hi,
> >
> > At the moment if a layer doesn’t have enough volume to justify a
> dedicated
> > mailing list for patches (see, for example, meta-
> > a...@lists.yoctoproject.org )
> then
> > the convention is that the patches can be sent to
> > yo...@lists.yoctoproject.org .
> >
> > However, that’s also the list that we encourage users of Yocto to use for
> > help, so the list has a mix of patches for various layers and people
> > asking for help, which isn’t ideal: users who want help don’t want to be
> > flooded with patches for layers they’re not using, layer maintainers may
> > not want to see the requests for help, and people who want the status
> > reports have to receive patches and support.
> >
> > The Yocto TSC has been discussing this, and as a solution to this we’ve
> > just created a new mailing list: yocto-patc...@lists.yoctoproject.org
> > .  This list is
> specifically
> > for Yocto-related projects which don’t have their own mailing list or
> > other patch submission process.   We ask that all layers currently using
> > yocto@ for patches move to yocto-patches@, so that yocto@ can be used
> > purely for discussion and other non-patch related subjects.
> >
> > Many thanks,
> > Ross
> > Yocto TSC member
>
> To whoever is responsible for updating
> https://www.yoctoproject.org/community/mailing-lists/: the links for the
> two new lists both refer to yocto-announce rather than yocto-status and
> yocto-patches.
>
> //Peter
>
>
> 
>
>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197917): 
https://lists.openembedded.org/g/openembedded-core/message/197917
Mute This Topic: https://lists.openembedded.org/mt/105307763/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [dunfell][PATCH] shadow: fix CVE-2023-4641

2024-04-03 Thread Hugo Simeliere via lists.openembedded.org
From: Hugo SIMELIERE 

Upstream-Status: Backport 
[https://github.com/shadow-maint/shadow/commit/65c88a43a23c2391dcc90c0abda3e839e9c57904]

Signed-off-by: Hugo SIMELIERE 
---
 .../shadow/files/CVE-2023-4641.patch  | 145 ++
 meta/recipes-extended/shadow/shadow.inc   |   1 +
 2 files changed, 146 insertions(+)
 create mode 100644 meta/recipes-extended/shadow/files/CVE-2023-4641.patch

diff --git a/meta/recipes-extended/shadow/files/CVE-2023-4641.patch 
b/meta/recipes-extended/shadow/files/CVE-2023-4641.patch
new file mode 100644
index 00..709813ab31
--- /dev/null
+++ b/meta/recipes-extended/shadow/files/CVE-2023-4641.patch
@@ -0,0 +1,145 @@
+From 51731b01fd9a608397da22b7b9164e4996f3d4c6 Mon Sep 17 00:00:00 2001
+From: Alejandro Colomar 
+Date: Sat, 10 Jun 2023 16:20:05 +0200
+Subject: [PATCH] gpasswd(1): Fix password leak
+
+CVE: CVE-2023-4641
+Upstream-Status: Backport 
[https://github.com/shadow-maint/shadow/commit/65c88a43a23c2391dcc90c0abda3e839e9c57904]
+
+How to trigger this password leak?
+~~
+
+When gpasswd(1) asks for the new password, it asks twice (as is usual
+for confirming the new password).  Each of those 2 password prompts
+uses agetpass() to get the password.  If the second agetpass() fails,
+the first password, which has been copied into the 'static' buffer
+'pass' via STRFCPY(), wasn't being zeroed.
+
+agetpass() is defined in <./libmisc/agetpass.c> (around line 91), and
+can fail for any of the following reasons:
+
+-  malloc(3) or readpassphrase(3) failure.
+
+   These are going to be difficult to trigger.  Maybe getting the system
+   to the limits of memory utilization at that exact point, so that the
+   next malloc(3) gets ENOMEM, and possibly even the OOM is triggered.
+   About readpassphrase(3), ENFILE and EINTR seem the only plausible
+   ones, and EINTR probably requires privilege or being the same user;
+   but I wouldn't discard ENFILE so easily, if a process starts opening
+   files.
+
+-  The password is longer than PASS_MAX.
+
+   The is plausible with physical access.  However, at that point, a
+   keylogger will be a much simpler attack.
+
+And, the attacker must be able to know when the second password is being
+introduced, which is not going to be easy.
+
+How to read the password after the leak?
+
+
+Provoking the leak yourself at the right point by entering a very long
+password is easy, and inspecting the process stack at that point should
+be doable.  Try to find some consistent patterns.
+
+Then, search for those patterns in free memory, right after the victim
+leaks their password.
+
+Once you get the leak, a program should read all the free memory
+searching for patterns that gpasswd(1) leaves nearby the leaked
+password.
+
+On 6/10/23 03:14, Seth Arnold wrote:
+> An attacker process wouldn't be able to use malloc(3) for this task.
+> There's a handful of tools available for userspace to allocate memory:
+>
+> -  brk / sbrk
+> -  mmap MAP_ANONYMOUS
+> -  mmap /dev/zero
+> -  mmap some other file
+> -  shm_open
+> -  shmget
+>
+> Most of these return only pages of zeros to a process.  Using mmap of an
+> existing file, you can get some of the contents of the file demand-loaded
+> into the memory space on the first use.
+>
+> The MAP_UNINITIALIZED flag only works if the kernel was compiled with
+> CONFIG_MMAP_ALLOW_UNINITIALIZED.  This is rare.
+>
+> malloc(3) doesn't zero memory, to our collective frustration, but all the
+> garbage in the allocations is from previous allocations in the current
+> process.  It isn't leftover from other processes.
+>
+> The avenues available for reading the memory:
+> -  /dev/mem and /dev/kmem (requires root, not available with Secure Boot)
+> -  /proc/pid/mem (requires ptrace privileges, mediated by YAMA)
+> -  ptrace (requires ptrace privileges, mediated by YAMA)
+> -  causing memory to be swapped to disk, and then inspecting the swap
+>
+> These all require a certain amount of privileges.
+
+How to fix it?
+~~
+
+memzero(), which internally calls explicit_bzero(3), or whatever
+alternative the system provides with a slightly different name, will
+make sure that the buffer is zeroed in memory, and optimizations are not
+allowed to impede this zeroing.
+
+This is not really 100% effective, since compilers may place copies of
+the string somewhere hidden in the stack.  Those copies won't get zeroed
+by explicit_bzero(3).  However, that's arguably a compiler bug, since
+compilers should make everything possible to avoid optimizing strings
+that are later passed to explicit_bzero(3).  But we all know that
+sometimes it's impossible to have perfect knowledge in the compiler, so
+this is plausible.  Nevertheless, there's nothing we can do against such
+issues, except minimizing the time such passwords are stored in plain
+text.
+
+Security concerns
+~
+
+We believe this isn't easy to exploit.  Neverthe

[OE-core] Debugging rust oe-selftest failures

2024-04-03 Thread Alex Kiernan
Hi Sundeep (or anyone else with insight on this!)

How do you go about debugging rust oe-selftest failures? I've bumped
everything up to 1.77 (https://github.com/akiernan/poky) but
oe-selftest fails for reasons that aren't immediately obvious to me...

https://gist.github.com/akiernan/6cc6131c1ec3af866098a9318679cf1b

Any clues?

-- 
Alex Kiernan

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197915): 
https://lists.openembedded.org/g/openembedded-core/message/197915
Mute This Topic: https://lists.openembedded.org/mt/105307188/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [OE-core][PATCH] iputils: splitting the ping6 as a package

2024-04-03 Thread Alexandre Belloni via lists.openembedded.org

https://autobuilder.yoctoproject.org/typhoon/#/builders/64/builds/8810/steps/11/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/117/builds/4601/steps/13/logs/stdio
https://autobuilder.yoctoproject.org/typhoon/#/builders/80/builds/6546/steps/14/logs/stdio

ERROR: Logfile of failure stored in: 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/temp/log.do_install.685043
Log data follows:
| DEBUG: Executing python function extend_recipe_sysroot
| NOTE: Direct dependencies are 
['/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-core/musl/musl_git.bb:do_populate_sysroot',
 
'/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/gcc/gcc-cross_13.2.bb:do_populate_sysroot',
 
'/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/gcc/gcc-runtime_13.2.bb:do_populate_sysroot',
 
'/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/opkg-utils/opkg-utils_0.6.3.bb:do_populate_sysroot',
 
'/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/qemu/qemu-native_8.2.1.bb:do_populate_sysroot',
 
'/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/quilt/quilt-native_0.67.bb:do_populate_sysroot',
 
'/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-support/gnutls/gnutls_3.8.4.bb:do_populate_sysroot',
 
'/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-support/libcap/libcap_2.69.bb:do_populate_sysroot',
 
'virtual:native:/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/meson/meson_1.3.1.bb:do_populate_sysroot',
 
'virtual:native:/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/ninja/ninja_1.11.1.bb:do_populate_sysroot',
 
'virtual:native:/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/patch/patch_2.7.6.bb:do_populate_sysroot',
 
'virtual:native:/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/pkgconfig/pkgconfig_git.bb:do_populate_sysroot',
 
'virtual:native:/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/pseudo/pseudo_git.bb:do_populate_sysroot',
 
'virtual:native:/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-devtools/python/python3_3.12.2.bb:do_populate_sysroot',
 
'virtual:native:/home/pokybuild/yocto-worker/musl-qemux86/build/meta/recipes-support/libcap/libcap_2.69.bb:do_populate_sysroot']
| NOTE: Installed into sysroot: []
| NOTE: Skipping as already exists in sysroot: ['gettext-minimal-native', 
'bsd-headers', 'libssp-nonshared', 'musl', 'binutils-cross-i686', 
'cmake-native', 'gcc-cross-i686', 'gcc-runtime', 'libgcc', 'libtool-native', 
'm4-native', 'opkg-utils', 'qemu-native', 'quilt-native', 'libidn2', 
'texinfo-dummy-native', 'linux-libc-headers', 'gmp', 'gnutls', 'libtasn1', 
'libcap', 'libseccomp', 'libunistring', 'nettle', 'openssl-native', 
'expat-native', 'gettext-native', 'glib-2.0-native', 'ncurses-native', 
'util-linux-libuuid-native', 'util-linux-native', 'zlib-native', 'flex-native', 
'gnu-config-native', 'libedit-native', 'make-native', 'meson-native', 
'ninja-native', 'patch-native', 'perl-native', 'pkgconfig-native', 
'pseudo-native', 'python3-build-native', 'python3-flit-core-native', 
'python3-installer-native', 'python3-packaging-native', 
'python3-pyproject-hooks-native', 'python3-setuptools-native', 
'python3-wheel-native', 'python3-native', 'bzip2-native', 'libnsl2-native', 
'libtirpc-native', 'unzip-native', 'xz-native', 'zstd-native', 'attr-native', 
'gdbm-native', 'gmp-native', 'libcap-ng-native', 'libcap-native', 
'libffi-native', 'libmpc-native', 'libpcre2-native', 'mpfr-native', 
're2c-native', 'sqlite3-native']
| DEBUG: Python function extend_recipe_sysroot finished
| DEBUG: Executing shell function do_install
| Installing ping/ping to 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/image/bin
| Installing tracepath to 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/image/bin
| Installing clockdiff to 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/image/bin
| Installing arping to 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/image/bin
| ln: failed to create symbolic link 
'/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/image//usr/bin/ping6':
 No such file or directory
| WARNING: 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/temp/run.do_install.685043:154
 exit 1 from 'ln -sf ping 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/core2-32-poky-linux-musl/iputils/20240117/image//usr/bin/ping6'
| WARNING: Backtrace (BB generated script):
|   #1: do_install, 
/home/pokybuild/yocto-worker/musl-qemux86/build/build/tmp/work/

Re: [OE-core] [PATCH v2] curl: improve reproducibility

2024-04-03 Thread Oleh Matiusha via lists.openembedded.org
What about --with-libtool-sysroot and DEBUG_PREFIX_MAP?

Oleh

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197913): 
https://lists.openembedded.org/g/openembedded-core/message/197913
Mute This Topic: https://lists.openembedded.org/mt/105181578/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH v2] bash: improve reproducibility

2024-04-03 Thread Oleh Matiusha via lists.openembedded.org
nativesdk-bash package contains host references in output packages.
remove them.

Signed-off-by: Oleh Matiusha 
---
v2
 - moved common code to separate function
---
---
 meta/recipes-extended/bash/bash.inc | 11 ++-
 1 file changed, 10 insertions(+), 1 deletion(-)

diff --git a/meta/recipes-extended/bash/bash.inc 
b/meta/recipes-extended/bash/bash.inc
index 7832ad052b..e541161c75 100644
--- a/meta/recipes-extended/bash/bash.inc
+++ b/meta/recipes-extended/bash/bash.inc
@@ -74,7 +74,8 @@ do_install:append () {
mv ${D}${bindir}/bash ${D}${base_bindir}
fi
 }
-do_install:append:class-target () {
+
+fix_absolute_paths () {
# Clean buildhost references in bashbug
sed -i -e "s,--sysroot=${STAGING_DIR_TARGET},,g" \
-e "s,-I${WORKDIR}/\S* ,,g" \
@@ -93,6 +94,14 @@ do_install:append:class-target () {
${D}${libdir}/bash/Makefile.inc
 }
 
+do_install:append:class-target () {
+   fix_absolute_paths
+}
+
+do_install:append:class-nativesdk () {
+   fix_absolute_paths
+}
+
 do_install_ptest () {
make INSTALL_TEST_DIR=${D}${PTEST_PATH}/tests install-test
cp ${B}/Makefile ${D}${PTEST_PATH}
-- 
2.33.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197912): 
https://lists.openembedded.org/g/openembedded-core/message/197912
Mute This Topic: https://lists.openembedded.org/mt/105304955/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] Patchtest results for [PATCH 3/5] ninja: build modified version with GNU Make jobserver support

2024-04-03 Thread Patchtest
Thank you for your submission. Patchtest identified one
or more issues with the patch. Please see the log below for
more information:

---
Testing patch 
/home/patchtest/share/mboxes/3-5-ninja-build-modified-version-with-GNU-Make-jobserver-support.patch

FAIL: test Signed-off-by presence: A patch file has been added without a 
Signed-off-by tag: '0001-Add-GNU-make-jobserver-client-support.patch' 
(test_patch.TestPatch.test_signed_off_by_presence)

PASS: test CVE tag format (test_patch.TestPatch.test_cve_tag_format)
PASS: test Signed-off-by presence 
(test_mbox.TestMbox.test_signed_off_by_presence)
PASS: test Upstream-Status presence 
(test_patch.TestPatch.test_upstream_status_presence_format)
PASS: test author valid (test_mbox.TestMbox.test_author_valid)
PASS: test commit message presence 
(test_mbox.TestMbox.test_commit_message_presence)
PASS: test lic files chksum presence 
(test_metadata.TestMetadata.test_lic_files_chksum_presence)
PASS: test license presence (test_metadata.TestMetadata.test_license_presence)
PASS: test max line length (test_metadata.TestMetadata.test_max_line_length)
PASS: test mbox format (test_mbox.TestMbox.test_mbox_format)
PASS: test non-AUH upgrade (test_mbox.TestMbox.test_non_auh_upgrade)
PASS: test shortlog format (test_mbox.TestMbox.test_shortlog_format)
PASS: test shortlog length (test_mbox.TestMbox.test_shortlog_length)
PASS: test summary presence (test_metadata.TestMetadata.test_summary_presence)

SKIP: pretest pylint: No python related patches, skipping test 
(test_python_pylint.PyLint.pretest_pylint)
SKIP: pretest src uri left files: No modified recipes, skipping pretest 
(test_metadata.TestMetadata.pretest_src_uri_left_files)
SKIP: test CVE check ignore: No modified recipes or older target branch, 
skipping test (test_metadata.TestMetadata.test_cve_check_ignore)
SKIP: test bugzilla entry format: No bug ID found 
(test_mbox.TestMbox.test_bugzilla_entry_format)
SKIP: test lic files chksum modified not mentioned: No modified recipes, 
skipping test 
(test_metadata.TestMetadata.test_lic_files_chksum_modified_not_mentioned)
SKIP: test pylint: No python related patches, skipping test 
(test_python_pylint.PyLint.test_pylint)
SKIP: test series merge on head: Merge test is disabled for now 
(test_mbox.TestMbox.test_series_merge_on_head)
SKIP: test src uri left files: No modified recipes, skipping pretest 
(test_metadata.TestMetadata.test_src_uri_left_files)
SKIP: test target mailing list: Series merged, no reason to check other mailing 
lists (test_mbox.TestMbox.test_target_mailing_list)

---

Please address the issues identified and
submit a new revision of the patch, or alternatively, reply to this
email with an explanation of why the patch should be accepted. If you
believe these results are due to an error in patchtest, please submit a
bug at https://bugzilla.yoctoproject.org/ (use the 'Patchtest' category
under 'Yocto Project Subprojects'). For more information on specific
failures, see: https://wiki.yoctoproject.org/wiki/Patchtest. Thank
you!

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197911): 
https://lists.openembedded.org/g/openembedded-core/message/197911
Mute This Topic: https://lists.openembedded.org/mt/105304368/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 1/5] classes: jobserver: support gnu make fifo jobserver

2024-04-03 Thread Martin Hundeb?ll
Add a class to implement the gnu make fifo style jobserver. The class
can be activated by symply adding an `INHERIT += "jobserver"` to the
local configuration.

Furthermore, one can configure an external jobserver (i.e. a server
shared between multiple builds), by configured the `JOBSERVER_FIFO`
variable to point at an existing jobserver fifo.

The jobserver class uses the fifo style jobserver, which doesn't require
passing open file descriptors around. It does, however, require
make-4.4, which isn't available in common distro yet. To work around
this, the class make all recipes (except make and its dependencies
itself) depend on `virtual/make-native`.

Signed-off-by: Martin Hundebøll 
---
 meta/classes-global/jobserver.bbclass | 80 +++
 meta/conf/bitbake.conf|  2 +-
 2 files changed, 81 insertions(+), 1 deletion(-)
 create mode 100644 meta/classes-global/jobserver.bbclass

diff --git a/meta/classes-global/jobserver.bbclass 
b/meta/classes-global/jobserver.bbclass
new file mode 100644
index 00..c76909fe50
--- /dev/null
+++ b/meta/classes-global/jobserver.bbclass
@@ -0,0 +1,80 @@
+JOBSERVER_FIFO ?= ""
+JOBSERVER_FIFO[doc] = "Path to external jobserver fifo to use instead of 
creating a per-build server."
+
+addhandler jobserver_setup_fifo
+jobserver_setup_fifo[eventmask] = "bb.event.ConfigParsed"
+
+python jobserver_setup_fifo() {
+# don't setup a per-build fifo, if an external one is configured
+if d.getVar("JOBSERVER_FIFO"):
+return
+
+# don't use a job-server if no parallelism is configured
+jobs = oe.utils.parallel_make(d)
+if jobs in (None, 1):
+return
+
+# reduce jobs by one as a token has implicitly been handed to the
+# process requesting tokens
+jobs -= 1
+
+fifo = d.getVar("TMPDIR") + "/jobserver_fifo"
+
+# and old fifo might be lingering; remove it
+if os.path.exists(fifo):
+os.remove(fifo)
+
+# create a new fifo to use for communicating tokens
+os.mkfifo(fifo)
+
+# fill the fifo with the number of tokens to hand out
+wfd = os.open(fifo, os.O_RDWR)
+written = os.write(wfd, b"+" * jobs)
+if written != (jobs):
+bb.error("Failed to fil make fifo: {} != {}".format(written, jobs))
+
+# configure the per-build fifo path to use
+d.setVar("JOBSERVER_FIFO", fifo)
+}
+
+python () {
+# don't configure the fifo if none is defined
+fifo = d.getVar("JOBSERVER_FIFO")
+if not fifo:
+return
+
+# avoid making make-native or its dependencies depend on make-native itself
+if d.getVar("PN") in (
+"make-native",
+"libtool-native",
+"pkgconfig-native",
+"automake-native",
+"autoconf-native",
+"m4-native",
+"texinfo-dummy-native",
+"gettext-minimal-native",
+"quilt-native",
+"gnu-config-native",
+):
+return
+
+# don't make unwilling recipes depend on make-native
+if d.getVar('INHIBIT_DEFAULT_DEPS', False):
+return
+
+# make other recipes depend on make-native to make sure it is new enough to
+# support the --jobserver-auth=fifo: syntax (from make-4.4 and 
onwards)
+d.appendVar("DEPENDS", " virtual/make-native")
+
+# disable the "-j " flag, as that overrides the jobserver fifo tokens
+d.setVar("PARALLEL_MAKE", "")
+d.setVar("PARALLEL_MAKEINST", "")
+
+# set and export the jobserver in the environment
+d.appendVar("MAKEFLAGS", " --jobserver-auth=fifo:" + fifo)
+d.setVarFlag("MAKEFLAGS", "export", "1")
+
+# ignore the joberserver argument part of MAKEFLAGS in the hash, as that
+# shouldn't change the build output
+d.appendVarFlag("MAKEFLAGS", "vardepvalueexclude", "| 
--jobserver-auth=fifo:" + fifo)
+}
diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf
index 6f180d18b0..23a016b31e 100644
--- a/meta/conf/bitbake.conf
+++ b/meta/conf/bitbake.conf
@@ -960,7 +960,7 @@ BB_HASHEXCLUDE_COMMON ?= "TMPDIR FILE PATH PWD BB_TASKHASH 
BBPATH BBSERVER DL_DI
 BB_WORKERCONTEXT BB_LIMITEDDEPS BB_UNIHASH extend_recipe_sysroot 
DEPLOY_DIR \
 SSTATE_HASHEQUIV_METHOD SSTATE_HASHEQUIV_REPORT_TASKDATA \
 SSTATE_HASHEQUIV_OWNER CCACHE_TOP_DIR BB_HASHSERVE GIT_CEILING_DIRECTORIES 
\
-OMP_NUM_THREADS BB_CURRENTTASK"
+OMP_NUM_THREADS BB_CURRENTTASK JOBSERVER_FIFO"
 BB_BASEHASH_IGNORE_VARS ?= "${BB_HASHEXCLUDE_COMMON} PSEUDO_IGNORE_PATHS 
BUILDHISTORY_DIR \
 SSTATE_DIR SOURCE_DATE_EPOCH RUST_BUILD_SYS RUST_HOST_SYS RUST_TARGET_SYS"
 BB_HASHCONFIG_IGNORE_VARS ?= "${BB_HASHEXCLUDE_COMMON} DATE TIME SSH_AGENT_PID 
\
-- 
2.44.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197910): 
https://lists.openembedded.org/g/openembedded-core/message/197910
Mute This Topic: https://lists.openembedded.org/mt/105304233/21656
Group Owner: openembedded-core+ow...

[OE-core] [PATCH 0/5] Jobserver support

2024-04-03 Thread Martin Hundeb?ll
The parallelism of bitbake easily uses every available core on the build
host. But since every task is run with the same number of parallel
threads/processes, multiple tasks might load the CPU excessively, which
in turn slows down the build due to scheduling overhead.

This patch series adds a class that creates a fifo filled with
PARALLEL_MAKE tokens. The path to the created fifo is then configured in
the MAKEFLAGS environment variable, which is read by make and a patched
ninja (and gcc if doing lto).

The benefits from using the jobserver depends on the set of executed
tasks: running multiple large do_compile tasks simultaneously benefits
more than multiple do_fetch tasks. A simple test building the following
tasks (and all their dependencies) yields a ~5% improvement in build
time (20:20 -> 19:20):

  nodejs-native
  rust-llvm-native
  rust-native
  linux-yocto
  qemu-native

On build machines shared by multiple users, a single jobserver can be
shared between multiple builds (using the JOBSERVER_FIFO variable).
Running the above build in two different build directories at the same
time gives a ~12% improvement (43:17 -> 37:55).

Finally, the memory pressure from e.g. compiling multiple c++ based
projects is also reduced. In our case, a cloud based build machine (with
32 cores and 32GB RAM) fails to compile llvm-rust-native (in parallel to
nodejs) without the jobserver due to a lack of memory.

This patch set is roughly based on previous work by Richard[1]. That
patch lists three TODO items, which are all addressed by these patches:
 * The fifo path defaults to TMPDIR/jobserver_fifo, but can be
   configured using JOBSERVER_FIFO.
 * The number of make threads defaults to the value from PARALLEL_MAKE
   (which is then redundant).
 * If PARALLEL_MAKE is unset, the jobserver functionality is skipped.

Further work in addition to this patch set could be to make bitbake
tasks jobserver aware.

Changes since the RFC[2]:
 * The ninja src uri change in patch 3 is converted to a set of patches
 * The qemu fix in patch 4 is converted to a submitted patch

[1] 
https://lore.kernel.org/openembedded-core/1423223184.20217.15.ca...@linuxfoundation.org/
[2] 
https://lore.kernel.org/openembedded-core/20230828124834.376779-1-mar...@geanix.com/

Martin Hundebøll (5):
  classes: jobserver: support gnu make fifo jobserver
  scripts: build-env: allow passing JOBSERVER_FIFO from environment
  ninja: build modified version with GNU Make jobserver support
  qemu: enable parallel builds when using the jobserver class
  contrib: add python service and systemd unit to run shared jobserver

 contrib/jobserver/jobserver.py|   78 +
 contrib/jobserver/jobserver.service   |   10 +
 meta/classes-global/jobserver.bbclass |   80 +
 meta/conf/bitbake.conf|2 +-
 ...dd-GNU-make-jobserver-client-support.patch |  494 +++
 ...l-monitoring-to-SubprocessSet-DoWork.patch |  560 +++
 ...er-when-jN-is-forced-on-command-line.patch |  198 +++
 .../files/0004-Honor-lN-from-MAKEFLAGS.patch  |  134 ++
 ...e-LinePrinter-for-TokenPool-messages.patch |  128 ++
 .../files/0006-Prepare-PR-for-merging.patch   |  156 ++
 .../files/0007-Add-tests-for-TokenPool.patch  |  237 +++
 ...0008-Add-tests-for-subprocess-module.patch |  121 ++
 .../0009-Add-tests-for-build-module.patch |  397 +
 ...-implementation-for-GNUmakeTokenPool.patch | 1283 +
 .../0011-Prepare-PR-for-merging-part-II.patch |  744 ++
 ...ename-TokenPool-Setup-to-SetupClient.patch |  109 ++
 ...013-Add-TokenPool-SetupMaster-method.patch |   78 +
 ...mmand-line-option-m-tokenpool-master.patch |  101 ++
 ...plement-GNUmakeTokenPool-SetupMaster.patch |  152 ++
 ...mplement-GNUmakeTokenPool-CreatePool.patch |   87 ++
 ...-Add-tests-for-TokenPool-SetupMaster.patch |  145 ++
 ...-jobserver-fifo-style-client-support.patch |  265 
 ...ional-argument-to-m-tokenpool-master.patch |  368 +
 ...-jobserver-fifo-style-master-support.patch |  287 
 meta/recipes-devtools/ninja/ninja_1.11.1.bb   |   33 -
 meta/recipes-devtools/ninja/ninja_1.12.0.bb   |   55 +
 meta/recipes-devtools/qemu/qemu.inc   |1 +
 ...e-jobserver-auth-argument-when-calli.patch |   37 +
 scripts/oe-buildenv-internal  |2 +-
 29 files changed, 6307 insertions(+), 35 deletions(-)
 create mode 100644 contrib/jobserver/jobserver.py
 create mode 100644 contrib/jobserver/jobserver.service
 create mode 100644 meta/classes-global/jobserver.bbclass
 create mode 100644 
meta/recipes-devtools/ninja/files/0001-Add-GNU-make-jobserver-client-support.patch
 create mode 100644 
meta/recipes-devtools/ninja/files/0002-Add-TokenPool-monitoring-to-SubprocessSet-DoWork.patch
 create mode 100644 
meta/recipes-devtools/ninja/files/0003-Ignore-jobserver-when-jN-is-forced-on-command-line.patch
 create mode 100644 
meta/recipes-devtools/ninja/files/0004-Honor-lN-from-MAKEFLAGS.patch
 create mode 100644 
meta/recipes-devtools/ninja/fil

[OE-core] [PATCH 2/5] scripts: build-env: allow passing JOBSERVER_FIFO from environment

2024-04-03 Thread Martin Hundeb?ll
Sharing a common jobserver fifo between multiple (containerized) builds
is much easier, if an administrator can configure said jobserver fifo
path in the environment. Append the JOBSERVER_FIFO variable name to the
list of variables configurable through the environment.

Signed-off-by: Martin Hundebøll 
---
 scripts/oe-buildenv-internal | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/scripts/oe-buildenv-internal b/scripts/oe-buildenv-internal
index 2fdb19565a..c8e67ffb8f 100755
--- a/scripts/oe-buildenv-internal
+++ b/scripts/oe-buildenv-internal
@@ -112,7 +112,7 @@ HTTPS_PROXY https_proxy FTP_PROXY ftp_proxy FTPS_PROXY 
ftps_proxy ALL_PROXY \
 all_proxy NO_PROXY no_proxy SSH_AGENT_PID SSH_AUTH_SOCK BB_SRCREV_POLICY \
 SDKMACHINE BB_NUMBER_THREADS BB_NO_NETWORK PARALLEL_MAKE GIT_PROXY_COMMAND \
 SOCKS5_PASSWD SOCKS5_USER SCREENDIR STAMPS_DIR BBPATH_EXTRA 
BB_SETSCENE_ENFORCE \
-BB_LOGCONFIG"
+BB_LOGCONFIG JOBSERVER_FIFO"
 
 BB_ENV_PASSTHROUGH_ADDITIONS="$(echo $BB_ENV_PASSTHROUGH_ADDITIONS 
$BB_ENV_PASSTHROUGH_ADDITIONS_OE | tr ' ' '\n' | LC_ALL=C sort --unique | tr 
'\n' ' ')"
 
-- 
2.44.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197908): 
https://lists.openembedded.org/g/openembedded-core/message/197908
Mute This Topic: https://lists.openembedded.org/mt/105304231/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 5/5] contrib: add python service and systemd unit to run shared jobserver

2024-04-03 Thread Martin Hundeb?ll
For CI setups that might end up building multiple yocto builds in
parallel, a shared jobserver can reduce the total load of the system.
Setting up such a jobserver is simple, but it does require a process
hanging around to keep the jobserver fifo open (to avoid blocking token
requests).

Add a simple python script that creates such a jobserver fifo and waits
forever. Also add a systemd unit file to start the python service at
boot.

The systemd unit can be installed in $HOME/.config/systemd/user/, but
one might need to add a droplet config (i.e. `systemctl --user edit
jobserver.service`) to setup the PYTHONPATH variable to make the python
script loadable.

Signed-off-by: Martin Hundebøll 
---
 contrib/jobserver/jobserver.py  | 78 +
 contrib/jobserver/jobserver.service | 10 
 2 files changed, 88 insertions(+)
 create mode 100644 contrib/jobserver/jobserver.py
 create mode 100644 contrib/jobserver/jobserver.service

diff --git a/contrib/jobserver/jobserver.py b/contrib/jobserver/jobserver.py
new file mode 100644
index 00..41b085f47f
--- /dev/null
+++ b/contrib/jobserver/jobserver.py
@@ -0,0 +1,78 @@
+#!/usr/bin/env python3
+
+from pathlib import Path
+from threading import Event
+import argparse
+import os
+import shutil
+import signal
+
+resumed = Event()
+runtime_dir = os.environ.get("XDG_RUNTIME_DIR", "/run")
+
+def signal_handler(signum, _frame):
+"""Wait for an external signal exit the process gracefully."""
+resumed.set()
+
+
+def main(path, user, group, mode, jobs):
+"""Setup a fifo to used as jobserver shared between builds."""
+try:
+path.unlink(missing_ok=True)
+os.mkfifo(path)
+shutil.chown(path, user, group)
+os.chmod(path, mode)
+except (FileNotFoundError, PermissionError) as exc:
+raise SystemExit(f"failed to create fifo: {path}: {exc.strerror}")
+
+print(f"jobserver: {path}: {jobs} jobs")
+fifo = os.open(path, os.O_RDWR)
+os.write(fifo, b"+" * jobs)
+
+print("jobserver: ready; waiting indefinitely")
+signal.signal(signal.SIGTERM, signal_handler)
+signal.signal(signal.SIGINT, signal_handler)
+resumed.wait()
+
+print("jobserver: exiting")
+path.unlink()
+os.close(fifo)
+
+
+if __name__ == "__main__":
+parser = argparse.ArgumentParser(
+prog='Make jobserver',
+description='Simple application to instantiate a jobserver fifo and 
hang around',
+)
+parser.add_argument(
+"--mode",
+help="Permission to apply to jobserver fifo",
+type=lambda v: int(v, 8),
+default=0o0666,
+)
+parser.add_argument(
+"--user",
+help="Username or id to assign ownership of fifo to",
+default=os.getuid(),
+)
+parser.add_argument(
+"--group",
+help="Groupname of id to assign ownership of fifo to",
+default=os.getgid(),
+)
+parser.add_argument(
+"path",
+help="Path to jobserver fifo path",
+type=Path,
+nargs='?',
+default=f"{runtime_dir}/jobserver",
+)
+parser.add_argument(
+"jobs",
+help="Number of tokens to load jobserver with",
+type=int,
+nargs='?',
+default=os.cpu_count(),
+)
+args = parser.parse_args()
+main(args.path, args.user, args.group, args.mode, args.jobs)
diff --git a/contrib/jobserver/jobserver.service 
b/contrib/jobserver/jobserver.service
new file mode 100644
index 00..bbc7167ac0
--- /dev/null
+++ b/contrib/jobserver/jobserver.service
@@ -0,0 +1,10 @@
+[Unit]
+Description=Shared jobserver fifo
+
+[Service]
+Type=simple
+Environment=PYTHONUNBUFFERED=1
+ExecStart=python jobserver.py
+
+[Install]
+WantedBy=multi-user.target
-- 
2.44.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197909): 
https://lists.openembedded.org/g/openembedded-core/message/197909
Mute This Topic: https://lists.openembedded.org/mt/105304232/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[OE-core] [PATCH 4/5] qemu: enable parallel builds when using the jobserver class

2024-04-03 Thread Martin Hundeb?ll
If the jobserver class is enabled, the PARALLEL_MAKE variable is unset in
favor of configuring a shared jobserver in the MAKEFLAGS variable. However,
the qemu makefile translates the missing `-j` argument to `-j1` when
calling into meson / ninja. Add a patch to make the qemu makefile
consider the --jobserver-auth option too.

Signed-off-by: Martin Hundebøll 
---
 meta/recipes-devtools/qemu/qemu.inc   |  1 +
 ...e-jobserver-auth-argument-when-calli.patch | 37 +++
 2 files changed, 38 insertions(+)
 create mode 100644 
meta/recipes-devtools/qemu/qemu/0013-Makefile-preserve-jobserver-auth-argument-when-calli.patch

diff --git a/meta/recipes-devtools/qemu/qemu.inc 
b/meta/recipes-devtools/qemu/qemu.inc
index 4501f84c2b..1f86bf5a44 100644
--- a/meta/recipes-devtools/qemu/qemu.inc
+++ b/meta/recipes-devtools/qemu/qemu.inc
@@ -39,6 +39,7 @@ SRC_URI = "https://download.qemu.org/${BPN}-${PV}.tar.xz \
file://0003-linux-user-Add-strace-for-shmat.patch \
file://0004-linux-user-Rewrite-target_shmat.patch \

file://0005-tests-tcg-Check-that-shmat-does-not-break-proc-self-.patch \
+   
file://0013-Makefile-preserve-jobserver-auth-argument-when-calli.patch \
file://CVE-2023-6683.patch \
file://qemu-guest-agent.init \
file://qemu-guest-agent.udev \
diff --git 
a/meta/recipes-devtools/qemu/qemu/0013-Makefile-preserve-jobserver-auth-argument-when-calli.patch
 
b/meta/recipes-devtools/qemu/qemu/0013-Makefile-preserve-jobserver-auth-argument-when-calli.patch
new file mode 100644
index 00..33db8b7ddc
--- /dev/null
+++ 
b/meta/recipes-devtools/qemu/qemu/0013-Makefile-preserve-jobserver-auth-argument-when-calli.patch
@@ -0,0 +1,37 @@
+From 730530c5f01e00cdc3754ebb8f3d7ff995f3376e Mon Sep 17 00:00:00 2001
+From: =?UTF-8?q?Martin=20Hundeb=C3=B8ll?= 
+Date: Thu, 21 Sep 2023 10:57:45 +0200
+Subject: [PATCH] Makefile: preserve --jobserver-auth argument when calling
+ ninja
+MIME-Version: 1.0
+Content-Type: text/plain; charset=UTF-8
+Content-Transfer-Encoding: 8bit
+
+Qemu wraps its call to ninja in a Makefile. Since ninja, as opposed to
+make, utilizes all CPU cores by default, the qemu Makefile translates
+the absense of a `-jN` argument into `-j1`. This breaks jobserver
+functionality, so update the -jN mangling to take the --jobserver-auth
+argument into considerationa too.
+
+Signed-off-by: Martin Hundebøll 
+Upstream-Status: Submitted [https://gitlab.com/qemu-project/qemu/-/issues/1898]
+---
+ Makefile | 2 +-
+ 1 file changed, 1 insertion(+), 1 deletion(-)
+
+diff --git a/Makefile b/Makefile
+index 8f36990335..183756018f 100644
+--- a/Makefile
 b/Makefile
+@@ -142,7 +142,7 @@ MAKE.k = $(findstring k,$(firstword $(filter-out 
--%,$(MAKEFLAGS
+ MAKE.q = $(findstring q,$(firstword $(filter-out --%,$(MAKEFLAGS
+ MAKE.nq = $(if $(word 2, $(MAKE.n) $(MAKE.q)),nq)
+ NINJAFLAGS = $(if $V,-v) $(if $(MAKE.n), -n) $(if $(MAKE.k), -k0) \
+-$(filter-out -j, $(lastword -j1 $(filter -l% -j%, $(MAKEFLAGS \
++$(or $(filter -l% -j%, $(MAKEFLAGS)), $(if $(filter 
--jobserver-auth=%, $(MAKEFLAGS)),, -j1)) \
+ -d keepdepfile
+ ninja-cmd-goals = $(or $(MAKECMDGOALS), all)
+ ninja-cmd-goals += $(foreach g, $(MAKECMDGOALS), $(.ninja-goals.$g))
+-- 
+2.44.0
+
-- 
2.44.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#197906): 
https://lists.openembedded.org/g/openembedded-core/message/197906
Mute This Topic: https://lists.openembedded.org/mt/105304229/21656
Group Owner: openembedded-core+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-