Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Mikko Rapeli
On Thu, Dec 03, 2020 at 07:20:11PM +0100, Alexander Kanavin wrote: > I'd rather teach bitbake to abstain from starting new tasks when I/O or CPU > gets tight. And memory! -Mikko -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#145287):

Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Mikko Rapeli
Hi, On Thu, Dec 03, 2020 at 05:48:16PM +, Ross Burton wrote: > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores > available unless told otherwise. This was a good idea six years > ago[1] but some modern machines are moving to very large core counts. > > For

Re: [OE-core] commit breaks menuconfig on upstream kernel "cml1.bbclass: Handle ncurses-native being available via pkg-config"

2020-12-03 Thread Nathan Rossi
On Fri, 4 Dec 2020 at 14:58, Richard Purdie wrote: > > On Fri, 2020-12-04 at 10:53 +1000, Nathan Rossi wrote: > > On Fri, 4 Dec 2020 at 08:31, Andrey Zhizhikin > > wrote: > > > Hello Scott and Nathan, > > > > > > On Thu, Dec 3, 2020 at 7:18 PM Scott Branden via > > > lists.openembedded.org > > >

Re: [OE-core] [PATCH] oeqa/selftest/containerimage: update for improved cleanup

2020-12-03 Thread Richard Purdie
On Thu, 2020-12-03 at 16:16 +, Ross Burton wrote: > ldconfig/aux-cache isn't generated anymore, and the opkg directories > are correctly removed now. > > Signed-off-by: Ross Burton > --- > meta/lib/oeqa/selftest/cases/containerimage.py | 8 +--- > 1 file changed, 1 insertion(+), 7

Re: [OE-core] commit breaks menuconfig on upstream kernel "cml1.bbclass: Handle ncurses-native being available via pkg-config"

2020-12-03 Thread Richard Purdie
On Fri, 2020-12-04 at 10:53 +1000, Nathan Rossi wrote: > On Fri, 4 Dec 2020 at 08:31, Andrey Zhizhikin > wrote: > > Hello Scott and Nathan, > > > > On Thu, Dec 3, 2020 at 7:18 PM Scott Branden via > > lists.openembedded.org > > wrote: > > > > > > > > > On 2020-12-02 4:19 p.m., Nathan Rossi

[OE-core] Conditional inherit with PACKAGECONFIG

2020-12-03 Thread Robert Joslyn
I'm trying to remove unnecessary packages from one of my images, and I noticed that some conditional inherit lines don't work as I'd expect. In my case, I'm trying to remove python, and the only recipe pulling in python is btrfs-tools. The relevant parts of the btrfs-tools recipe (I'm building on

[OE-core][master][PATCH] qemu: CVE-2020-25723

2020-12-03 Thread Li Wang
References: https://nvd.nist.gov/vuln/detail/CVE-2020-25723 https://bugzilla.redhat.com/show_bug.cgi?id=1898579 backport patch from: https://git.qemu.org/?p=qemu.git;a=commit;h=2fdb42d840400d58f2e706ecca82c142b97bcbd6 Signed-off-by: Li Wang --- meta/recipes-devtools/qemu/qemu.inc |

[OE-core] [PATCH] sysstat: upgrade 12.4.0 -> 12.4.1

2020-12-03 Thread zangrc
Signed-off-by: Zang Ruochen --- .../sysstat/{sysstat_12.4.0.bb => sysstat_12.4.1.bb}| 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) rename meta/recipes-extended/sysstat/{sysstat_12.4.0.bb => sysstat_12.4.1.bb} (65%) diff --git

[OE-core] [PATCH] lighttpd: upgrade 1.4.55 -> 1.4.56

2020-12-03 Thread zangrc
Signed-off-by: Zang Ruochen --- .../lighttpd/{lighttpd_1.4.55.bb => lighttpd_1.4.56.bb} | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) rename meta/recipes-extended/lighttpd/{lighttpd_1.4.55.bb => lighttpd_1.4.56.bb} (96%) diff --git

[OE-core] [PATCH] libinput: upgrade 1.16.3 -> 1.16.4

2020-12-03 Thread zangrc
Signed-off-by: Zang Ruochen --- .../wayland/{libinput_1.16.3.bb => libinput_1.16.4.bb} | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) rename meta/recipes-graphics/wayland/{libinput_1.16.3.bb => libinput_1.16.4.bb} (95%) diff --git

Re: [PATCH] [OE-core] [PATCHv2] systemtap: upgrade 4.3 -> 4.4

2020-12-03 Thread zangrc
I think this problem should be because the kernel does not enable CONFIG_SECURITY_LOCKDOWN_LSM, do you need me to submit a patch to open this option of the kernel? Zangrc From: Zang, Ruochen/臧 若尘 Sent: Thursday, November 26, 2020 2:18 PM To: 'Leonardo Sandoval' Cc:

Re: [OE-core] commit breaks menuconfig on upstream kernel "cml1.bbclass: Handle ncurses-native being available via pkg-config"

2020-12-03 Thread Nathan Rossi
On Fri, 4 Dec 2020 at 08:31, Andrey Zhizhikin wrote: > > Hello Scott and Nathan, > > On Thu, Dec 3, 2020 at 7:18 PM Scott Branden via > lists.openembedded.org > wrote: > > > > > > > > On 2020-12-02 4:19 p.m., Nathan Rossi wrote: > > > On Thu, 3 Dec 2020 at 05:17, Scott Branden > > > wrote: > >

[OE-core][dunfell 00/16] Pull request (cover letter only)

2020-12-03 Thread Steve Sakoman
The following changes since commit b885888df67eb5cdb3b82f4f0a07369a449e223b: build-appliance-image: Update to dunfell head revision (2020-11-25 23:25:31 +) are available in the Git repository at: git://git.openembedded.org/openembedded-core-contrib stable/dunfell-next

[OE-Core][master][gatesgarth][PATCH v2] populate_sdk_ext: use SDK_CUSTOM_TEPLATECONF variable to enable custom templateconf.cfg

2020-12-03 Thread Chandana kalluri
The current implementation will always pick an existing templateconf.cfg if present else it will use the one from OE. A user might not always want to pick an existing tempalteconf.cfg even if its present. Introduce SDK_CUSTOM_TEMPLATECONF variable to provide an option for the user to specify if

[OE-core] [meta-oe][PATCH v4 3/3] procps: split into binary subpackages

2020-12-03 Thread Sinan Kaya
This change allows you to pull individual binaries into the target without including the entire suite. Signed-off-by: Sinan Kaya --- meta/recipes-extended/procps/procps_3.3.16.bb | 15 --- 1 file changed, 4 insertions(+), 11 deletions(-) diff --git

[OE-core] [meta-oe][PATCH v4 2/3] net-tools: split into binary packages

2020-12-03 Thread Sinan Kaya
Support per binary package to not bloat the system with unneeded tools. Signed-off-by: Sinan Kaya --- .../net-tools/net-tools_1.60-20181103.bb | 9 + 1 file changed, 1 insertion(+), 8 deletions(-) diff --git a/meta/recipes-extended/net-tools/net-tools_1.60-20181103.bb

[OE-core] [meta-oe][PATCH v4 1/3] introduce lib_subpackage

2020-12-03 Thread Sinan Kaya
This subclass allows us to easily split a recipe into subpackages. Signed-off-by: Sinan Kaya --- meta/classes/lib_subpackage.bbclass | 40 + 1 file changed, 40 insertions(+) create mode 100644 meta/classes/lib_subpackage.bbclass diff --git

Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Richard Purdie
On Thu, 2020-12-03 at 17:48 +, Ross Burton wrote: > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of > cores > available unless told otherwise. This was a good idea six years > ago[1] but some modern machines are moving to very large core counts. > > For example, 88

Re: [OE-core] [PATCH] wic: Introduce empty plugin to create unformatted empty partitions

2020-12-03 Thread Richard Purdie
On Thu, 2020-12-03 at 15:35 +, Diego Sueiro wrote: > The empty wic plugin is used to create unformatted empty partitions for wic > images. > > To use it you must pass "empty" as argument for the "--source" parameter in > the wks file. For example: > part foo --source empty --ondisk sda

Re: [OE-core] [PATCH] mesa.inc: add dispmanx support

2020-12-03 Thread Trevor Woerner
On Thu, Dec 3, 2020 at 5:25 PM Phil Blundell wrote: > If we're talking about OpenGLES applications, wouldn't you already have > opengl in DISTRO_FEATURES? > Not necessarily. Adding opengl to DISTRO_FEATURES really means "enable a bunch of PACKAGECONFIGs all over the place because I need x11

Re: [OE-core] commit breaks menuconfig on upstream kernel "cml1.bbclass: Handle ncurses-native being available via pkg-config"

2020-12-03 Thread Andrey Zhizhikin
Hello Scott and Nathan, On Thu, Dec 3, 2020 at 7:18 PM Scott Branden via lists.openembedded.org wrote: > > > > On 2020-12-02 4:19 p.m., Nathan Rossi wrote: > > On Thu, 3 Dec 2020 at 05:17, Scott Branden > > wrote: > >> Hi Nathan, > >> > >> Your commit: > >> "cml1.bbclass: Handle ncurses-native

Re: [OE-core] [PATCH] mesa.inc: add dispmanx support

2020-12-03 Thread Phil Blundell via lists.openembedded.org
If we're talking about OpenGLES applications, wouldn't you already have opengl in DISTRO_FEATURES? I'm not sure it makes a lot of sense to introduce a check for dispmanx to oe-core if nothing in oe-core ever defines that feature. p. On 3 December 2020 13:35:26 GMT, Trevor Woerner wrote:

Re: [OE-core] [PATCH] mesa.inc: add dispmanx support

2020-12-03 Thread Trevor Woerner
On Thu, Dec 3, 2020 at 2:01 PM Khem Raj wrote: > On Thu, Dec 3, 2020 at 5:35 AM Trevor Woerner wrote: > > -ANY_OF_DISTRO_FEATURES_class-target = "opengl vulkan" > > +ANY_OF_DISTRO_FEATURES_class-target = "opengl vulkan dispmanx" > > > > dispmanx is only supported by userland graphics and we do

Re: [OE-Core][master][gatesgarth][PATCH] populate_sdk_ext: use CUSTOM_TEPLATECONF variable to enable custom templateconf.cfg

2020-12-03 Thread Richard Purdie
On Mon, 2020-11-30 at 14:07 -0800, Chandana kalluri wrote: > The current implementation will always pick an existing templateconf.cfg if > present else it will use the one from OE. A user might not always want to > pick > an existing tempalteconf.cfg even if its present. Introduce >

Re: [OE-core] [PATCH 1/2] iproute2: install tools to mirror install under Debian/Ubuntu

2020-12-03 Thread Alan Perry
On 12/2/20 11:29 PM, Andre McCurdy wrote: On Wed, Dec 2, 2020 at 11:11 AM Alan Perry wrote: Many scripts exist that expect the iproute2 tools to be found in the same directories where they are found in Debian or Ubuntu. For the iproute2 tools included in the iproute2 recipe, move them to

Re: [OE-core] [PATCH 02/11] kea: fix reproducibility

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 11:22 AM Alexander Kanavin wrote: > > On Thu, 3 Dec 2020 at 20:19, Khem Raj wrote: >> >> >> but say if you were. Would it make the problem more obscure than what >> it is now. So while here, perhaps defining KEA_LOCKFILE_DIR to point >> to /run would be a prudent thing to

Re: [OE-core] [PATCH 04/11] ruby: fix reproducibility

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 11:20 AM Alexander Kanavin wrote: > > On Thu, 3 Dec 2020 at 20:16, Khem Raj wrote: >> >> >> where is this template used ? is it used on target ? is it possible to >> just all bare compiler name then since it will still work on target >> although not as important as if it

Re: [OE-core] [PATCH 08/11] serf: do not install the static library

2020-12-03 Thread Alexander Kanavin
On Thu, 3 Dec 2020 at 20:30, Khem Raj wrote: > > honestly, scons should be fixed here. Since it will be used in more > than one places > using host ar is never a good option for cross builds. > if you dare reluctant to fix scons properly that's fine but at least > create a tracker bug for it. >

Re: [OE-core] [PATCH 09/11] llvm: sort the lists in generated source reproducibibly

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 5:37 AM Alexander Kanavin wrote: > > Signed-off-by: Alexander Kanavin > --- > ...r-sort-ClassInfo-lists-by-name-as-we.patch | 31 +++ > meta/recipes-devtools/llvm/llvm_git.bb| 3 +- > 2 files changed, 33 insertions(+), 1 deletion(-) > create mode

Re: [OE-core] [PATCH 08/11] serf: do not install the static library

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 5:37 AM Alexander Kanavin wrote: > > scons is using host ar to create it, which may or may not > be built with reproducible option by default. Rather than > patch scons for the benefit of a single recipe, let's > just not install the .a, which is unused anyway. > honestly,

Re: [OE-core] [PATCH 02/11] kea: fix reproducibility

2020-12-03 Thread Alexander Kanavin
On Thu, 3 Dec 2020 at 20:19, Khem Raj wrote: > > but say if you were. Would it make the problem more obscure than what > it is now. So while here, perhaps defining KEA_LOCKFILE_DIR to point > to /run would be a prudent thing to do if it's already not done. > Apologies, but no. I am not defining

Re: [OE-core] [PATCH 04/11] ruby: fix reproducibility

2020-12-03 Thread Alexander Kanavin
On Thu, 3 Dec 2020 at 20:16, Khem Raj wrote: > > where is this template used ? is it used on target ? is it possible to > just all bare compiler name then since it will still work on target > although not as important as if it was needed during cross builds. > I don't think it is used on

Re: [OE-core] [PATCH 02/11] kea: fix reproducibility

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 11:12 AM Alexander Kanavin wrote: > > On Thu, 3 Dec 2020 at 20:07, Khem Raj wrote: >> >> >> does this test then work or do we also need to ensure that >> KEA_LOCKFILE_DIR is set to somewhere in /run dir >> via Compiler flags or some such > > > As we are not executing the

Re: [OE-core] [PATCH 04/11] ruby: fix reproducibility

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 5:37 AM Alexander Kanavin wrote: > > Signed-off-by: Alexander Kanavin > --- > ...e.in-do-not-write-host-cross-cc-item.patch | 32 +++ > meta/recipes-devtools/ruby/ruby_2.7.2.bb | 1 + > 2 files changed, 33 insertions(+) > create mode 100644 >

Re: [OE-core] [PATCH 02/11] kea: fix reproducibility

2020-12-03 Thread Alexander Kanavin
On Thu, 3 Dec 2020 at 20:07, Khem Raj wrote: > > does this test then work or do we also need to ensure that > KEA_LOCKFILE_DIR is set to somewhere in /run dir > via Compiler flags or some such > As we are not executing the test, it does not matter, and it would not have worked on target anyway

Re: [OE-core] [PATCH 02/11] kea: fix reproducibility

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 5:37 AM Alexander Kanavin wrote: > > Signed-off-by: Alexander Kanavin > --- > ...er_unittest_support.cc-do-not-write-.patch | 27 + > meta/recipes-connectivity/kea/kea_1.7.10.bb | 29 +++ > 2 files changed, 44 insertions(+), 12

Re: [OE-core] [PATCH] mesa.inc: add dispmanx support

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 5:35 AM Trevor Woerner wrote: > > On the RaspberryPi it is possible to run gles2 applications on top of dispmanx > without the need for x11/wayland/etc. > > Signed-off-by: Trevor Woerner > --- > meta/recipes-graphics/mesa/mesa.inc | 2 +- > 1 file changed, 1 insertion(+),

Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Khem Raj
On Thu, Dec 3, 2020 at 9:48 AM Ross Burton wrote: > > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores > available unless told otherwise. This was a good idea six years > ago[1] but some modern machines are moving to very large core counts. > > For example, 88 core

Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Konrad Weihmann
+1 for Alex's comment. As I/O (and potentially RAM) is clearly the bottleneck here, limitation to some arbitrary value doesn't address the issue at the right end. I would rather see real resource management. From my point of view there is a huge difference if I package like 128 shell scripts

Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Paul Barker
On Thu, 3 Dec 2020 at 17:48, Ross Burton wrote: > > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores > available unless told otherwise. This was a good idea six years > ago[1] but some modern machines are moving to very large core counts. > > For example, 88 core

Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Andre McCurdy
On Thu, Dec 3, 2020 at 9:48 AM Ross Burton wrote: > > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores > available unless told otherwise. This was a good idea six years > ago[1] but some modern machines are moving to very large core counts. > > For example, 88 core

Re: [OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Alexander Kanavin
I'd rather teach bitbake to abstain from starting new tasks when I/O or CPU gets tight. Alex On Thu, 3 Dec 2020 at 18:48, Ross Burton wrote: > Hi, > > Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores > available unless told otherwise. This was a good idea six years >

Re: [OE-core] commit breaks menuconfig on upstream kernel "cml1.bbclass: Handle ncurses-native being available via pkg-config"

2020-12-03 Thread Scott Branden via lists.openembedded.org
On 2020-12-02 4:19 p.m., Nathan Rossi wrote: > On Thu, 3 Dec 2020 at 05:17, Scott Branden wrote: >> Hi Nathan, >> >> Your commit: >> "cml1.bbclass: Handle ncurses-native being available via pkg-config" >>

Re: [OE-core] commit breaks menuconfig on upstream kernel "cml1.bbclass: Handle ncurses-native being available via pkg-config"

2020-12-03 Thread Scott Branden via lists.openembedded.org
On 2020-12-02 4:19 p.m., Nathan Rossi wrote: > On Thu, 3 Dec 2020 at 05:17, Scott Branden wrote: >> Hi Nathan, >> >> Your commit: >> "cml1.bbclass: Handle ncurses-native being available via pkg-config" >>

[OE-core] Automatic cap on BB_NUMBER_THREADS and PARALLEL_MAKE

2020-12-03 Thread Ross Burton
Hi, Currently, BB_NUMBER_THREADS and PARALLEL_MAKE use the number of cores available unless told otherwise. This was a good idea six years ago[1] but some modern machines are moving to very large core counts. For example, 88 core dual Xeons are fairly common. A ThunderX2 has 256 cores (2

Re: [OE-core] [meta-oe][PATCH v3] net-tools: split into binary packages

2020-12-03 Thread Sinan Kaya
On 12/3/2020 10:40 AM, Anibal Limon wrote: > This patch causes problems in multilib configurations, > > http://errors.yoctoproject.org/Errors/Details/539019/ > > Thanks for the report, I'll take a look. -=-=-=-=-=-=-=-=-=-=-=- Links: You

[OE-core] [PATCH] oeqa/selftest/containerimage: update for improved cleanup

2020-12-03 Thread Ross Burton
ldconfig/aux-cache isn't generated anymore, and the opkg directories are correctly removed now. Signed-off-by: Ross Burton --- meta/lib/oeqa/selftest/cases/containerimage.py | 8 +--- 1 file changed, 1 insertion(+), 7 deletions(-) diff --git a/meta/lib/oeqa/selftest/cases/containerimage.py

Re: [OE-Core][master][gatesgarth][PATCH] populate_sdk_ext: use CUSTOM_TEPLATECONF variable to enable custom templateconf.cfg

2020-12-03 Thread Chandana kalluri
Ping On 11/30/20, 2:07 PM, "openembedded-core@lists.openembedded.org on behalf of Chandana kalluri via lists.openembedded.org" wrote: The current implementation will always pick an existing templateconf.cfg if present else it will use the one from OE. A user might not always want to

Re: [OE-core] [meta-oe][PATCH v3] net-tools: split into binary packages

2020-12-03 Thread Anibal Limon
This patch causes problems in multilib configurations, http://errors.yoctoproject.org/Errors/Details/539019/ Regards, Anibal On Mon, 30 Nov 2020 at 21:35, Sinan Kaya wrote: > Support per binary package to not bloat the system with unneeded > tools. > > Signed-off-by: Sinan Kaya > --- >

[OE-core] [PATCH] wic: Introduce empty plugin to create unformatted empty partitions

2020-12-03 Thread Diego Sueiro
The empty wic plugin is used to create unformatted empty partitions for wic images. To use it you must pass "empty" as argument for the "--source" parameter in the wks file. For example: part foo --source empty --ondisk sda --size="1024" --align 1024 Signed-off-by: Diego Sueiro ---

[OE-core][dunfell 27/28] bitbake.conf: Exclude ${CCACHE_DIR} from pseudo database

2020-12-03 Thread Steve Sakoman
From: Mingli Yu When ccache enabled as below: INHERIT += "ccache" CCACHE_DIR = "/path/build/ccache" There comes do_install failure for some recipes randomly, take linux-libc-headerswhen as example. $ cat /path/build/tmp/work/corei7-64-wrs-linux/linux-libc-headers/5.8-r0/pseudo/pseudo.log

[OE-core][dunfell 28/28] uninative: Don't use single sstate for pseudo-native

2020-12-03 Thread Steve Sakoman
From: Richard Purdie pseudo-native is a bit special. It conditionally compiles in support for xattr, statx and statvfs amongst other options. If a pseudo-native binary is used on a system where these functions are present but it wasn't compiled in we see hard to debug permissions problems. An

[OE-core][dunfell 25/28] oeqa/selftest/runtime_test: Exclude gpg directory from pseudo database

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Avoid pseudo abort()s like: path mismatch [1 link]: ino 6295376 db '/tmp/oeqa-feed-sign-2mw7z81v/S.gpg-agent.yocto-native' req '/tmp/jwkivmu6'. Signed-off-by: Richard Purdie (cherry picked from commit 189630ca6cdf7ceb6cf9b8f9d86c58997f505efc) Signed-off-by: Steve Sakoman

[OE-core][dunfell 26/28] tcl: adapt to potential pseudo changes

2020-12-03 Thread Steve Sakoman
From: Mingli Yu It failed as below when rerun do_install for tcl: $ bitbake tcl $ bitbake tcl -f -cinstall [snip] | NOTE: make -j 72 DESTDIR=/build/tmp/work/core2-64-wrs-linux/tcl/8.6.10-r0/image install | abort()ing pseudo client by server request. See

[OE-core][dunfell 23/28] pseudo: Upgrade to include mkostemp64 wrapper

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Newer systems are using this currently unwrapped glibc function, add it. [YOCTO #14080] Signed-off-by: Richard Purdie (cherry picked from commit cba4f51f0166e2c20e854ee0344be0c58769eaca) Signed-off-by: Steve Sakoman --- meta/recipes-devtools/pseudo/pseudo_git.bb | 2 +-

[OE-core][dunfell 24/28] base.bbclass: use os.path.normpath instead of just comparing WORKDIR and S as strings

2020-12-03 Thread Steve Sakoman
From: Martin Jansa * cannot use os.path.samefile, because S/B might not exist at this time yet * there is issue with PSEUDO_IGNORE_PATHS when some recipe sets e.g. S = "${WORKDIR}/" whole WORKDIR gets added to PSEUDO_IGNORE_PATHS and then the build can fail with various strange errors, in

[OE-core][dunfell 22/28] pseudo: Update to account for patches merged on branch

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Signed-off-by: Richard Purdie (cherry picked from commit ea22fb3aa1c5dd3edcd1d8b415a0843a9ee4677c) Signed-off-by: Steve Sakoman --- .../pseudo/files/abort_on_mismatch.patch | 64 .../pseudo/files/add_ignore_paths.patch | 298 --

[OE-core][dunfell 21/28] abi_version,sanity: Tell users TMPDIR must be clean after pseudo changes

2020-12-03 Thread Steve Sakoman
From: Richard Purdie After the recent path ignore changes, there are invalid entries in exiting pseudo databases which will trip up users with the new abort() (proving how common the pseudo potential corrpution is!). Inform them a clean TMPDIR is needed. Signed-off-by: Richard Purdie (cherry

[OE-core][dunfell 20/28] bitbake.conf: Extend PSEUDO_IGNORE_PATHS to ${COREBASE}/meta

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Unfortunately, .pyc files can be generated in meta/lib/oe which corrupt the pseudo database so we need to extend the ignore list to cover this as well. Signed-off-by: Richard Purdie (cherry picked from commit e0cb6dd689a362d8433caa14cc5a9fdd5eb44923) Signed-off-by: Steve

[OE-core][dunfell 17/28] wic: Handle new PSEUDO_IGNORE_PATHS variable

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Adjust wic to correctly handle the new PSEUDO_IGNORE_PATH variable and avoid inode corruption issues. Signed-off-by: Richard Purdie (cherry picked from commit 13500f5234361385c365c7c35e83f99435500481) Signed-off-by: Steve Sakoman --- meta/classes/image_types_wic.bbclass

[OE-core][dunfell 19/28] devtool: remove unused variable

2020-12-03 Thread Steve Sakoman
From: Ross Burton This variable isn't used at all. Signed-off-by: Ross Burton Signed-off-by: Richard Purdie (cherry picked from commit 9676ee24d190b144cb50be6ebde3990644a6df2a) Signed-off-by: Steve Sakoman --- scripts/lib/devtool/standard.py | 1 - 1 file changed, 1 deletion(-) diff --git

[OE-core][dunfell 18/28] pseudo: Fix statx function usage

2020-12-03 Thread Steve Sakoman
From: Richard Purdie There is magic in the posts where specific variable names have specific magic. For that magic to work, "path" needs to be used not "pathname" as is currently there. Fix this, which fixes path issues on systems using statx (Ubuntu 20.04 in particular). Signed-off-by: Richard

[OE-core][dunfell 15/28] wic: Fix multi images .wks with bitbake

2020-12-03 Thread Steve Sakoman
From: Ricardo Ribalda Delgado In order to support .wks files with multiple images inside bitbake we need to explicitly set the pseudo database in use. Eg: If we try this .mks: part / --source rootfs --ondisk sda --fstype=ext4 part /export --source rootfs --rootfs=core-image-minimal-mtdutils

[OE-core][dunfell 14/28] wic: Fix permissions when using exclude or include path

2020-12-03 Thread Steve Sakoman
From: Ricardo Ribalda Delgado When parameters include_path or exclude_path are passed to the rootfs plugin, it will copy the partition content into a folder and make all the modifications there. This is done using copyhardlinktree(), which does not take into consideration the content of the

[OE-core][dunfell 16/28] wic: Avoid creating invalid pseudo directory

2020-12-03 Thread Steve Sakoman
From: Ricardo Ribalda Delgado If the source of the rootfs is not a bitbake cooked image, or it is not pointing to the root of one, we call pseudo again, which will produce a new pseudo folder at rootfs/../pseudo Eg: part /etc --source rootfs --rootfs-dir=${IMAGE_ROOTFS}/home --fstype=ext4 Cc:

[OE-core][dunfell 13/28] base/bitbake.conf: Enable pseudo path filtering

2020-12-03 Thread Steve Sakoman
From: Richard Purdie This is a pretty big change to the way pseudo operates when used in OpenEmbedded. Normally, pseudo monitors and logs (adds to its database) any file created or modified whilst in a fakeroot environment. There are large numbers of files we simply don't care about the

[OE-core][dunfell 12/28] bitbake.conf: Remove TERM from default BB_HASHBASE_WHITELIST

2020-12-03 Thread Steve Sakoman
From: Jacob Kroon Since BitBake commit 0d5cdd0c0d65f2f81c3af0f3767fee86c4142c3a TERM is no longer preserved in the environment by BitBake, so there should be no need to whitelist it by default. Signed-off-by: Jacob Kroon Signed-off-by: Richard Purdie (cherry picked from commit

[OE-core][dunfell 11/28] pseudo: Add pathfix patch

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Add a path to fix up handling of dirfd being passed as a full file and with path="". Signed-off-by: Richard Purdie (cherry picked from commit 3006bbe7768e4efe33d3d2d3f5786a561ecbe96f) Signed-off-by: Steve Sakoman --- .../pseudo/files/pathfix.patch| 25

[OE-core][dunfell 10/28] pseudo: Add may unlink patch

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Mark files which are unlinked (nlink == 0) but open with fd's as "may-unlink" to avoid problematic database entries. Signed-off-by: Richard Purdie (cherry picked from commit e1e481f3608c05ab14c61bf45cd0837d7287b6a5) Signed-off-by: Steve Sakoman ---

[OE-core][dunfell 09/28] pseudo: Fix xattr segfault

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Fix a NULL pointer dereference exposed by the path ignore code in xattr handling. Signed-off-by: Richard Purdie (cherry picked from commit 929a27bf6cbca94d1141d2094ae0c915d93bd3f4) Signed-off-by: Steve Sakoman --- .../pseudo/files/xattr_fix.patch | 40

[OE-core][dunfell 06/28] pseudo: Add support for ignoring paths from the pseudo DB

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Add PSEUDO_IGNORE_PATHS, a comma separated list of path prefixes, where any files underneath are not handled by pseudo. This allows files to be left out of the pseudo datanase where we know we don't need the fake root emulation. This is particularly useful if we know these

[OE-core][dunfell 08/28] psuedo: Add tracking of linked files for fds

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Where files are link()'d and one is unlink()'d, pseudo's fd mappings can become confused. Add a patch to try and improve this for the common usecases we see. Signed-off-by: Richard Purdie (cherry picked from commit 9ce621fa2099608ca0ccbb8420b31d71cdd7b00e) Signed-off-by:

[OE-core][dunfell 07/28] pseudo: Abort on mismatch patch

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Rather than doing what turns out to be a rather dangerous "fixup" if we see a file with a different path but the same inode as another file we've previously seen, throw and abort. Direct the user to a wiki page where we can maintain information about what this error means.

[OE-core][dunfell 05/28] pseudo: Ignore mismatched inodes from the db

2020-12-03 Thread Steve Sakoman
From: Richard Purdie Currently, where pseudo finds a database entry for an inode but the path doesn't match, it reuses that database entry metadata. This is causing real world "corruption" of file attributes. See [YOCTO #14057] for an example of this. This can happen when files are deleted

[OE-core][dunfell 04/28] pseudo: fix renaming to self

2020-12-03 Thread Steve Sakoman
From: Joe Slater Pseudo tests for an item being renamed to itself only after information about it has been deleted. Move the test to before we change the database. Note that pseudo does not support renameat2(), but neither does glibc. Signed-off-by: Joe Slater Signed-off-by: Richard Purdie

[OE-core][dunfell 03/28] pseudo: Update to add OFC fcntl lock updates

2020-12-03 Thread Steve Sakoman
From: Richard Purdie This adds in support for the OFC fcntl ioctl lock flags, removing warnings on some more recent linux kernels. Signed-off-by: Richard Purdie (cherry picked from commit 234168f803bee2e5b0955aabaddb1d967349fb82) Signed-off-by: Steve Sakoman ---

[OE-core][dunfell 02/28] pseudo: merge in fixes for setfacl issue

2020-12-03 Thread Steve Sakoman
From: Richard Purdie [YOCTO #13959] Signed-off-by: Richard Purdie (cherry picked from commit 18fbd28c9aa0276d110839c4282a9ab75fc9f28e) Signed-off-by: Steve Sakoman --- meta/recipes-devtools/pseudo/pseudo_git.bb | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git

[OE-core][dunfell 01/28] pseudo: Switch to oe-core branch in git repo

2020-12-03 Thread Steve Sakoman
From: Richard Purdie We have a significant number of outstanding patches to pseudo. Rather than queue these up as patches, create a branch in the upstream repo and use that until such times as we have someone with the time/skills to properly review these for master in the pseudo repo.

[OE-core][dunfell 00/28] Patch review - pseudo file mode corruption fix series

2020-12-03 Thread Steve Sakoman
Issues with undetected file mode corruption in pseudo have been identified. Fixes have been merged into master and gatesgarth over the past couple of months and things seem to have stabilized enough that we can consider backporting these fixes to dunfell. This is a somewhat more invasive

[OE-core] [PATCH 11/11] selftest/reproducible: add an exclusion list for items that are not yet reproducible

2020-12-03 Thread Alexander Kanavin
-20201127-4s9ejwyp/ +# https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20201127-haiwdlbr/ +# https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20201127-hwds3mcl/ +# https://autobuilder.yocto.io/pub/repro-fail/oe-reproducible-20201203-sua0pzvc/ +# (both packages/ and packages

[OE-core] [PATCH 10/11] selftest/reproducible: enable world reproducibility test

2020-12-03 Thread Alexander Kanavin
Add systemd and pam distro features, and commercial license flag to include more recipes into the world set. Signed-off-by: Alexander Kanavin --- meta/lib/oeqa/selftest/cases/reproducible.py | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git

[OE-core] [PATCH 09/11] llvm: sort the lists in generated source reproducibibly

2020-12-03 Thread Alexander Kanavin
Signed-off-by: Alexander Kanavin --- ...r-sort-ClassInfo-lists-by-name-as-we.patch | 31 +++ meta/recipes-devtools/llvm/llvm_git.bb| 3 +- 2 files changed, 33 insertions(+), 1 deletion(-) create mode 100644

[OE-core] [PATCH 08/11] serf: do not install the static library

2020-12-03 Thread Alexander Kanavin
scons is using host ar to create it, which may or may not be built with reproducible option by default. Rather than patch scons for the benefit of a single recipe, let's just not install the .a, which is unused anyway. Signed-off-by: Alexander Kanavin --- meta/recipes-support/serf/serf_1.3.9.bb

[OE-core] [PATCH 07/11] piglit: fix reproducibility

2020-12-03 Thread Alexander Kanavin
Signed-off-by: Alexander Kanavin --- ...file.py-make-test-lists-reproducible.patch | 31 + ...gen_tcs-tes_input_tests.py-do-not-ha.patch | 44 +++ ...lizer.py-make-.gz-files-reproducible.patch | 30 + ...sort-the-file-list-before-working-on.patch | 28

[OE-core] [PATCH 06/11] ffmpeg: fix reproducibility

2020-12-03 Thread Alexander Kanavin
Signed-off-by: Alexander Kanavin --- ...e-assembly-with-full-path-from-sourc.patch | 97 +++ .../recipes-multimedia/ffmpeg/ffmpeg_4.3.1.bb | 6 ++ 2 files changed, 103 insertions(+) create mode 100644

[OE-core] [PATCH 04/11] ruby: fix reproducibility

2020-12-03 Thread Alexander Kanavin
Signed-off-by: Alexander Kanavin --- ...e.in-do-not-write-host-cross-cc-item.patch | 32 +++ meta/recipes-devtools/ruby/ruby_2.7.2.bb | 1 + 2 files changed, 33 insertions(+) create mode 100644

[OE-core] [PATCH 05/11] webkitgtk: fix reproducibility

2020-12-03 Thread Alexander Kanavin
Signed-off-by: Alexander Kanavin --- meta/recipes-sato/webkit/webkitgtk_2.30.2.bb | 12 1 file changed, 12 insertions(+) diff --git a/meta/recipes-sato/webkit/webkitgtk_2.30.2.bb b/meta/recipes-sato/webkit/webkitgtk_2.30.2.bb index 58b66c0f66..31370f3239 100644 ---

[OE-core] [PATCH 03/11] llvm: fix reproducibility

2020-12-03 Thread Alexander Kanavin
Signed-off-by: Alexander Kanavin --- meta/recipes-devtools/llvm/llvm_git.bb | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/recipes-devtools/llvm/llvm_git.bb b/meta/recipes-devtools/llvm/llvm_git.bb index 4c2d490315..b146d0e6e3 100644 --- a/meta/recipes-devtools/llvm/llvm_git.bb

[OE-core] [PATCH 01/11] meta/lib/oe/reproducible.py: gitsm:// works just as fine as git:// for timestamps

2020-12-03 Thread Alexander Kanavin
This in particular addresses vulkan-samples reproducibility which made me scratch my head for a while. Signed-off-by: Alexander Kanavin --- meta/lib/oe/reproducible.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oe/reproducible.py b/meta/lib/oe/reproducible.py

[OE-core] [PATCH 02/11] kea: fix reproducibility

2020-12-03 Thread Alexander Kanavin
Signed-off-by: Alexander Kanavin --- ...er_unittest_support.cc-do-not-write-.patch | 27 + meta/recipes-connectivity/kea/kea_1.7.10.bb | 29 +++ 2 files changed, 44 insertions(+), 12 deletions(-) create mode 100644

[OE-core] [PATCH] mesa.inc: add dispmanx support

2020-12-03 Thread Trevor Woerner
On the RaspberryPi it is possible to run gles2 applications on top of dispmanx without the need for x11/wayland/etc. Signed-off-by: Trevor Woerner --- meta/recipes-graphics/mesa/mesa.inc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-graphics/mesa/mesa.inc

[OE-core] [PATCH 2/2] initscripts: Change execution order between checkroot and modutils

2020-12-03 Thread Diego Sueiro
When '/' is first mounted as read-only, we want to have the checkroot.sh initscript (which then remounts '/' as rw if allowed) running before the modutils.sh. This is because modutils.sh initscript might need to run depmod depending on the status of the modules.dep file to update it and the '/'

[OE-core] [PATCH 1/2] modutils-initscripts: Fix modules.dep creation when USE_DEPMOD="0"

2020-12-03 Thread Diego Sueiro
When having USE_DEPMOD="0" it is expected that in the first boot that the modules.dep is generated. To achieve this we need to check if modules.dep exists and has a size greater than zero. This verification also needs to be done regardless of whether the /etc/modules or /etc/modules-load.d

Re: [OE-core] commit breaks menuconfig on upstream kernel "cml1.bbclass: Handle ncurses-native being available via pkg-config"

2020-12-03 Thread Andrey Zhizhikin
Hello Nathan, On Thu, Dec 3, 2020 at 1:20 AM Nathan Rossi wrote: > > On Thu, 3 Dec 2020 at 05:17, Scott Branden wrote: > > > > Hi Nathan, > > > > Your commit: > > "cml1.bbclass: Handle ncurses-native being available via pkg-config" > >

[OE-core] [PATCH 3/3] systemd-conf: match ethernet interfaces by type rather than globbing

2020-12-03 Thread Jack Mitchell
If we say we're enabling DHCP on wired/ethernet networks lets be more specific than trying to catch everything with globbing. Signed-off-by: Jack Mitchell --- meta/recipes-core/systemd/systemd-conf/wired.network | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git

[OE-core] [PATCH 2/3] systemd-conf: add PACKAGECONFIG to enable/disable auto ethernet DHCP

2020-12-03 Thread Jack Mitchell
Allow distros which include other network managers to disable the auto DHCP setup of interfaces in systemd-networkd. Signed-off-by: Jack Mitchell --- meta/recipes-core/systemd/systemd-conf_246.1.bb | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git

[OE-core] [PATCH 1/3] Revert "connman: set service to conflict with systemd-networkd"

2020-12-03 Thread Jack Mitchell
Without further examples of how this is failing revert as using both together is a valid use case, for example connman handling Wifi/AP and systemd-networkd handling more complex routing such as for containers and ethernet switches. This reverts commit 5303420ead25817f5caec276b79eec7ee797271a.

Re: [OE-core] [PATCH 2/2] connman: set service to conflict with systemd-networkd

2020-12-03 Thread kai
On 12/2/20 8:11 PM, Jack Mitchell wrote: On 02/12/2020 02:20, Yi Zhao wrote: On 12/1/20 5:02 AM, Jack Mitchell wrote: On 02/11/2020 09:20, Yi Zhao wrote: Do not run systemd-networkd and connman simultaneously. These two network managers may conflict with each other. Signed-off-by: Yi Zhao