[oe] [meta-multimedia][PATCH] pipewire: Update 0.3.81 -> 0.3.83

2023-10-20 Thread Markus Volk
PipeWire 0.3.83 (2023-10-19)

This is the third 1.0 release candidate that is API and ABI compatible
with previous 0.3.x releases.

Highlights
  - A quantum change regression was fixed.
  - Use a 2 socket server now for the manager and the applications
with (when wireplumber is updated) different permissions.
  - Reduce memory usage a little in audioconvert and use fewer buffers.
  - Some JACK deadlocks were fixed.
  - More bugfixes and improvements.

PipeWire
  - Fix quantum change regression. (#3574)
  - Use a 2 socket server by default. One for the session-manager and one
for applications.
  - Fix a potential use-after-free in node and device cleanup. (#3588)

modules
  - Some hardcoded buffer size limits were removed.
  - Fix ASYNC flag on combined-streams.
  - Add support for on-demand combined-streams using metadata.

SPA
  - alsa-udev will now ignore PCMs with the ACP_IGNORE udev environment
variable. (#3570)
  - The audioadapter now uses at least 2 buffers when the follower is
async.
  - The number of buffers used by plugins was tweaked a little. Most
plugins now only ask 1 buffer.
  - Memory usage in audioconvert was reduced.
  - Fix some unaligned reads and writes and undefined left shifts reported
by ASAN. (#3572)
  - Rework vulkan dependency checking.
  - Don't try to link ALSA devices when prepare fails. This fixes some
crashes.
  - Fix a stall when the allowed codecs are changed in ALSA.
  - Improve ALSA rate control for sources to avoid xruns. (#3584)
  - Try to fix IEC958 TrueHD and DTS playback. (#2284)

Bluetooth
  - Improve fallback SCO mtu when the kernel doesn't tell us.

JACK
  - The fixed buffer size limit was removed.
  - Add an option to make input buffers writable (default true).
  - A potential deadlock was fixed when applications lock the process
function. (#3585)
  - Use a separate thread to dispatch notifications to avoid deadlocks.
(#3585)
  - Potentially fix silent export in ardour in some cases. (#3514)

Older versions:

PipeWire 0.3.82 (2023-10-13)

This is the second 1.0 release candidate that is API and ABI compatible
with previous 0.3.x releases.

Highlights
  - Fix a regression in some devices when the Pro-Audio profile was selected.
Only enable the IRQ based scheduling and device linking in specific
safe cases. (#3556)
  - Improve rate switching. In some cases the graph rate would not switch
correctly. (#2929)
  - Fix regression in alsa wakeups that would cause silence in VMs.
  - Fix a leak in the SBC codecs for SCO.
  - More improvements to the RAOP module.
  - Other small improvements and fixes.

PipeWire
  - Improve client property checks.
  - Allow non-power-of-2 quantums when forced.
  - Improve rate switching. In some cases the graph rate would not switch
correctly. (#2929)
  - The PIPEWIRE_QUANTUM env variable now forces the size and rate in the
graph for the duration of the application. The softer PIPEWIRE_LATENCY
and PIPEWIRE_RATE can still be used to merely suggest a maximum latency
and a rate.

modules
  - Remove the RTSP FLUSH request in RAOP because it does not seem necessary.
  - The RAOP module now uses the common RTP stream functions.
  - Add sockets option to protocol-native to make pipewire listen on multiple
sockets.

SPA
  - Clean up some of the log functions.
  - Add an option in ALSA to disable linking devices together.
  - Only link pcms together when 1 capture and 1 playback pcm. For more complex
devices we can't be sure which ones can be linked. (#3556)
  - disable tsched only when using linked devices.
  - Add some extra checks in ALSA to avoid segfaults. (#3554)
  - Add Tag support to alsa-sink and alsa-source.
  - Use dynamic pod builder when we can.
  - Set priority.driver on midi-bridge to allow it as a fallback driver. (#3562)
  - Fix regression in alsa wakeups. (#3565)
  - The PTP clock can now be found from the interface in node-driver.

pulse-server
  - Some small cleanups and internal improvements.
  - Add some memory debugging messages.
  - Add Tag messages to streams.

Bluetooth
  - Fix a leak in the SBC codecs for SCO.

JACK
  - Patch up midi events in the destination buffer instead of writing to the
source buffer. (#3580)
  - Group all jack clients together to avoid transport issues. (#3562)

ALSA-plugins
  - Add also.deny option to block alsa clients from opening the PCM.

Signed-off-by: Markus Volk 
---
 .../pipewire/{pipewire_0.3.81.bb => pipewire_0.3.83.bb} | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta-multimedia/recipes-multimedia/pipewire/{pipewire_0.3.81.bb => 
pipewire_0.3.83.bb} (99%)

diff --git a/meta-multimedia/recipes-multimedia/pipewire/pipewire_0.3.81.bb 
b/meta-multimedia/recipes-multimedia/pipewire/pipewire_0.3.83.bb
similarity index 99%
rename from meta-multimedia/recipes-multimedia/pipewire/pipewire_0.3.81.bb
rename to meta-multimedia/recipes-multimedia/pipewire/pipewire_0.3.83.bb
index 2a3699f93..2414f1397

Re: [oe] [meta-oe][PATCH] leveldb: Upgrade to 1.23 plus latest git

2023-10-20 Thread Martin Jansa
I've sent a fix for the first part with gtest.

The 2nd part is caused by:
https://github.com/google/leveldb/commit/69061b464ab1da287da9b7ffec1ed911b754403b
which is relatively easy to fix in leveldb-tl:
https://github.com/webOS-ports/meta-webos-ports/commit/ada50397377dbdd471ed66fbcbfa5dbb8e3546d6
but a bit worse in db8:
https://github.com/webOS-ports/meta-webos-ports/commit/b98d9d358914ecfbd7d9857fb7cfb05f6a47c90b
but then 7 other recipes start failing as they are using db8 and use rtti.

Maybe I'm just doing something silly (or too many silly things at the same
time instead of sleep(), lets see tomorrow).

On Fri, Oct 20, 2023 at 2:47 PM Martin Jansa via lists.openembedded.org
 wrote:

> On Tue, Oct 17, 2023 at 7:17 PM Khem Raj  wrote:
>
>> Switch to git submods as it needs gtest and benchmarks checked out at a
>> particular commit
>>
>
> But it probably shouldn't install gtest files as this now causes conflicts
> when leveldb is used in component which itself also depends on gtest e.g.
> leveldb-tl in meta-webosose:
>
> ERROR: lib32-leveldb-tl-0.1.6-r4 do_prepare_recipe_sysroot: The file
> /usr/lib/pkgconfig/gtest.pc is installed by both lib32-googletest and
> lib32-leveldb, aborting
>
> Without gtest enabled in leveldb-tl it fails a bit later:
>  FAILED: mksandwich
> | : &&
> /OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot-native/usr/bin/x86_64-webos-linux/x86_64-webos-linux-g++
> --sysroot=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot
> -m64 -march=nehalem -mtune=generic -mfpmath=sse -msse4.2
>  
> --sysroot=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot
>  -O2 -pipe -g -feliminate-unused-debug-types -fcanon-prefix-map
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot-native=
>  -fvisibility-inlines-hidden -std=c++14 -Wall -Wextra -Wconversion -Werror
>  -m64 -march=nehalem -mtune=generic -mfpmath=sse -msse4.2
>  
> --sysroot=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot
>  -O2 -pipe -g -feliminate-unused-debug-types -fcanon-prefix-map
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot-native=
>  -fvisibility-inlines-hidden -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed
> -fcanon-prefix-map
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
>  
> -fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
>  
> -fmacro-prefix-map=/O

[oe] [meta-oe][PATCH] leveldb: prevent installing gtest

2023-10-20 Thread Martin Jansa
* Causes conflicts when leveldb is used in component which itself also depends
  on gtest e.g. leveldb-tl in meta-webosose:

  ERROR: lib32-leveldb-tl-0.1.6-r4 do_prepare_recipe_sysroot: The file
  /usr/lib/pkgconfig/gtest.pc is installed by both lib32-googletest and
  lib32-leveldb, aborting

Signed-off-by: Martin Jansa 
---
 ...s.txt-fix-googletest-related-options.patch | 55 +++
 meta-oe/recipes-dbs/leveldb/leveldb_1.23.bb   |  4 +-
 2 files changed, 58 insertions(+), 1 deletion(-)
 create mode 100644 
meta-oe/recipes-dbs/leveldb/leveldb/0001-CMakeLists.txt-fix-googletest-related-options.patch

diff --git 
a/meta-oe/recipes-dbs/leveldb/leveldb/0001-CMakeLists.txt-fix-googletest-related-options.patch
 
b/meta-oe/recipes-dbs/leveldb/leveldb/0001-CMakeLists.txt-fix-googletest-related-options.patch
new file mode 100644
index 00..b0bfb8bf16
--- /dev/null
+++ 
b/meta-oe/recipes-dbs/leveldb/leveldb/0001-CMakeLists.txt-fix-googletest-related-options.patch
@@ -0,0 +1,55 @@
+From 77da477840f89da7ced29da315de77571e8f190e Mon Sep 17 00:00:00 2001
+From: Martin Jansa 
+Date: Fri, 20 Oct 2023 22:57:48 +0200
+Subject: [PATCH] CMakeLists.txt: fix googletest related options
+
+* 
https://cmake.org/cmake/help/book/mastering-cmake/chapter/Writing%20CMakeLists%20Files.html
+  says that CMake options are case-sensitive and I don't see lower-case 
version in
+  currently used googletest submodules and gtest is indeed installed with 
leveldb
+
+* install_gmock option I don't see at all, so I've kept it as is, 
INSTALL_GTEST, BUILD_GMOCK
+  do exist as upper-case
+
+$ grep -Ri install_.*mock .
+./CMakeLists.txt:  set(install_gmock OFF)
+./third_party/googletest/googlemock/CMakeLists.txt:install_project(gmock 
gmock_main)
+$ grep -Ri build_gmock .
+./CMakeLists.txt:  set(BUILD_GMOCK ON)
+./third_party/googletest/googletest/README.md:cmake .. -DBUILD_GMOCK=OFF
+./third_party/googletest/CMakeLists.txt:option(BUILD_GMOCK "Builds the 
googlemock subproject" ON)
+./third_party/googletest/CMakeLists.txt:if(BUILD_GMOCK)
+$ grep -Ri install_gtest .
+./CMakeLists.txt:  set(INSTALL_GTEST OFF)
+./third_party/googletest/googletest/cmake/internal_utils.cmake:  
if(INSTALL_GTEST)
+./third_party/googletest/googletest/CMakeLists.txt:if (INSTALL_GTEST)
+./third_party/googletest/CMakeLists.txt:option(INSTALL_GTEST "Enable 
installation of googletest. (Projects embedding googletest may want to turn 
this OFF.)" ON)
+
+* also use CACHE and FORCE as sugested in:
+  https://cmake.org/cmake/help/latest/command/set.html
+  https://stackoverflow.com/questions/20239334/cmake-set-subdirectory-options
+  for the value to correctly propagate into third_party/googletest subdirectory
+
+Signed-off-by: Martin Jansa 
+---
+Upstream-Status: Submitted [https://github.com/google/leveldb/pull/1152]
+
+ CMakeLists.txt | 6 +++---
+ 1 file changed, 3 insertions(+), 3 deletions(-)
+
+diff --git a/CMakeLists.txt b/CMakeLists.txt
+index fda9e01..f8a2629 100644
+--- a/CMakeLists.txt
 b/CMakeLists.txt
+@@ -295,9 +295,9 @@ if(LEVELDB_BUILD_TESTS)
+ 
+   # Prevent overriding the parent project's compiler/linker settings on 
Windows.
+   set(gtest_force_shared_crt ON CACHE BOOL "" FORCE)
+-  set(install_gtest OFF)
+-  set(install_gmock OFF)
+-  set(build_gmock ON)
++  set(INSTALL_GTEST OFF CACHE BOOL "" FORCE)
++  set(install_gmock OFF CACHE BOOL "" FORCE)
++  set(BUILD_GMOCK ON CACHE BOOL "" FORCE)
+ 
+   # This project is tested using GoogleTest.
+   add_subdirectory("third_party/googletest")
diff --git a/meta-oe/recipes-dbs/leveldb/leveldb_1.23.bb 
b/meta-oe/recipes-dbs/leveldb/leveldb_1.23.bb
index 61fa02c154..ab0176ff9b 100644
--- a/meta-oe/recipes-dbs/leveldb/leveldb_1.23.bb
+++ b/meta-oe/recipes-dbs/leveldb/leveldb_1.23.bb
@@ -5,7 +5,9 @@ LICENSE = "BSD-3-Clause"
 LIC_FILES_CHKSUM = "file://LICENSE;md5=92d1b128950b11ba8495b64938fc164d"
 
 SRC_URI = "gitsm://github.com/google/${BPN}.git;branch=main;protocol=https \
-   file://run-ptest"
+file://0001-CMakeLists.txt-fix-googletest-related-options.patch \
+file://run-ptest \
+"
 
 SRCREV = "068d5ee1a3ac40dabd00d211d5013af44be55bea"
 S = "${WORKDIR}/git"
-- 
2.42.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105623): 
https://lists.openembedded.org/g/openembedded-devel/message/105623
Mute This Topic: https://lists.openembedded.org/mt/102093169/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[oe] [meta-python][PATCH] meta-python: Add python3-rapidjson to PTESTS_FAST_META_PYTHON

2023-10-20 Thread Khem Raj
Signed-off-by: Khem Raj 
---
 meta-python/conf/include/ptest-packagelists-meta-python.inc | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta-python/conf/include/ptest-packagelists-meta-python.inc 
b/meta-python/conf/include/ptest-packagelists-meta-python.inc
index 043d4a1358..3272d98192 100644
--- a/meta-python/conf/include/ptest-packagelists-meta-python.inc
+++ b/meta-python/conf/include/ptest-packagelists-meta-python.inc
@@ -35,6 +35,7 @@ PTESTS_FAST_META_PYTHON = "\
 python3-pyserial \
 python3-pytest-mock \
 python3-pytoml \
+python3-rapidjson \
 python3-requests-file \
 python3-requests-toolbelt \
 python3-semver \
-- 
2.42.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105622): 
https://lists.openembedded.org/g/openembedded-devel/message/105622
Mute This Topic: https://lists.openembedded.org/mt/102084633/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe] [meta-oe][PATCH] leveldb: Upgrade to 1.23 plus latest git

2023-10-20 Thread Martin Jansa
On Tue, Oct 17, 2023 at 7:17 PM Khem Raj  wrote:

> Switch to git submods as it needs gtest and benchmarks checked out at a
> particular commit
>

But it probably shouldn't install gtest files as this now causes conflicts
when leveldb is used in component which itself also depends on gtest e.g.
leveldb-tl in meta-webosose:

ERROR: lib32-leveldb-tl-0.1.6-r4 do_prepare_recipe_sysroot: The file
/usr/lib/pkgconfig/gtest.pc is installed by both lib32-googletest and
lib32-leveldb, aborting

Without gtest enabled in leveldb-tl it fails a bit later:
 FAILED: mksandwich
| : &&
/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot-native/usr/bin/x86_64-webos-linux/x86_64-webos-linux-g++
--sysroot=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot
-m64 -march=nehalem -mtune=generic -mfpmath=sse -msse4.2
 
--sysroot=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot
 -O2 -pipe -g -feliminate-unused-debug-types -fcanon-prefix-map
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot-native=
 -fvisibility-inlines-hidden -std=c++14 -Wall -Wextra -Wconversion -Werror
 -m64 -march=nehalem -mtune=generic -mfpmath=sse -msse4.2
 
--sysroot=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot
 -O2 -pipe -g -feliminate-unused-debug-types -fcanon-prefix-map
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot-native=
 -fvisibility-inlines-hidden -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed
-fcanon-prefix-map
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot=
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/recipe-sysroot-native=
 -Wl,-O1 -Wl,--hash-style=gnu -Wl,--as-needed -fcanon-prefix-map
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/git=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fmacro-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leveldb-tl/1.0.6+git/build=/usr/src/debug/leveldb-tl/1.0.6+git-r0
 
-fdebug-prefix-map=/OE/build/luneos-scarthgap/tmp-glibc/work/corei7-64-webos-linux/leve

Re: [oe][meta-networking][kirkstone][PATCH V2 1/3] samba: fix CVE-2023-34966

2023-10-20 Thread Polampalli, Archana via lists.openembedded.org
Reminder!

-Archana

From: openembedded-devel@lists.openembedded.org 
 on behalf of Polampalli, Archana 
via lists.openembedded.org 

Sent: 29 September 2023 23:13
To: openembedded-devel@lists.openembedded.org 

Subject: [oe][meta-networking][kirkstone][PATCH V2 1/3] samba: fix 
CVE-2023-34966

Signed-off-by: Archana Polampalli 
---
 .../samba/samba/CVE-2023-34966_0001.patch |  78 ++
 .../samba/samba/CVE-2023-34966_0002.patch | 140 ++
 .../samba/samba_4.14.14.bb|   2 +
 3 files changed, 220 insertions(+)
 create mode 100644 
meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0001.patch
 create mode 100644 
meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0002.patch

diff --git 
a/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0001.patch 
b/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0001.patch
new file mode 100644
index 0..77a383f09
--- /dev/null
+++ b/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0001.patch
@@ -0,0 +1,78 @@
+From 38664163fcac985d87e4274d198568e0fe88595e Mon Sep 17 00:00:00 2001
+From: Ralph Boehme 
+Date: Fri, 26 May 2023 13:06:19 +0200
+Subject: [PATCH] CVE-2023-34966: mdssvc: harden sl_unpack_loop()
+
+A malicious client could send a packet where subcount is zero, leading to a 
busy
+loop because
+
+count -= subcount
+=>  count -= 0
+=>  while (count > 0)
+
+loops forever.
+
+BUG: https://bugzilla.samba.org/show_bug.cgi?id=15340
+
+Signed-off-by: Ralph Boehme 
+
+Upstream-Status: Backport 
[https://github.com/samba-team/samba/commit/38664163fcac985d87e4274d198568e0fe88595e]
+
+CVE: CVE-2023-34966
+
+Signed-off-by: Archana Polampalli 
+---
+ source3/rpc_server/mdssvc/marshalling.c | 10 +-
+ 1 file changed, 5 insertions(+), 5 deletions(-)
+
+diff --git a/source3/rpc_server/mdssvc/marshalling.c 
b/source3/rpc_server/mdssvc/marshalling.c
+index 9ba6ef571f2..d794ba15838 100644
+--- a/source3/rpc_server/mdssvc/marshalling.c
 b/source3/rpc_server/mdssvc/marshalling.c
+@@ -1119,7 +1119,7 @@ static ssize_t sl_unpack_loop(DALLOC_CTX *query,
+   sl_nil_t nil = 0;
+
+   subcount = tag.count;
+-  if (subcount > count) {
++  if (subcount < 1 || subcount > count) {
+   return -1;
+   }
+   for (i = 0; i < subcount; i++) {
+@@ -1147,7 +1147,7 @@ static ssize_t sl_unpack_loop(DALLOC_CTX *query,
+
+   case SQ_TYPE_INT64:
+   subcount = sl_unpack_ints(query, buf, offset, bufsize, 
encoding);
+-  if (subcount == -1 || subcount > count) {
++  if (subcount < 1 || subcount > count) {
+   return -1;
+   }
+   offset += tag.size;
+@@ -1156,7 +1156,7 @@ static ssize_t sl_unpack_loop(DALLOC_CTX *query,
+
+   case SQ_TYPE_UUID:
+   subcount = sl_unpack_uuid(query, buf, offset, bufsize, 
encoding);
+-  if (subcount == -1 || subcount > count) {
++  if (subcount < 1 || subcount > count) {
+   return -1;
+   }
+   offset += tag.size;
+@@ -1165,7 +1165,7 @@ static ssize_t sl_unpack_loop(DALLOC_CTX *query,
+
+   case SQ_TYPE_FLOAT:
+   subcount = sl_unpack_floats(query, buf, offset, 
bufsize, encoding);
+-  if (subcount == -1 || subcount > count) {
++  if (subcount < 1 || subcount > count) {
+   return -1;
+   }
+   offset += tag.size;
+@@ -1174,7 +1174,7 @@ static ssize_t sl_unpack_loop(DALLOC_CTX *query,
+
+   case SQ_TYPE_DATE:
+   subcount = sl_unpack_date(query, buf, offset, bufsize, 
encoding);
+-  if (subcount == -1 || subcount > count) {
++  if (subcount < 1 || subcount > count) {
+   return -1;
+   }
+   offset += tag.size;
+--
+2.40.0
diff --git 
a/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0002.patch 
b/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0002.patch
new file mode 100644
index 0..a86d1729c
--- /dev/null
+++ b/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34966_0002.patch
@@ -0,0 +1,140 @@
+From 10b6890d26b3c7a829a9e9a05ad1d1ff54daeca9 Mon Sep 17 00:00:00 2001
+From: Ralph Boehme 
+Date: Wed, 31 May 2023 15:34:26 +0200
+Subject: [PATCH] CVE-2023-34966: CI: test for sl_unpack_loop()
+
+Send a maliciously crafted packet where a nil type has a subcount of 0. This
+triggers an endless loop in mdssvc sl_unpack_loop().
+
+BUG: https://bugzilla.samba.org/show_bug.cgi?i

Re: [oe][meta-networking][kirkstone][PATCH V2 3/3] samba:fix CVE-2023-34967

2023-10-20 Thread Polampalli, Archana via lists.openembedded.org
Reminder!

-Archana

From: openembedded-devel@lists.openembedded.org 
 on behalf of Polampalli, Archana 
via lists.openembedded.org 

Sent: 29 September 2023 23:13
To: openembedded-devel@lists.openembedded.org 

Subject: [oe][meta-networking][kirkstone][PATCH V2 3/3] samba:fix CVE-2023-34967

Signed-off-by: Archana Polampalli 
---
 .../samba/samba/CVE-2023-34967_0001.patch | 178 ++
 .../samba/samba/CVE-2023-34967_0002.patch | 125 
 .../samba/samba_4.14.14.bb|   2 +
 3 files changed, 305 insertions(+)
 create mode 100644 
meta-networking/recipes-connectivity/samba/samba/CVE-2023-34967_0001.patch
 create mode 100644 
meta-networking/recipes-connectivity/samba/samba/CVE-2023-34967_0002.patch

diff --git 
a/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34967_0001.patch 
b/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34967_0001.patch
new file mode 100644
index 0..e30e54ab9
--- /dev/null
+++ b/meta-networking/recipes-connectivity/samba/samba/CVE-2023-34967_0001.patch
@@ -0,0 +1,178 @@
+From 3b3c30e2acfb00d04c4013e32343bc277d5b1aa8 Mon Sep 17 00:00:00 2001
+From: Ralph Boehme 
+Date: Wed, 31 May 2023 16:26:14 +0200
+Subject: [PATCH] CVE-2023-34967: CI: add a test for type checking of
+ dalloc_value_for_key()
+
+Sends a maliciously crafted packet where the value in a key/value style
+dictionary for the "scope" key is a simple string object whereas the server
+expects an array. As the server doesn't perform type validation on the value, 
it
+crashes when trying to use the "simple" object as a "complex" one.
+
+BUG: https://bugzilla.samba.org/show_bug.cgi?id=15341
+
+Signed-off-by: Ralph Boehme 
+
+Upstream-Status: Backport 
[https://github.com/samba-team/samba/commit/3b3c30e2acfb00d04c4013e32343bc277d5b1aa8]
+
+CVE: CVE-2023-34967
+
+Signed-off-by: Archana Polampalli 
+---
+ source4/torture/rpc/mdssvc.c | 134 +++
+ 1 file changed, 134 insertions(+)
+
+diff --git a/source4/torture/rpc/mdssvc.c b/source4/torture/rpc/mdssvc.c
+index f5f5939..1dce403 100644
+--- a/source4/torture/rpc/mdssvc.c
 b/source4/torture/rpc/mdssvc.c
+@@ -666,6 +666,136 @@ done:
+   return ok;
+ }
+
++static bool test_sl_dict_type_safety(struct torture_context *tctx,
++   void *data)
++{
++  struct torture_mdsscv_state *state = talloc_get_type_abort(
++  data, struct torture_mdsscv_state);
++  struct dcerpc_binding_handle *b = state->p->binding_handle;
++  struct mdssvc_blob request_blob;
++  struct mdssvc_blob response_blob;
++  uint64_t ctx1 = 0xdeadbeef;
++  uint64_t ctx2 = 0xcafebabe;
++  uint32_t device_id;
++  uint32_t unkn2;
++  uint32_t unkn9;
++  uint32_t fragment;
++  uint32_t flags;
++  DALLOC_CTX *d = NULL;
++  sl_array_t *array1 = NULL, *array2 = NULL;
++  sl_dict_t *arg = NULL;
++  int result;
++  NTSTATUS status;
++  bool ok = true;
++
++  device_id = UINT32_C(0x2f45);
++  unkn2 = 23;
++  unkn9 = 0;
++  fragment = 0;
++  flags = UINT32_C(0x6b01);
++
++  d = dalloc_new(tctx);
++  torture_assert_not_null_goto(tctx, d,
++   ok, done, "dalloc_new failed\n");
++
++  array1 = dalloc_zero(d, sl_array_t);
++  torture_assert_not_null_goto(tctx, array1,
++   ok, done, "dalloc_zero failed\n");
++
++  array2 = dalloc_zero(d, sl_array_t);
++  torture_assert_not_null_goto(tctx, array2,
++   ok, done, "dalloc_new failed\n");
++
++  result = dalloc_stradd(array2, "openQueryWithParams:forContext:");
++  torture_assert_goto(tctx, result == 0,
++  ok, done, "dalloc_stradd failed\n");
++
++  result = dalloc_add_copy(array2, &ctx1, uint64_t);
++  torture_assert_goto(tctx, result == 0,
++  ok, done, "dalloc_stradd failed\n");
++
++  result = dalloc_add_copy(array2, &ctx2, uint64_t);
++  torture_assert_goto(tctx, result == 0,
++  ok, done, "dalloc_stradd failed\n");
++
++  arg = dalloc_zero(array1, sl_dict_t);
++  torture_assert_not_null_goto(tctx, d,
++   ok, done, "dalloc_zero failed\n");
++
++  result = dalloc_stradd(arg, "kMDQueryString");
++  torture_assert_goto(tctx, result == 0,
++  ok, done, "dalloc_stradd failed\n");
++
++  result = dalloc_stradd(arg, "*");
++  torture_assert_goto(tctx, result == 0,
++  ok, done, "dalloc_stradd failed\n");
++
++  result = dalloc_stradd(arg, "kMDScopeArray");
++  torture_assert_goto(tctx, result == 0,
++  ok, done, "dalloc_stradd failed\n");
++
++  result = dalloc_stradd(arg, "");
++  torture_assert_goto(tctx, result == 0,
++  ok, d

Re: [oe][meta-networking][kirkstone][PATCH V2 2/3] samba: fix CVE-2022-2127

2023-10-20 Thread Polampalli, Archana via lists.openembedded.org
Reminder!

-Archana

From: openembedded-devel@lists.openembedded.org 
 on behalf of Polampalli, Archana 
via lists.openembedded.org 

Sent: 29 September 2023 23:13
To: openembedded-devel@lists.openembedded.org 

Subject: [oe][meta-networking][kirkstone][PATCH V2 2/3] samba: fix CVE-2022-2127

Signed-off-by: Archana Polampalli 
---
 .../samba/samba/CVE-2022-2127.patch   | 44 +++
 .../samba/samba_4.14.14.bb|  1 +
 2 files changed, 45 insertions(+)
 create mode 100644 
meta-networking/recipes-connectivity/samba/samba/CVE-2022-2127.patch

diff --git 
a/meta-networking/recipes-connectivity/samba/samba/CVE-2022-2127.patch 
b/meta-networking/recipes-connectivity/samba/samba/CVE-2022-2127.patch
new file mode 100644
index 0..e94d5d538
--- /dev/null
+++ b/meta-networking/recipes-connectivity/samba/samba/CVE-2022-2127.patch
@@ -0,0 +1,44 @@
+From 53838682570135b753fa622dfcde111528563c2d Mon Sep 17 00:00:00 2001
+From: Ralph Boehme 
+Date: Fri, 16 Jun 2023 12:28:47 +0200
+Subject: [PATCH] CVE-2022-2127: ntlm_auth: cap lanman response length value
+
+We already copy at most sizeof(request.data.auth_crap.lm_resp) bytes to the
+lm_resp buffer, but we don't cap the length indicator.
+
+BUG: https://bugzilla.samba.org/show_bug.cgi?id=15072
+
+Signed-off-by: Ralph Boehme 
+
+CVE: CVE-2022-2127
+
+Upstream-Status: Backport 
[https://github.com/samba-team/samba/commit/53838682570135b753fa622dfcde111528563c2d]
+
+Signed-off-by: Archana Polampalli 
+---
+ source3/utils/ntlm_auth.c | 8 ++--
+ 1 file changed, 6 insertions(+), 2 deletions(-)
+
+diff --git a/source3/utils/ntlm_auth.c b/source3/utils/ntlm_auth.c
+index 02a2379..c82ea45 100644
+--- a/source3/utils/ntlm_auth.c
 b/source3/utils/ntlm_auth.c
+@@ -574,10 +574,14 @@ NTSTATUS contact_winbind_auth_crap(const char *username,
+   memcpy(request.data.auth_crap.chal, challenge->data, 
MIN(challenge->length, 8));
+
+   if (lm_response && lm_response->length) {
++  size_t capped_lm_response_len = MIN(
++  lm_response->length,
++  sizeof(request.data.auth_crap.lm_resp));
++
+   memcpy(request.data.auth_crap.lm_resp,
+  lm_response->data,
+- MIN(lm_response->length, 
sizeof(request.data.auth_crap.lm_resp)));
+-  request.data.auth_crap.lm_resp_len = lm_response->length;
++ capped_lm_response_len);
++  request.data.auth_crap.lm_resp_len = capped_lm_response_len;
+   }
+
+   if (nt_response && nt_response->length) {
+--
+2.40.0
diff --git a/meta-networking/recipes-connectivity/samba/samba_4.14.14.bb 
b/meta-networking/recipes-connectivity/samba/samba_4.14.14.bb
index 11b6ade40..b71c4b3fc 100644
--- a/meta-networking/recipes-connectivity/samba/samba_4.14.14.bb
+++ b/meta-networking/recipes-connectivity/samba/samba_4.14.14.bb
@@ -35,6 +35,7 @@ SRC_URI = "${SAMBA_MIRROR}/stable/samba-${PV}.tar.gz \
file://CVE-2021-44758.patch;patchdir=source4/heimdal \
file://CVE-2023-34966_0001.patch \
file://CVE-2023-34966_0002.patch \
+   file://CVE-2022-2127.patch \
"

 SRC_URI:append:libc-musl = " \
--
2.40.0


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105617): 
https://lists.openembedded.org/g/openembedded-devel/message/105617
Mute This Topic: https://lists.openembedded.org/mt/102077422/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe] [OE-core] Detecting unimplemented ptests with heuristics

2023-10-20 Thread Yoann Congal
On 10/19/23 17:21, Michael Opdenacker wrote:
> Hi Yoann

Hi,
 
> On 19.10.23 at 10:00, Yoann Congal wrote:
>> Hi everyone,
>>
>> We recently implemented a way to detect recipes for upstream code that 
>> contain unit tests but does not implement ptests.
>> Those recipes make good candidates for increasing the ptests coverage.
>>
>> This is implemented as a QA check. The check is disabled by default since it 
>> generates a lot of warning at build.
>> In order to activate it (in local.conf for exemple) :
>> WARN_QA += "unimplemented-ptest"
>>
>> The warnings looks like:
>> WARNING: time-1.9-r0 do_patch: QA Issue: time: autotools-based tests 
>> detected [unimplemented-ptest]
>>   I've generated the list for the unimplemented ptests for oe-core and for 
>> meta-openembedded:
>>    329 unimplemented-ptests_oe-core.log: 
>> https://gist.github.com/ycongal-smile/dd51b0e450a8f0083e9d5cc10eeeb060#file-unimplemented-ptests_oe-core-log
>>   1080 unimplemented-ptests_meta-openembedded.log: 
>> https://gist.github.com/ycongal-smile/dd51b0e450a8f0083e9d5cc10eeeb060#file-unimplemented-ptests_meta-openembedded-log
> 
> Thanks, indeed, I "own" recipes that were flagged :)
> Maybe, you could find a way to notify the maintainers of such recipes, as in 
> the AUH upgrade status reports 
> (https://lists.openembedded.org/g/openembedded-core/message/188589 for 
> example).

Good idea, Thanks!

I've created a bug to not forget : 
15249 – Notify the maintainers of unimplemented ptests
https://bugzilla.yoctoproject.org/show_bug.cgi?id=15249
I've CC'd you :)

Regards,
-- 
Yoann Congal
Smile ECS - Tech Expert

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105616): 
https://lists.openembedded.org/g/openembedded-devel/message/105616
Mute This Topic: https://lists.openembedded.org/mt/102062196/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[oe] [meta-python][PATCH] python3-rapidjson: add missing ptest dependency

2023-10-20 Thread David Pierret
add the pytz module dependency.

Signed-off-by: David Pierret 
Reviewed-by: Yoann Congal 
---
 meta-python/recipes-devtools/python/python3-rapidjson_1.11.bb | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta-python/recipes-devtools/python/python3-rapidjson_1.11.bb 
b/meta-python/recipes-devtools/python/python3-rapidjson_1.11.bb
index 3ea559488..74e46ca5f 100644
--- a/meta-python/recipes-devtools/python/python3-rapidjson_1.11.bb
+++ b/meta-python/recipes-devtools/python/python3-rapidjson_1.11.bb
@@ -27,6 +27,7 @@ DEPENDS += " \
 RDEPENDS:${PN}-ptest += " \
 ${PYTHON_PN}-pytest \
 ${PYTHON_PN}-unittest-automake-output \
+${PYTHON_PN}-pytz \
 "
 
 RDEPENDS:${PN} += " \
-- 
2.39.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105615): 
https://lists.openembedded.org/g/openembedded-devel/message/105615
Mute This Topic: https://lists.openembedded.org/mt/102077163/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



[oe] [meta-oe][PATCH] paho-mqtt-c: upgrade 1.3.12 -> 1.3.13

2023-10-20 Thread Matthias Klein
Service release.
Issues resolved:
https://github.com/eclipse/paho.mqtt.c/milestone/20?closed=1

Signed-off-by: Matthias Klein 
---
 .../{paho-mqtt-c_1.3.12.bb => paho-mqtt-c_1.3.13.bb}| 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
 rename meta-oe/recipes-connectivity/paho-mqtt-c/{paho-mqtt-c_1.3.12.bb => 
paho-mqtt-c_1.3.13.bb} (95%)

diff --git a/meta-oe/recipes-connectivity/paho-mqtt-c/paho-mqtt-c_1.3.12.bb 
b/meta-oe/recipes-connectivity/paho-mqtt-c/paho-mqtt-c_1.3.13.bb
similarity index 95%
rename from meta-oe/recipes-connectivity/paho-mqtt-c/paho-mqtt-c_1.3.12.bb
rename to meta-oe/recipes-connectivity/paho-mqtt-c/paho-mqtt-c_1.3.13.bb
index 4decb098c..6f229001f 100644
--- a/meta-oe/recipes-connectivity/paho-mqtt-c/paho-mqtt-c_1.3.12.bb
+++ b/meta-oe/recipes-connectivity/paho-mqtt-c/paho-mqtt-c_1.3.13.bb
@@ -12,7 +12,7 @@ LIC_FILES_CHKSUM = " \
 
 SRC_URI = "git://github.com/eclipse/paho.mqtt.c;protocol=https;branch=master"
 
-SRCREV = "4157a27d39f1dd5b95750ecb6acd1481432785d8"
+SRCREV = "07a875788d8cc6f5833b12581d6e3e349b34d719"
 
 DEPENDS = "openssl"
 
-- 
2.39.2


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105614): 
https://lists.openembedded.org/g/openembedded-devel/message/105614
Mute This Topic: https://lists.openembedded.org/mt/102076909/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe] [PATCH] Revert "protobuf: stage protoc binary to sysroot"

2023-10-20 Thread Martin Jansa
do_prepare_recipe_sysroot doesn't install any packages to RSS. Only package
manager on target or in do_rootfs uses packages.

It installs the files from dependency populate_sysroot task.

On Fri, Oct 20, 2023 at 9:11 AM Samuli Piippo 
wrote:

> Dependency to the recipe name will always install all packages to RSS.
> You can verify this by checking that the libprotoc.so from the
> nativesdk-protobuf-compile package is in the sysroot.
> The problem you are facing is the fact that binaries are not installed
> into the sysroot (for nativesdk builds), so you are only missing the
> bin/protoc-23.4.0 file.
> The proposed and twice reverted fix for this is the aforementioned
> SYSROOT_DIRS.
>
> -samuli
>
> On Fri, 20 Oct 2023 at 09:17, Vyacheslav Yurkov 
> wrote:
>
>> I think the problem goes down to how dependencies are populated in the
>> sysroot. I raised this question in oe-core mailing list
>> https://lists.openembedded.org/g/openembedded-core/message/189324 , but
>> didn't get an answer yet.
>>
>> DEPENDS += "protobuf" will only install the main package of protobuf to
>> the sysroot, because it assumes that nativesdk-protobuf-compiler is also
>> part of the main package (which is not). I guess the part of the system
>> populating sysroot deals with recipes only, and not with packages. I'm
>> still trying to understand how that should be addressed properly.
>> My understanding is that either all packages should be installed to
>> sysroot (which recipe claims it provides), or we need a way to indicate a
>> package level dependency (i.e. nativesdk-protobuf-compiler in this case)
>>
>> Any ideas?
>>
>> Slava
>>
>> On 18.10.2023 14:28, Samuli Piippo wrote:
>>
>> Following simple test recipe will fail now when trying to use Protobuf
>> with CMake.
>>
>> inherit cmake
>> DEPENDS += "protobuf"
>>
>> do_configure:prepend() {
>> echo "find_package(Protobuf CONFIG)" > ${S}/CMakeLists.txt
>> }
>>
>> BBCLASSEXTEND = "nativesdk"
>>
>> ---
>> CMake Error at
>> tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-test/1.0/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/lib/cmake/protobuf/protobuf-targets.cmake:107
>> (message):
>>   The imported target "protobuf::protoc" references the file
>>
>>
>>  
>> "tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-test/1.0/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/bin/protoc-23.4.0"
>>
>>   but this file does not exist.
>> ---
>>
>> I don't quite see why every project/recipe should fix this independently
>> when the simple workaround for this yocto-specific issue is available
>> (namely the use of SYSROOT_DIRS).
>>
>> -samuli
>>
>> ps. qtgrpc recipe and other Qt6 recipes are now visible in the layerindex
>> https://layers.openembedded.org/layerindex/recipe/348210/
>>
>>
>> On Thu, 12 Oct 2023 at 15:06, Vyacheslav Yurkov 
>> wrote:
>>
>>> I'd like to follow-up on this and say that I see this issue now with
>>> nativesdk build, in particular nativesdk-grpc recipe fails in master with
>>> the same error. I hope that's partially related to the issue everybody is
>>> confused about, but I'd like understand how to properly fix it.
>>>
>>> |   The imported target "protobuf::protoc" references the file
>>> |
>>> |
>>> "/home/uvv/projects/poky/build/tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-grpc/1.56.2/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/bin/protoc-23.4.0"
>>> |
>>> |   but this file does not exist.  Possible reasons include:
>>> |
>>> |   * The file was deleted, renamed, or moved to another location.
>>>
>>> The protoc-23.4.0 file already exists in the recipe-sysroot-native.
>>>
>>> And we do want protoc to be present in the SDK, but nativesdk build is a
>>> cross-compilation, because SDKMACHINE and HOST might be different.
>>> In this particular grpc case there's an option to say where the actual
>>> protoc executable is (
>>> -D_gRPC_PROTOBUF_PROTOC_EXECUTABLE=/home/uvv/projects/poky/build/tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-grpc/1.56.2/recipe-sysroot-native/usr/bin/protoc
>>> is passed to grpc).
>>>
>>> So there shouldn't be any issues here, but nativesdk build still fails.
>>>
>>> Looking into it further I see that protoc is actually packaged by
>>> protobuf-compiler package, but when I try to add a package dependency to
>>> grpc recipe I get this:
>>>
>>> nativesdk-protobuf RPROVIDES nativesdk-protobuf-compiler
>>>
>>> Moreover, if I go into devshell and forcefully install
>>> nativesdk-libprotobuf-compiler, then `bitbake nativesdk-grpc` is happy and
>>> compiles!
>>>
>>> So something wrong with the dependencies in protobuf recipe, but I can't
>>> figure out yet what exactly. Any ideas?
>>>
>>> Regards,
>>> Slava
>>>
>>>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105613): 
https://lists.openembedded.org/g/openembedded-devel/message/105613
Mute This Topic: https://lists.openembedded

Re: [oe] [PATCH] Revert "protobuf: stage protoc binary to sysroot"

2023-10-20 Thread Samuli Piippo
Dependency to the recipe name will always install all packages to RSS.
You can verify this by checking that the libprotoc.so from the
nativesdk-protobuf-compile package is in the sysroot.
The problem you are facing is the fact that binaries are not installed into
the sysroot (for nativesdk builds), so you are only missing the
bin/protoc-23.4.0 file.
The proposed and twice reverted fix for this is the aforementioned
SYSROOT_DIRS.

-samuli

On Fri, 20 Oct 2023 at 09:17, Vyacheslav Yurkov  wrote:

> I think the problem goes down to how dependencies are populated in the
> sysroot. I raised this question in oe-core mailing list
> https://lists.openembedded.org/g/openembedded-core/message/189324 , but
> didn't get an answer yet.
>
> DEPENDS += "protobuf" will only install the main package of protobuf to
> the sysroot, because it assumes that nativesdk-protobuf-compiler is also
> part of the main package (which is not). I guess the part of the system
> populating sysroot deals with recipes only, and not with packages. I'm
> still trying to understand how that should be addressed properly.
> My understanding is that either all packages should be installed to
> sysroot (which recipe claims it provides), or we need a way to indicate a
> package level dependency (i.e. nativesdk-protobuf-compiler in this case)
>
> Any ideas?
>
> Slava
>
> On 18.10.2023 14:28, Samuli Piippo wrote:
>
> Following simple test recipe will fail now when trying to use Protobuf
> with CMake.
>
> inherit cmake
> DEPENDS += "protobuf"
>
> do_configure:prepend() {
> echo "find_package(Protobuf CONFIG)" > ${S}/CMakeLists.txt
> }
>
> BBCLASSEXTEND = "nativesdk"
>
> ---
> CMake Error at
> tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-test/1.0/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/lib/cmake/protobuf/protobuf-targets.cmake:107
> (message):
>   The imported target "protobuf::protoc" references the file
>
>
>  
> "tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-test/1.0/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/bin/protoc-23.4.0"
>
>   but this file does not exist.
> ---
>
> I don't quite see why every project/recipe should fix this independently
> when the simple workaround for this yocto-specific issue is available
> (namely the use of SYSROOT_DIRS).
>
> -samuli
>
> ps. qtgrpc recipe and other Qt6 recipes are now visible in the layerindex
> https://layers.openembedded.org/layerindex/recipe/348210/
>
>
> On Thu, 12 Oct 2023 at 15:06, Vyacheslav Yurkov 
> wrote:
>
>> I'd like to follow-up on this and say that I see this issue now with
>> nativesdk build, in particular nativesdk-grpc recipe fails in master with
>> the same error. I hope that's partially related to the issue everybody is
>> confused about, but I'd like understand how to properly fix it.
>>
>> |   The imported target "protobuf::protoc" references the file
>> |
>> |
>> "/home/uvv/projects/poky/build/tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-grpc/1.56.2/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/bin/protoc-23.4.0"
>> |
>> |   but this file does not exist.  Possible reasons include:
>> |
>> |   * The file was deleted, renamed, or moved to another location.
>>
>> The protoc-23.4.0 file already exists in the recipe-sysroot-native.
>>
>> And we do want protoc to be present in the SDK, but nativesdk build is a
>> cross-compilation, because SDKMACHINE and HOST might be different.
>> In this particular grpc case there's an option to say where the actual
>> protoc executable is (
>> -D_gRPC_PROTOBUF_PROTOC_EXECUTABLE=/home/uvv/projects/poky/build/tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-grpc/1.56.2/recipe-sysroot-native/usr/bin/protoc
>> is passed to grpc).
>>
>> So there shouldn't be any issues here, but nativesdk build still fails.
>>
>> Looking into it further I see that protoc is actually packaged by
>> protobuf-compiler package, but when I try to add a package dependency to
>> grpc recipe I get this:
>>
>> nativesdk-protobuf RPROVIDES nativesdk-protobuf-compiler
>>
>> Moreover, if I go into devshell and forcefully install
>> nativesdk-libprotobuf-compiler, then `bitbake nativesdk-grpc` is happy and
>> compiles!
>>
>> So something wrong with the dependencies in protobuf recipe, but I can't
>> figure out yet what exactly. Any ideas?
>>
>> Regards,
>> Slava
>>
>>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105612): 
https://lists.openembedded.org/g/openembedded-devel/message/105612
Mute This Topic: https://lists.openembedded.org/mt/101679410/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-



Re: [oe] [PATCH] Revert "protobuf: stage protoc binary to sysroot"

2023-10-20 Thread Martin Jansa
No, it installs whatever recipe stages in do_populate_sysroot which is
controlled by SYSROOT_DIRS, so the solution still makes sense to me as
explained before and IMHO is better than the alternatives (changing the
protobuf .cmake files to be different in sysroot and in PN-dev).

On Fri, Oct 20, 2023 at 8:17 AM Vyacheslav Yurkov 
wrote:

> I think the problem goes down to how dependencies are populated in the
> sysroot. I raised this question in oe-core mailing list
> https://lists.openembedded.org/g/openembedded-core/message/189324 , but
> didn't get an answer yet.
>
> DEPENDS += "protobuf" will only install the main package of protobuf to
> the sysroot, because it assumes that nativesdk-protobuf-compiler is also
> part of the main package (which is not). I guess the part of the system
> populating sysroot deals with recipes only, and not with packages. I'm
> still trying to understand how that should be addressed properly.
> My understanding is that either all packages should be installed to
> sysroot (which recipe claims it provides), or we need a way to indicate a
> package level dependency (i.e. nativesdk-protobuf-compiler in this case)
>
> Any ideas?
>
> Slava
>
> On 18.10.2023 14:28, Samuli Piippo wrote:
>
> Following simple test recipe will fail now when trying to use Protobuf
> with CMake.
>
> inherit cmake
> DEPENDS += "protobuf"
>
> do_configure:prepend() {
> echo "find_package(Protobuf CONFIG)" > ${S}/CMakeLists.txt
> }
>
> BBCLASSEXTEND = "nativesdk"
>
> ---
> CMake Error at
> tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-test/1.0/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/lib/cmake/protobuf/protobuf-targets.cmake:107
> (message):
>   The imported target "protobuf::protoc" references the file
>
>
>  
> "tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-test/1.0/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/bin/protoc-23.4.0"
>
>   but this file does not exist.
> ---
>
> I don't quite see why every project/recipe should fix this independently
> when the simple workaround for this yocto-specific issue is available
> (namely the use of SYSROOT_DIRS).
>
> -samuli
>
> ps. qtgrpc recipe and other Qt6 recipes are now visible in the layerindex
> https://layers.openembedded.org/layerindex/recipe/348210/
>
>
> On Thu, 12 Oct 2023 at 15:06, Vyacheslav Yurkov 
> wrote:
>
>> I'd like to follow-up on this and say that I see this issue now with
>> nativesdk build, in particular nativesdk-grpc recipe fails in master with
>> the same error. I hope that's partially related to the issue everybody is
>> confused about, but I'd like understand how to properly fix it.
>>
>> |   The imported target "protobuf::protoc" references the file
>> |
>> |
>> "/home/uvv/projects/poky/build/tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-grpc/1.56.2/recipe-sysroot/usr/local/oe-sdk-hardcoded-buildpath/sysroots/x86_64-pokysdk-linux/usr/bin/protoc-23.4.0"
>> |
>> |   but this file does not exist.  Possible reasons include:
>> |
>> |   * The file was deleted, renamed, or moved to another location.
>>
>> The protoc-23.4.0 file already exists in the recipe-sysroot-native.
>>
>> And we do want protoc to be present in the SDK, but nativesdk build is a
>> cross-compilation, because SDKMACHINE and HOST might be different.
>> In this particular grpc case there's an option to say where the actual
>> protoc executable is (
>> -D_gRPC_PROTOBUF_PROTOC_EXECUTABLE=/home/uvv/projects/poky/build/tmp/work/x86_64-nativesdk-pokysdk-linux/nativesdk-grpc/1.56.2/recipe-sysroot-native/usr/bin/protoc
>> is passed to grpc).
>>
>> So there shouldn't be any issues here, but nativesdk build still fails.
>>
>> Looking into it further I see that protoc is actually packaged by
>> protobuf-compiler package, but when I try to add a package dependency to
>> grpc recipe I get this:
>>
>> nativesdk-protobuf RPROVIDES nativesdk-protobuf-compiler
>>
>> Moreover, if I go into devshell and forcefully install
>> nativesdk-libprotobuf-compiler, then `bitbake nativesdk-grpc` is happy and
>> compiles!
>>
>> So something wrong with the dependencies in protobuf recipe, but I can't
>> figure out yet what exactly. Any ideas?
>>
>> Regards,
>> Slava
>>
>>

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#105611): 
https://lists.openembedded.org/g/openembedded-devel/message/105611
Mute This Topic: https://lists.openembedded.org/mt/101679410/21656
Group Owner: openembedded-devel+ow...@lists.openembedded.org
Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-