[OE-core] [PATCH v2 16/20] python3: support profile optimized build

2017-05-16 Thread Markus Lehtonen
ata can be obtainen e.g. by running bitbake python-pgo-image -c profile3. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/python/python3_3.5.2.bb | 20 1 file changed, 20 insertions(+) diff --git a/meta/recipes-devtools/python/python3_3.5.2.bb b/me

[OE-core] [PATCH v2 15/20] python3: remove two setup.py cross-compile hacks

2017-05-16 Thread Markus Lehtonen
es when running "gcc -E -v". The second hack becomes useless after the first hack has been removed and we get the standard include and lib directories normally from gcc. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- .../python3-setup.py-no-host-h

[OE-core] [PATCH v2 09/20] python-pgo-image: switch python default profile task to pybench

2017-05-16 Thread Markus Lehtonen
Switch to pybench in order to reduce the time taken by profiling. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/images/python-pgo-image.bb | 18 ++ 1 file changed, 10 insertions(+), 8 deletions(-) diff --git a/meta/recipes-devtools/images/python-pgo

[OE-core] [PATCH v2 20/20] python-pgo-image: change python3 profile target to pybench

2017-05-16 Thread Markus Lehtonen
Running test.regrtest was still taking ridiculously long, i.e. around 4 hours in qemux86 on my desktop machine. Change to pybench which "only" takes around 55 minutes. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/images/python-pgo-image.bb | 11 ++---

[OE-core] [PATCH v2 10/20] python-pgo-image: enable sstate for do_profile

2017-05-16 Thread Markus Lehtonen
tbake python-pgo-image -c clean" (or otherwise wipe pre-existing profile data) before running "bitbake python-pgo-image -c profile". [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/images/python-pgo-image.bb | 15 +-- 1 file changed, 13 insert

[OE-core] [PATCH v2 12/20] python3: fix depends of python-tests

2017-05-16 Thread Markus Lehtonen
Similar to an earlier fix for Python 2.7. Make the tests subpackage depend on all modules as test.regrtest uses most (if not all) of them. Some tests also depend on libgcc so add that as a runtime dependency as well. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools

[OE-core] [PATCH v2 13/20] python3: add python-profile-opt3 recipe

2017-05-16 Thread Markus Lehtonen
3. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/python/python-profile-opt3 | 1 + .../python/python-profile-opt3_3.5.2.bb| 15 +++ ...efile-add-install_generate_profile-target.patch | 25 + ...name-libpython3-to-libpython-profile-opt3.p

Re: [OE-core] [PATCH v2 00/20] support profile-optimized build for Python

2017-05-16 Thread Markus Lehtonen
On 16/05/2017, 16.23, "Alexander Kanavin" wrote: On 05/16/2017 04:18 PM, Markus Lehtonen wrote: > This patchset makes it possible to make a PGO (profile-guided-optimization) > build of python. This version of the patchset is almost identical to v1 > submitt

Re: [OE-core] [PATCH v2 00/20] support profile-optimized build for Python

2017-05-16 Thread Markus Lehtonen
On 16/05/2017, 16.45, "Richard Purdie" wrote: On Tue, 2017-05-16 at 16:18 +0300, Markus Lehtonen wrote: > This patchset makes it possible to make a PGO (profile-guided- > optimization) build of python. This version of the patchset is almost > identical to v

[OE-core] [PATCH v3 2/8] python3: fix depends of python3-tests

2017-05-18 Thread Markus Lehtonen
Similar to an earlier fix for Python 2.7. Make the tests subpackage depend on all modules as test.regrtest uses most (if not all) of them. Some tests also depend on libgcc so add that as a runtime dependency as well. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools

[OE-core] [PATCH v3 7/8] python3: add python3-tools subpackage

2017-05-18 Thread Markus Lehtonen
Useful in developing Python, e.g. in benchmarking. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/python/python-3.5-manifest.inc | 8 +--- meta/recipes-devtools/python/python3_3.5.2.bb| 5 + 2 files changed, 10 insertions(+), 3 deletions(-) diff --git a

[OE-core] [PATCH v3 5/8] python3: support profile optimized build

2017-05-18 Thread Markus Lehtonen
specify PYTHON3_PROFILE_OPT = "1" in your local.conf, and, have profile data available in the location pointed to by PYTHON3_PROFILE_DIR. Profile data can be obtainen e.g. by running bitbake python-pgo-image -c profile3. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipe

[OE-core] [PATCH v3 3/8] python3: add python3-profile-opt recipe

2017-05-18 Thread Markus Lehtonen
the target hardware. This patch enables the first step, i.e. building python with profile instrumentation enabled [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/python/python3-profile-opt | 1 + .../python/python3-profile-opt_3.5.2.bb| 12 +++

[OE-core] [PATCH v3 8/8] python3: remove two setup.py cross-compile hacks

2017-05-18 Thread Markus Lehtonen
es when running "gcc -E -v". The second hack becomes useless after the first hack has been removed and we get the standard include and lib directories normally from gcc. Signed-off-by: Markus Lehtonen --- .../python/python3-profile-opt_3.5.2.bb| 3 ++ .../python3

[OE-core] [PATCH v3 1/8] python3-native: support profile optimized build

2017-05-18 Thread Markus Lehtonen
.conf, e.g. PYTHON3_NATIVE_PROFILE_TASK = "${S}/Tools/pybench/pybench.py -n 2 --with-gc --with-syscheck" [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/python/python3-native_3.5.2.bb | 9 + meta/recipes-devtools/python/python3/000-cross-compile.patch | 9 -

[OE-core] [PATCH v3 4/8] devtools/images: add python-pgo-image

2017-05-18 Thread Markus Lehtonen
specified with PYTHON3_PROFILE_TASK. The default profile task is pybench, although an example for using test.regrtest is included in the recipe. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/images/python-pgo-image.bb | 85 1 file changed, 85

[OE-core] [PATCH v3 0/8] support profile-optimized build for Python

2017-05-18 Thread Markus Lehtonen
changes since commit 138f3e3f81d866e8272b01dd88c164b367adc4cd: byacc: remove the recipe (2017-05-16 14:08:19 +0100) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/fixes-9338 http://cgit.openembedded.org/openembedded-core-contrib/log/?h=marquiz/fixes-9338

[OE-core] [PATCH v3 6/8] python3: fix profile-optimized build of modules

2017-05-18 Thread Markus Lehtonen
Without this the pgo-related compiler flags are not used in cross-builds. [YOCTO #9338] Signed-off-by: Markus Lehtonen --- ...-CFLAGS-for-extensions-when-cross-compili.patch | 56 ++ meta/recipes-devtools/python/python3_3.5.2.bb | 1 + 2 files changed, 57 insertions

[OE-core] [PATCH 2/2] build-perf-test.sh: add eSDK testing

2016-01-21 Thread Markus Lehtonen
examining the results. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test.sh | 24 1 file changed, 24 insertions(+) diff --git a/scripts/contrib/build-perf-test.sh b/scripts/contrib/build-perf-test.sh index 105b54b..f1f44d3 100755 --- a/scripts/contrib

[OE-core] [PATCH 1/2] build-perf-test.sh: more generic timing function

2016-01-21 Thread Markus Lehtonen
Make it possible to time also other than bitbake commands. The name of the log file is changed from bitbake.log to commands.log. Signed-off-by: Markus Lehtonen --- scripts/contrib/build-perf-test.sh | 17 ++--- 1 file changed, 10 insertions(+), 7 deletions(-) diff --git a/scripts

Re: [OE-core] [PATCH 3/3] oe.gpg_sign: support obs-signd

2016-01-22 Thread Markus Lehtonen
Hi Mark, (CC'd the mailing list which was accidentally dropped from my previous email) On 21/01/16 17:21, "Mark Hatle" wrote: >On 1/21/16 5:20 AM, Markus Lehtonen wrote: >> On Wed, 2016-01-13 at 12:28 +0200, Markus Lehtonen wrote: >>> On Tue, 2016-01-12 at 1

[OE-core] [PATCH v2] New lib module for signing

2016-01-25 Thread Markus Lehtonen
slightly modified. Markus Lehtonen (1): New lib module for handling GPG signing meta/classes/sign_package_feed.bbclass | 6 +++ meta/classes/sign_rpm.bbclass | 47 + meta/lib/oe/gpg_sign.py| 76 ++ meta/lib/oe

[OE-core] [PATCH v2] New lib module for handling GPG signing

2016-01-25 Thread Markus Lehtonen
signing). Currently, only local signing with gpg is implemented. [YOCTO #8755] Signed-off-by: Markus Lehtonen --- meta/classes/sign_package_feed.bbclass | 6 +++ meta/classes/sign_rpm.bbclass | 47 + meta/lib/oe/gpg_sign.py| 76

[OE-core] [PATCH 1/2] externalsrc.bbclas: remove nostamp from do_configure

2016-01-26 Thread Markus Lehtonen
mpilations happen. During the first bitbake run preparing of the task runqueue may take much longer because all the files in the source tree are hashed. Subsequent builds are not significantly slower because (most) file hashes are found from the cache. [YOCTO #8853] Signed-off-by: Mark

[OE-core] [PATCH 0/2] Improve externalsrc task dependency tracking

2016-01-26 Thread Markus Lehtonen
epository at: git://git.openembedded.org/openembedded-core-contrib marquiz/devtool/fixes Markus Lehtonen (2): externalsrc.bbclas: remove nostamp from do_configure devtool: create-workspace: define separate cache for task file checksums meta/classes/externalsrc.bbclass | 3 +-- scripts/devtool

[OE-core] [PATCH 2/2] devtool: create-workspace: define separate cache for task file checksums

2016-01-26 Thread Markus Lehtonen
the fetcher local file checksum cache. Also, this new devtool-specific cache is not used after the workspace layer is disabled. [YOCTO #8853] Signed-off-by: Markus Lehtonen --- scripts/devtool | 1 + 1 file changed, 1 insertion(+) diff --git a/scripts/devtool b/scripts/devtool index 2d57da0

[OE-core] [PATCH] buildhistory: fix the check for existence of a git repo

2016-01-27 Thread Markus Lehtonen
on which was causing unwanted behavior. This patch changes buildhistory.bbclass to check for any file named '.git' which fixes these problems. [YOCTO #8911] Signed-off-by: Markus Lehtonen --- meta/classes/buildhistory.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion

[OE-core] [PATCH] autotools.bbclass: use oe_runmake instead of ${MAKE}

2016-01-29 Thread Markus Lehtonen
Use oe_runmake like in base.bbclass so that EXTRA_OEMAKE will be respected. Signed-off-by: Markus Lehtonen --- meta/classes/autotools.bbclass | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/meta/classes/autotools.bbclass b/meta/classes/autotools.bbclass index 1400b44

[OE-core] [PATCH 1/3] autotools.bbclass: use oe_runmake instead of ${MAKE}

2016-01-29 Thread Markus Lehtonen
Use oe_runmake like in base.bbclass so that EXTRA_OEMAKE will be respected. Signed-off-by: Markus Lehtonen --- meta/classes/autotools.bbclass | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/meta/classes/autotools.bbclass b/meta/classes/autotools.bbclass index 1400b44

[OE-core] [PATCH 3/3] externalsrc: use shared CONFIGURESTAMPFILE if B=S

2016-01-29 Thread Markus Lehtonen
'work-shared' if ${B}=${S}. In addition, do_configure will depend on changes of this stamp file. As a result, do_configure is re-run and the build dir is cleaned correctly if a rebuild for different MACHINE is done. [YOCTO #8950] Signed-off-by: Markus Lehtonen --- meta/classes/externals

[OE-core] [PATCH 2/3] Make sure that the directory for CONFIGURESTAMPFILE exists

2016-01-29 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/classes/autotools.bbclass | 1 + meta/classes/base.bbclass | 1 + 2 files changed, 2 insertions(+) diff --git a/meta/classes/autotools.bbclass b/meta/classes/autotools.bbclass index 7bf510b..7f60c2a 100644 --- a/meta/classes/autotools.bbclass +++ b

[OE-core] [PATCH 0/3] correctly clean ${B] when externalsrc and {B}=${S}

2016-01-29 Thread Markus Lehtonen
: update to 3.4.2 (2016-01-26 22:48:57 +) are available in the git repository at: contrib-git marquiz/externalsrc for you to fetch changes up to 58bb2b3bd3195af2715e8dd594326dfa73fc72e9: externalsrc: use shared CONFIGURESTAMPFILE if B=S (2016-01-29 16:53:19 +0200) Markus Lehtonen (3

[OE-core] [PATCH] ncurses: use closing curly brackets

2016-02-04 Thread Markus Lehtonen
any other recipe in git.openembedded.org repositories or the layer repositories in git.yoctoproject.org (master branches). Markus Lehtonen (1): ncurses: use closing curly brackets in FILES_${PN}-tools variable meta/recipes-core/ncurses/ncurses.inc | 4 ++-- 1 file changed, 2 insertions(+), 2

[OE-core] [PATCH] ncurses: use closing curly brackets in FILES_${PN}-tools variable

2016-02-04 Thread Markus Lehtonen
This patch removes a workaround (needed for bitbake python parser) where closing curly brackets were replaced by ascii code '\x7d'. This commit requires a bitbake version with the "data_smart: simple bracket matching inside python expressions" patch applied. Signed-off

[OE-core] [PATCH 2/3] oe/gpg_sign: check for python-pexpect when using local signing

2016-02-05 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/lib/oe/gpg_sign.py | 10 +++--- 1 file changed, 7 insertions(+), 3 deletions(-) diff --git a/meta/lib/oe/gpg_sign.py b/meta/lib/oe/gpg_sign.py index 8832ea9..ea35564 100644 --- a/meta/lib/oe/gpg_sign.py +++ b/meta/lib/oe/gpg_sign.py @@ -17,13 +17,17

[OE-core] [PATCH 0/3] signing: enhance sanity checking

2016-02-05 Thread Markus Lehtonen
in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/rpmsign for you to fetch changes up to 643834ad064be34e2ad4218b436420cd5a1bc520: package signing: do sanity checking in an event handler (2016-02-05 15:32:29 +0200) Markus Lehtonen (3): package

[OE-core] [PATCH 3/3] package signing: do sanity checking in an event handler

2016-02-05 Thread Markus Lehtonen
This way, one does not get a ton of identical error messages. But, only one error message before all the recipes are parsed. Signed-off-by: Markus Lehtonen --- meta/classes/sign_package_feed.bbclass | 26 -- meta/classes/sign_rpm.bbclass | 26

[OE-core] [PATCH 1/3] package signing: do actual sanity checking in the signer class

2016-02-05 Thread Markus Lehtonen
The configuration needed for different signing backends may vary (although we currently support only one backend). Thus, do the actual sanity checking of the configuration there. Signed-off-by: Markus Lehtonen --- meta/classes/sign_package_feed.bbclass | 14 ++ meta/classes

Re: [OE-core] [PATCH 2/3] oe/gpg_sign: check for python-pexpect when using local signing

2016-02-08 Thread Markus Lehtonen
On Fri, 2016-02-05 at 14:31 +, Burton, Ross wrote: > > On 5 February 2016 at 14:00, Markus Lehtonen < > markus.lehto...@linux.intel.com> wrote: > > +msgs.append("Please install python-pexpect that is > > needed by lcocal gpg signing.") > >

[OE-core] [PATCH 1/2] oe/gpg_sign: fix incorrect variable name

2016-02-08 Thread Markus Lehtonen
Prevents crash in signing if GPG_PATH is defined. Signed-off-by: Markus Lehtonen --- meta/lib/oe/gpg_sign.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/lib/oe/gpg_sign.py b/meta/lib/oe/gpg_sign.py index 55abad8..821787e 100644 --- a/meta/lib/oe/gpg_sign.py +++ b

[OE-core] [PATCH 2/2] sign_package_feed.bbclass: fix task dependencies

2016-02-08 Thread Markus Lehtonen
This dependency was already added to sign_rpm.bbclass. However, the same dep needs to be added to sign_package_feed.bbclass, too, to cover the case where rpm signing is disabled but package feed signing is enabled. Signed-off-by: Markus Lehtonen --- meta/classes/sign_package_feed.bbclass | 1

[OE-core] [PATCH 0/2] Bugfixes to package signing

2016-02-08 Thread Markus Lehtonen
This patchset contains two small bugfixes to rpm package and package feed signing. Markus Lehtonen (2): oe/gpg_sign: fix incorrect variable name sign_package_feed.bbclass: fix task dependencies meta/classes/sign_package_feed.bbclass | 1 + meta/lib/oe/gpg_sign.py| 2 +- 2

[OE-core] [PATCH 0/5] sstate: use oe.gpg_sign for signing/verifying

2016-02-10 Thread Markus Lehtonen
repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/sstate for you to fetch changes up to 10ac62ab77a862a4efdcf68d20dd7331bfbc6f7a: sstate.bbclass: use oe.gpg_sign for gpg signing (2016-02-10 16:02:18 +0200) Markus Lehtonen (5): oe/gpg_sign: add verify() method oe

[OE-core] [PATCH 3/5] sign_rpm.bbclass: do not store key details in signer instance

2016-02-10 Thread Markus Lehtonen
Refactor the LocalSigner class. Do not store keyid or passphrase file in the signer object as they are only needed for some of the methods. For example, the newly added verify() method does not need any key parameters and export_pubkey only uses keyid. Signed-off-by: Markus Lehtonen --- meta

[OE-core] [PATCH 4/5] oe/gpg_sign: add 'passphrase' argument to detach_sign method

2016-02-10 Thread Markus Lehtonen
This allows directly giving the passphrase, instead of reading from a file. [YOCTO #9006] Signed-off-by: Markus Lehtonen --- meta/lib/oe/gpg_sign.py | 30 -- 1 file changed, 20 insertions(+), 10 deletions(-) diff --git a/meta/lib/oe/gpg_sign.py b/meta/lib/oe

[OE-core] [PATCH 2/5] oe/gpg_sign: add 'armor' argument to detach_sign()

2016-02-10 Thread Markus Lehtonen
[YOCTO #9006] Signed-off-by: Markus Lehtonen --- meta/lib/oe/gpg_sign.py | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/meta/lib/oe/gpg_sign.py b/meta/lib/oe/gpg_sign.py index a4f310e..16a2364 100644 --- a/meta/lib/oe/gpg_sign.py +++ b/meta/lib/oe/gpg_sign.py

[OE-core] [PATCH 1/5] oe/gpg_sign: add verify() method

2016-02-10 Thread Markus Lehtonen
A new method for verifying detached signatures. [YOCTO #9006] Signed-off-by: Markus Lehtonen --- meta/lib/oe/gpg_sign.py | 10 ++ 1 file changed, 10 insertions(+) diff --git a/meta/lib/oe/gpg_sign.py b/meta/lib/oe/gpg_sign.py index 821787e..a4f310e 100644 --- a/meta/lib/oe/gpg_sign.py

[OE-core] [PATCH 5/5] sstate.bbclass: use oe.gpg_sign for gpg signing

2016-02-10 Thread Markus Lehtonen
[YOCTO #9006] Signed-off-by: Markus Lehtonen --- meta/classes/sstate.bbclass | 38 +- 1 file changed, 17 insertions(+), 21 deletions(-) diff --git a/meta/classes/sstate.bbclass b/meta/classes/sstate.bbclass index 024b801..19fac32 100644 --- a/meta/classes

[OE-core] [PATCH] nss: define RPATH variable

2016-02-12 Thread Markus Lehtonen
f the sysroot instead of the host file system. This particular problem has probably been unnoticed as nss-native is seldom used and/or most users are likely to have nss libraries installed on their host system. In this case everything most likely work as expected. [YOCTO #9041] Signed-off-by: M

Re: [OE-core] [PATCH] nss: define RPATH variable

2016-02-15 Thread Markus Lehtonen
On Sat, 2016-02-13 at 05:12 +, Christopher Larson wrote: > On Fri, Feb 12, 2016 at 12:06 PM Markus Lehtonen < > markus.lehto...@linux.intel.com> wrote: > > Otherwise the nss libs do not get any RPATH/RUNPATH. Consequently, > > the > > .so dependencies of nss lib

[OE-core] [PATCH v2] nss: define RPATH variable for nss-native

2016-02-15 Thread Markus Lehtonen
f the sysroot instead of the host file system. This particular problem has probably been unnoticed as most users are likely to have nss libraries installed on their host system. In this case everything most likely work as expected. [YOCTO #9041] Signed-off-by: Markus Lehtonen --- meta/recipes-su

[OE-core] [PATCH] cml1.bbclass: fix do_menuconfig

2016-02-17 Thread Markus Lehtonen
The functionality got broken after bitbake commit 8bf33a8e92c0e188fa392030025756196c96fcbb which disabled the (bitbake) variable expansion inside python functions. Signed-off-by: Markus Lehtonen --- meta/classes/cml1.bbclass | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a

Re: [OE-core] [PATCH v5 1/3] gpg_sign: add local ipk package signing functionality

2016-02-18 Thread Markus Lehtonen
Hi, On 17/02/16 17:41, "Ioan-Adrian Ratiu" wrote: >Implement local ipk signing logic inside the gpg backend and add a new >bbclass which configures signing similar to how rpm does it. > >The ipk signing process is a bit different from rpm: >- Signatures are stored outside ipk files; opkg

Re: [OE-core] [PATCH v5 2/3] gpg_sign: detached_sign: add signature type support

2016-02-18 Thread Markus Lehtonen
On 17/02/16 17:41, "Ioan-Adrian Ratiu" wrote: >Add support for multiple types of signatures (binary or ascii) >in export_pubkey(). There is no change in behaviour for the function, >the previous implicit default is the new parameter "armor" default. > >Signed-off-by: Ioan-Adrian Ratiu >--- > m

Re: [OE-core] [PATCH v5 3/3] package_manager: sign IPK package feeds

2016-02-18 Thread Markus Lehtonen
On 17/02/16 17:41, "Ioan-Adrian Ratiu" wrote: >Create gpg signed ipk package feeds using the gpg backend if configured. > >Signed-off-by: Ioan-Adrian Ratiu >--- > meta/classes/sign_package_feed.bbclass | 10 +- > meta/lib/oe/package_manager.py | 17 +++-- > 2 files ch

[OE-core] [PATCH v2 0/2] devtool: create kernel config fragment

2016-02-18 Thread Markus Lehtonen
0 (2016-02-18 07:39:23 +) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/devtool/kernel for you to fetch changes up to 08dcad8878e8715f29ff9b63c65f3e9c177117a4: devtool: update-recipe: create config fragment (2016-02-18 15:53:07 +0

[OE-core] [PATCH v2 2/2] devtool: update-recipe: create config fragment

2016-02-18 Thread Markus Lehtonen
tree). ${S}/.config will be a symlink to ${B}/.config. We need to do this as devtool is not able to access ${B} because ${B} is set in a .bbappend in the workspace layer which is not parsed by devtool itself. [YOCTO #8999] Signed-off-by: Markus Lehtonen --- script

[OE-core] [PATCH v2 1/2] devtool: sync: update kernel config

2016-02-18 Thread Markus Lehtonen
Copy kernel config is copied to the source directory at a later phase in _extract_source() so that it gets copied when devtool sync is done, too. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-) diff --git a/scripts

Re: [OE-core] [PATCH v5 1/3] gpg_sign: add local ipk package signing functionality

2016-02-18 Thread Markus Lehtonen
On 18/02/16 11:28, "Ioan-Adrian Ratiu" wrote: >Hello > >On Thu, 18 Feb 2016 11:04:22 +0200 >Markus Lehtonen wrote: > >> Hi, >> >> >> >> On 17/02/16 17:41, "Ioan-Adrian Ratiu" >> > adrian.ra...@ni.com> wrote: &

Re: [OE-core] [PATCH v2 2/2] devtool: update-recipe: create config fragment

2016-02-19 Thread Markus Lehtonen
On Thu, 2016-02-18 at 15:19 +, Christopher Larson wrote: > > > On Thu, Feb 18, 2016 at 7:19 AM Markus Lehtonen < > markus.lehto...@linux.intel.com> wrote: > > Create config fragment if the user makes modifications to kernel > > config. > > User may change

Re: [OE-core] [PATCH] signing-keys: Make signing keys the only publisher of keys

2016-02-19 Thread Markus Lehtonen
Hi Randy, On Thu, 2016-02-18 at 07:38 -0800, Randy Witt wrote: > Previously the keys were put into the os-release package. The package > indexing code was also deploying the keys rather than only using the > keys. > > This change makes signing-keys.bb the only publisher of the keys and > also > u

Re: [OE-core] [PATCH v6 1/4] gpg_sign: add local ipk package signing functionality

2016-02-23 Thread Markus Lehtonen
Hi, Resending as my I got a strange "Only members may post to the list." error yesterday... On Fri, 2016-02-19 at 17:43 +0200, Ioan-Adrian Ratiu wrote: > Implement ipk signing inside the sign_ipk bbclass using the gpg_sign > module and configure signing similar to how rpm does it. sign_ipk > uses

Re: [OE-core] [PATCH v6 2/4] gpg_sign: detach_sign: fix gpg > 2.1 STDIN file descriptor

2016-02-23 Thread Markus Lehtonen
Hi, Resending as my I got a strange "Only members may post to the list." error yesterday... On Fri, 2016-02-19 at 17:43 +0200, Ioan-Adrian Ratiu wrote: > Starting from v2.1 passing passwords directly to gpg does not work > anymore [1], instead a loopback interface must be used otherwise > gpg >2.

Re: [OE-core] [PATCH v6 0/4] IPK signing for the gpg_sign module

2016-02-23 Thread Markus Lehtonen
Hi, Resending as my I got a strange "Only members may post to the list." error yesterday... On Fri, 2016-02-19 at 17:45 +0200, Ioan-Adrian Ratiu wrote: > This patch series extends the gpg_sign module to support ipk signing. > > v6 implements Markus' feedback. The most notable change is the > sign

[OE-core] [PATCH] base.bbclass wipe ${S} before unpacking source

2016-02-23 Thread Markus Lehtonen
Make sure that we have a pristine source tree after do_unpack. [YOCTO #9064] Signed-off-by: Markus Lehtonen --- meta/classes/base.bbclass | 8 +++- 1 file changed, 3 insertions(+), 5 deletions(-) diff --git a/meta/classes/base.bbclass b/meta/classes/base.bbclass index 1372f38..717a01e

[OE-core] [PATCH] Wipe ${S} before unpacking sources

2016-02-23 Thread Markus Lehtonen
igate if we can remove # the entire ${S} in this case. What kind of special cases might we have? At least qemux86 core-image-sato builds fine for me. [YOCTO #9064] Markus Lehtonen (1): base.bbclass wipe ${S} before unpacking source meta/classes/base.bbclass | 8 +++- 1 file changed, 3 i

Re: [OE-core] [PATCH] base.bbclass wipe ${S} before unpacking source

2016-02-24 Thread Markus Lehtonen
On Tue, 2016-02-23 at 18:23 +, Burton, Ross wrote: > > On 23 February 2016 at 18:01, Christopher Larson > wrote: > > db isn't the only recipe doing that. The fetcher unpack method > > knows where it's unpacking to, I think if anyone should be clearing > > out the destination first, it should.

[OE-core] [PATCH v2] Improve externalsrc task dependency tracking

2016-02-25 Thread Markus Lehtonen
expansion operator (2016-02-22 20:42:34 +) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/devtool/fixes Markus Lehtonen (1): externalsrc.bbclas: remove nostamp from do_configure meta/classes/externalsrc.bbclass | 25

[OE-core] [PATCH v2] externalsrc.bbclas: remove nostamp from do_configure

2016-02-25 Thread Markus Lehtonen
The reason is that all the files in the source tree are hashed. Subsequent builds are not significantly slower because (most) file hashes are found from the cache. [YOCTO #8853] Signed-off-by: Markus Lehtonen --- meta/classes/externalsrc.bbclass | 25 +++-- 1 file changed, 23 i

Re: [OE-core] [PATCH v7 1/5] gpg_sign: add local ipk package signing functionality

2016-03-03 Thread Markus Lehtonen
On 02/03/16 16:47, "Ioan-Adrian Ratiu" wrote: >Implement ipk signing inside the sign_ipk bbclass using the gpg_sign >module and configure signing similar to how rpm does it. sign_ipk uses >gpg_sign's detach_sign because its functionality is identical to package >feed signing. > >IPK signing proc

Re: [OE-core] [PATCH v7 2/5] gpg_sign: detach_sign: fix gpg > 2.1 STDIN file descriptor

2016-03-03 Thread Markus Lehtonen
On 02/03/16 16:47, "Ioan-Adrian Ratiu" wrote: >Starting from v2.1 passing passwords directly to gpg does not work >anymore [1], instead a loopback interface must be used otherwise >gpg >2.1 will error out with: >"gpg: signing failed: Inappropriate ioctl for device" > >gpg <2.1 does not work

Re: [OE-core] [PATCH v7 5/5] package_manager: sign IPK package feeds

2016-03-03 Thread Markus Lehtonen
On 02/03/16 16:47, "Ioan-Adrian Ratiu" wrote: >Create gpg signed ipk package feeds using the gpg backend if configured. > >Signed-off-by: Ioan-Adrian Ratiu >--- > meta/classes/sign_package_feed.bbclass | 17 - > meta/lib/oe/package_manager.py | 17 +++-- > 2 fi

[OE-core] [PATCH v2] externalsrc: use shared stamp directory if B=S

2016-03-18 Thread Markus Lehtonen
_configure to be re-run in every build if that would not be necessary. [YOCTO #8950] [YOCTO #9237] Signed-off-by: Markus Lehtonen --- meta/classes/externalsrc.bbclass | 10 -- 1 file changed, 4 insertions(+), 6 deletions(-) diff --git a/meta/classes/externalsrc.bbclass b/me

[OE-core] [PATCH] externalsrc: use shared stamp directory if B=S

2016-03-19 Thread Markus Lehtonen
_configure to be re-run in every build if that would not be necessary. [YOCTO #8950] [YOCTO #9237] Signed-off-by: Markus Lehtonen --- meta/classes/externalsrc.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes/externalsrc.bbclass b/meta/classes/externals

[OE-core] [PATCH] devtool: change config symlink name to .config.new

2016-03-19 Thread Markus Lehtonen
Otherwise (if the symlink is named .config) kernel build considers source tree as dirty and fails. [YOCTO #9270] Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts

Re: [OE-core] [jethro][PATCH 1/2] devtool: extract: copy kernel config to srctree

2016-03-19 Thread Markus Lehtonen
Hi, On 14/03/16 22:43, "Paul Eggleton" wrote: >From: Markus Lehtonen > >This makes the correct kernel config to be used when building kernel >from srctree (extrernalsrc). If no kernel config is present in the >builddir 'do_configure' task copies .config

[OE-core] [RFC PATCH] rpm signing: replace python-pexpect with our own implementation

2016-03-21 Thread Markus Lehtonen
elcome. [YOCTO #9304] Markus Lehtonen (1): oe/gpg_sign: use our own immplementation of pexpect meta/lib/oe/gpg_sign.py | 104 +--- 1 file changed, 90 insertions(+), 14 deletions(-) -- 2.6.2 -- ___ Op

[OE-core] [RFC PATCH] oe/gpg_sign: use our own immplementation of pexpect

2016-03-21 Thread Markus Lehtonen
Implement a simple python-expect replacement in order to get rid of the (currently undocumented) external dependency. Pexpect is only used for rpm package signing. [YOCTO #9304] Signed-off-by: Markus Lehtonen --- meta/lib/oe/gpg_sign.py | 104 +--- 1

[OE-core] [PATCH v2] Add ${S} to do_unpack[cleandirs]

2016-03-22 Thread Markus Lehtonen
Resending this second iteration of the patch. Markus Lehtonen (1): base.bbclass wipe ${S} before unpacking source meta/classes/base.bbclass | 12 ++-- 1 file changed, 2 insertions(+), 10 deletions(-) -- 2.6.2 -- ___ Openembedded-core

[OE-core] [PATCH v2] base.bbclass wipe ${S} before unpacking source

2016-03-22 Thread Markus Lehtonen
Make sure that we have a pristine source tree after do_unpack. [YOCTO #9064] Signed-off-by: Markus Lehtonen --- meta/classes/base.bbclass | 12 ++-- 1 file changed, 2 insertions(+), 10 deletions(-) diff --git a/meta/classes/base.bbclass b/meta/classes/base.bbclass index 1372f38

[OE-core] [PATCH v3 2/2] externalsrc: remove nostamp from do_configure

2016-03-22 Thread Markus Lehtonen
in the source tree are hashed. Subsequent builds are not significantly slower because (most) file hashes are found from the cache. [YOCTO #8853] Signed-off-by: Markus Lehtonen --- meta/classes/externalsrc.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes

[OE-core] [PATCH v3 1/2] externalsrc: do not use do_configure[nostamp] for git srctrees

2016-03-22 Thread Markus Lehtonen
op stops. Thus, you should usually see only one re-compilation (if any) after which the source tree is "stabilized" and no more re-compilations happen. [YOCTO #8853] Signed-off-by: Markus Lehtonen --- meta/classes/externalsrc.bbclass | 31 +-- 1 file changed,

[OE-core] [PATCH v3 0/2] Improve externalsrc task dependency tracking

2016-03-22 Thread Markus Lehtonen
9c200760cbbe322ed884729eb395f389c863e1c8: oe-buildenv-internal: Correct the sed expression which updates $PATH (2016-03-21 11:57:27 +) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/devtool/fixes Markus Lehtonen (2): externalsrc: do not use do_configure[nostamp] for

[OE-core] [PATCH v3] base.bbclass wipe ${S} before unpacking source

2016-03-22 Thread Markus Lehtonen
Make sure that we have a pristine source tree after do_unpack. [YOCTO #9064] Signed-off-by: Markus Lehtonen --- meta/classes/base.bbclass | 12 ++-- 1 file changed, 2 insertions(+), 10 deletions(-) diff --git a/meta/classes/base.bbclass b/meta/classes/base.bbclass index e066dc9

Re: [OE-core] [PATCH v2] base.bbclass wipe ${S} before unpacking source

2016-03-22 Thread Markus Lehtonen
On 22/03/16 09:47, "Richard Purdie" wrote: >On Tue, 2016-03-22 at 09:24 +0200, Markus Lehtonen wrote: >> Make sure that we have a pristine source tree after do_unpack. >> >> [YOCTO #9064] >> >> Signed-off-by: Markus Lehtonen >> --- >>

Re: [OE-core] [PATCH v2] externalsrc.bbclas: remove nostamp from do_configure

2016-03-22 Thread Markus Lehtonen
Hi Paul, On 08/03/16 07:03, "Paul Eggleton" wrote: >Hi Markus, > >On Thu, 25 Feb 2016 16:29:47 Markus Lehtonen wrote: >> Be a bit more intelligent than mindlessly re-compiling every time. >> Instead of using 'nostamp' flag for do_compile run a python

[OE-core] [PATCH v3] base.bbclass wipe ${S} before unpacking source

2016-08-03 Thread Markus Lehtonen
Make sure that we have a pristine source tree after do_unpack. [YOCTO #9064] Signed-off-by: Markus Lehtonen --- meta/classes/base.bbclass | 19 +-- 1 file changed, 9 insertions(+), 10 deletions(-) diff --git a/meta/classes/base.bbclass b/meta/classes/base.bbclass index 5d8e8d6

[OE-core] [PATCH v3] Add ${S} to do_unpack[cleandirs]

2016-08-03 Thread Markus Lehtonen
of this patch. Version 3 of the patch fixes the issue by moving Python code outside the value assignment. Markus Lehtonen (1): base.bbclass wipe ${S} before unpacking source meta/classes/base.bbclass | 19 +-- 1 file changed, 9 insertions(+), 10 deletions(-) -- 2.6.6

[OE-core] [PATCH v2 0/2] Improved handling of LICENSE_ variables

2016-08-03 Thread Markus Lehtonen
: Security fixes CVE-2015-8327 (2016-08-01 12:11:09 +0100) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/fixes-9499 http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/fixes-9499 Markus Lehtonen (2): license.bbclass: do

[OE-core] [PATCH v2 2/2] license: simple verification of LICENSE_ values

2016-08-03 Thread Markus Lehtonen
LICENSE_ values. It does do not do advanced parsing/matching of license expressions, but, checks that all licenses mentioned in LICENSE_ are also specified in LICENSE. A warning is printed if problems are found. Signed-off-by: Markus Lehtonen --- meta/classes/base.bbclass | 13 + me

[OE-core] [PATCH v2 1/2] license.bbclass: do not process LICENSE_pn variables

2016-08-03 Thread Markus Lehtonen
The loop iterating over LICENSE_pn variables has never worked. In addition, the LICENSE variable is supposed to contain all licenses defined in LICENSE_pn variables. Thus, it is simpler just to use LICENSE as the data we get is essentially the same. [YOCTO #9499] Signed-off-by: Markus Lehtonen

[OE-core] [PATCH 1/2] package.bbclass: better handling of middle-path dir symlinks

2016-08-04 Thread Markus Lehtonen
directory is a non-existent path. For example, defining FILES_{PN} = "symlink/file" causes a build failure because symlinks target 'foo/bar' is not included at all. [YOCTO #9827] Signed-off-by: Markus Lehtonen --- meta/classes/package.bbclass | 30

[OE-core] [PATCH 0/2] package.bbclass: better handling of directory symlinks

2016-08-04 Thread Markus Lehtonen
: foomatic-filters: Security fixes CVE-2015-8327 (2016-08-01 12:11:09 +0100) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/fixes-9827 http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/fixes-9827 Markus Lehtonen (2

[OE-core] [PATCH 2/2] package.bbclass: warn about files under symlinked directories

2016-08-04 Thread Markus Lehtonen
[YOCTO #9827] Signed-off-by: Markus Lehtonen --- meta/classes/package.bbclass | 3 +++ 1 file changed, 3 insertions(+) diff --git a/meta/classes/package.bbclass b/meta/classes/package.bbclass index df010e1..a9709ad 100644 --- a/meta/classes/package.bbclass +++ b/meta/classes/package.bbclass

[OE-core] [PATCH] license: improve handling of license files with identical basenames

2016-08-05 Thread Markus Lehtonen
ot; LIC_FILES_CHKSUM = "file://src/LICENCE;md5=d41d8cd98f00b204e9800998ecf8427e" you must specify: NO_GENERIC_LICENSE[my-custom-license] = "src/LICENCE" Signed-off-by: Markus Lehtonen --- meta/classes/license.bbclass | 30 ++ 1 file changed, 22 insertio

Re: [OE-core] [PATCH] license: improve handling of license files with identical basenames

2016-08-05 Thread Markus Lehtonen
/deploy/licenses/util-linux-native: COPYING.1 Only in build2/tmp-glibc/deploy/licenses/util-linux-native: COPYING.2 On 05/08/16 19:04, "Markus Lehtonen" wrote: >Previously, find_license_files() in license.bbclass just blindly assumed >that all different licenses specified in

[OE-core] [PATCH v2] license: improve handling of license files with identical basenames

2016-08-05 Thread Markus Lehtonen
ot; LIC_FILES_CHKSUM = "file://src/LICENCE;md5=d41d8cd98f00b204e9800998ecf8427e" you must specify: NO_GENERIC_LICENSE[my-custom-license] = "src/LICENCE" Signed-off-by: Markus Lehtonen --- meta/classes/license.bbclass | 30 ++ 1 file changed, 22 ins

Re: [OE-core] [PATCH 2/3] hdparm: update LICENSE info

2016-08-08 Thread Markus Lehtonen
On Mon, 2016-08-08 at 12:23 +0100, Burton, Ross wrote: > > On 8 August 2016 at 12:13, Maxin B. John > wrote: > > -LICENSE = "BSD" > > +LICENSE = "BSD & GPLv2" > > LICENSE_wiper = "GPLv2" > > > I sent a patch for this one last week but forgot to update the bug, > sorry. > > This isn't quite rig

Re: [OE-core] [PATCH v2] license: improve handling of license files with identical basenames

2016-08-08 Thread Markus Lehtonen
On Fri, 2016-08-05 at 19:24 +0300, Markus Lehtonen wrote: > Previously, find_license_files() in license.bbclass just blindly > assumed > that all different licenses specified in LIC_FILES_CHKSUM have unique > filenames. As a consequence, only the last one of these similarly > named

[OE-core] [PATCH] oeqa.buildperf: use oe.path.remove()

2016-08-11 Thread Markus Lehtonen
Drop the self-baked force_rm() method. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py| 15 --- meta/lib/oeqa/buildperf/basic_tests.py | 5 +++-- 2 files changed, 7 insertions(+), 13 deletions(-) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib

<    1   2   3   4   5   6   7   >