[OE-core] [PATCH v2 4/7] oe-selftest: devtool: add method for checking srctree repo

2015-06-03 Thread Markus Lehtonen
Removes some code duplication. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/selftest/devtool.py | 50 +++ 1 file changed, 19 insertions(+), 31 deletions(-) diff --git a/meta/lib/oeqa/selftest/devtool.py b/meta/lib/oeqa/selftest/devtool.py index c01e361

[OE-core] [PATCH v2 6/7] devtool: extract: always import local files to srctree

2015-06-03 Thread Markus Lehtonen
not under 'local-files'), just like before. [YOCTO #7602] Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/selftest/devtool.py | 46 +++ scripts/lib/devtool/standard.py | 58 ++- 2 files changed, 91 insertions(+), 1

[OE-core] [PATCH v2 7/7] devtool: modify: make bitbake use local files from srctree

2015-06-03 Thread Markus Lehtonen
l files into srctree. [YOCTO #7602] Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 9 +++-- 1 file changed, 7 insertions(+), 2 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index 44948fd..5d2a264 100644 --- a/scripts/lib

[OE-core] [PATCH v2 3/7] oe-selftest: devtool: add method for checking workspace dir

2015-06-03 Thread Markus Lehtonen
In order to remove some code duplication. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/selftest/devtool.py | 64 +++ 1 file changed, 24 insertions(+), 40 deletions(-) diff --git a/meta/lib/oeqa/selftest/devtool.py b/meta/lib/oeqa/selftest/devtool.py

[OE-core] [PATCH v2 5/7] devtool: update-recipe: update local files directly

2015-06-03 Thread Markus Lehtonen
space" and not behind a remote URL) we don't want create a patch against them, but, rather copy our modified version over the original source. NOTE: if new files are created, they are represented as patches, rather than copied over the orignal source. [YOCTO #7602] Signed-off-by: Markus Leh

[OE-core] [PATCH v2 2/7] oe.patch.GitApplyTree: add paths argument to extractPatches

2015-06-03 Thread Markus Lehtonen
Makes it possible to define which paths are included in the patches. Signed-off-by: Markus Lehtonen --- meta/lib/oe/patch.py | 5 - 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/meta/lib/oe/patch.py b/meta/lib/oe/patch.py index afb0013..6da2511 100644 --- a/meta/lib/oe

Re: [OE-core] [PATCH 0/6] devtool: improve handling of local source files

2015-06-04 Thread Markus Lehtonen
Hi, On Tue, 2015-05-12 at 19:01 +0100, Paul Eggleton wrote: > Hi Markus, > > On Thursday 30 April 2015 12:16:06 Markus Lehtonen wrote: > > This patchset tries to improve handling of local source files (i.e. file:// > > in SRC_URI). First, it improves packages for which S=W

Re: [OE-core] [PATCH v2 0/7] devtool: improve handling of local source files

2015-06-04 Thread Markus Lehtonen
Hi, On Thu, 2015-06-04 at 11:49 +0100, Paul Eggleton wrote: > Hi Markus, > > On Wednesday 03 June 2015 17:50:25 Markus Lehtonen wrote: > > Second version of my patchset aiming to improve handling of local source > > files. The only significant change since the first ve

[OE-core] [PATCH 01/10] devtool: fix wrong indentation

2015-06-04 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index c5b32d8..1e99413 100644 --- a/scripts/lib/devtool/standard.py +++ b/scripts/lib

[OE-core] [PATCH 05/10] devtool: simplify few conditionals a bit

2015-06-04 Thread Markus Lehtonen
Just refactor the code. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 27 --- 1 file changed, 12 insertions(+), 15 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index aa95e6e..dfa45e8 100644 --- a

[OE-core] [PATCH 03/10] devtool: update-recipe: do rev parsing in a separate function

2015-06-04 Thread Markus Lehtonen
Split out the logic of determining "initial rev" and "update rev" into a separate function. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 55 +++-- 1 file changed, 31 insertions(+), 24 deletions(-) diff --git a

[OE-core] [PATCH 04/10] devtool: simplify the logic of determining patches to be removed

2015-06-04 Thread Markus Lehtonen
A slight simplification of the code. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 25 +++-- 1 file changed, 11 insertions(+), 14 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index c8ba247..aa95e6e 100644

[OE-core] [PATCH 06/10] devtool: slight simplification of path splitting logic

2015-06-04 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index dfa45e8..c860094 100644 --- a/scripts/lib/devtool/standard.py +++ b/scripts/lib/devtool

[OE-core] [PATCH 10/10] devtool: use DevtoolError for error handling

2015-06-04 Thread Markus Lehtonen
ror occurs. Signed-off-by: Markus Lehtonen --- scripts/devtool | 8 ++- scripts/lib/devtool/__init__.py | 6 ++ scripts/lib/devtool/deploy.py | 31 scripts/lib/devtool/standard.py | 152 ++-- 4 files changed, 97 insertions(+), 100

[OE-core] [PATCH 02/10] devtool: refactor bb task execution into a separate class

2015-06-04 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 50 - 1 file changed, 30 insertions(+), 20 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index 1e99413..aed76ea 100644 --- a/scripts/lib

[OE-core] [PATCH 07/10] devtool: split out 'srcrev' update mode into a separate function

2015-06-04 Thread Markus Lehtonen
Refactor update_recipe() (i.e. the implementation of the update-recipe command) by splitting out the 'srcrev' into a distinct function. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 188 1 file changed, 111 inserti

[OE-core] [PATCH 00/10] devtool refactoring

2015-06-04 Thread Markus Lehtonen
available in the git repository at: ssh://oegit/openembedded-core-contrib marquiz/devtool/refactor http://git.openembedded.org/openembedded-core-contrib/commit/?h=marquiz/devtool/refactor Markus Lehtonen (10): devtool: fix wrong indentation devtool: refactor bb task execution into a separate

[OE-core] [PATCH 08/10] devtool: split out 'patch' update mode into a separate function

2015-06-04 Thread Markus Lehtonen
Continue refactoring of update_recipe() by splitting out the 'patch' mode into a separate function. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 236 +--- 1 file changed, 122 insertions(+), 114 deletions(-) diff --git a/s

[OE-core] [PATCH 09/10] devtool: remove some unused return values

2015-06-04 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/devtool | 1 - scripts/lib/devtool/standard.py | 3 --- 2 files changed, 4 deletions(-) diff --git a/scripts/devtool b/scripts/devtool index 0100eb8..307846a 100755 --- a/scripts/devtool +++ b/scripts/devtool @@ -157,7 +157,6 @@ def

Re: [OE-core] [PATCH 00/10] devtool refactoring

2015-06-10 Thread Markus Lehtonen
Hi, On 09/06/15 18:01, "Paul Eggleton" wrote: >Hi Markus, > >On Thursday 04 June 2015 19:31:44 Markus Lehtonen wrote: >> This patchset contains contains some refactoring of the devtool code, >> hopefully making the code more maintainable and somewhat easier to r

[OE-core] [PATCH v2 00/10] devtool refactoring

2015-06-11 Thread Markus Lehtonen
uiz/devtool/refactor ---- Markus Lehtonen (10): devtool: fix wrong indentation devtool: refactor bb task execution into a separate class devtool: update-recipe: do rev parsing in a separate function devtool: simplify the logic of deter

[OE-core] [PATCH v2 01/10] devtool: fix wrong indentation

2015-06-11 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index c5b32d8..1e99413 100644 --- a/scripts/lib/devtool/standard.py +++ b/scripts/lib

[OE-core] [PATCH v2 05/10] devtool: simplify few conditionals a bit

2015-06-11 Thread Markus Lehtonen
Just refactor the code. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 14 ++ 1 file changed, 6 insertions(+), 8 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index aa95e6e..4b9cebb 100644 --- a/scripts/lib/devtool

[OE-core] [PATCH v2 04/10] devtool: simplify the logic of determining patches to be removed

2015-06-11 Thread Markus Lehtonen
A slight simplification of the code. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 25 +++-- 1 file changed, 11 insertions(+), 14 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index c8ba247..aa95e6e 100644

[OE-core] [PATCH v2 03/10] devtool: update-recipe: do rev parsing in a separate function

2015-06-11 Thread Markus Lehtonen
Split out the logic of determining "initial rev" and "update rev" into a separate function. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 55 +++-- 1 file changed, 31 insertions(+), 24 deletions(-) diff --git a

[OE-core] [PATCH v2 02/10] devtool: refactor bb task execution into a separate class

2015-06-11 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 50 - 1 file changed, 30 insertions(+), 20 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index 1e99413..aed76ea 100644 --- a/scripts/lib

[OE-core] [PATCH v2 06/10] devtool: slight simplification of path splitting logic

2015-06-11 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 11 +-- 1 file changed, 5 insertions(+), 6 deletions(-) diff --git a/scripts/lib/devtool/standard.py b/scripts/lib/devtool/standard.py index 4b9cebb..c92c9ae 100644 --- a/scripts/lib/devtool/standard.py +++ b/scripts

[OE-core] [PATCH v2 07/10] devtool: split out 'srcrev' update mode into a separate function

2015-06-11 Thread Markus Lehtonen
Refactor update_recipe() (i.e. the implementation of the update-recipe command) by splitting out the 'srcrev' into a distinct function. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 188 1 file changed, 111 inserti

[OE-core] [PATCH v2 09/10] devtool: remove some unused return values

2015-06-11 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/devtool | 1 - scripts/lib/devtool/standard.py | 3 --- 2 files changed, 4 deletions(-) diff --git a/scripts/devtool b/scripts/devtool index 0100eb8..307846a 100755 --- a/scripts/devtool +++ b/scripts/devtool @@ -157,7 +157,6 @@ def

[OE-core] [PATCH v2 10/10] devtool: use DevtoolError for error handling

2015-06-11 Thread Markus Lehtonen
ror occurs. Signed-off-by: Markus Lehtonen --- scripts/devtool | 8 ++- scripts/lib/devtool/__init__.py | 6 ++ scripts/lib/devtool/deploy.py | 31 scripts/lib/devtool/standard.py | 154 ++-- 4 files changed, 99 insertions(+), 100

[OE-core] [PATCH v2 08/10] devtool: split out 'patch' update mode into a separate function

2015-06-11 Thread Markus Lehtonen
Continue refactoring of update_recipe() by splitting out the 'patch' mode into a separate function. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 236 +--- 1 file changed, 122 insertions(+), 114 deletions(-) diff --git a/s

Re: [OE-core] [PATCH 0/6] devtool: improve handling of local source files

2015-06-11 Thread Markus Lehtonen
Hi Paul, On Thu, 2015-06-04 at 14:49 +0100, Paul Eggleton wrote: > On Thursday 04 June 2015 16:12:07 Markus Lehtonen wrote: > > On Tue, 2015-05-12 at 19:01 +0100, Paul Eggleton wrote: > > > On Thursday 30 April 2015 12:16:06 Markus Lehtonen wrote: > > > > This patc

Re: [OE-core] [PATCH v2 09/10] devtool: remove some unused return values

2015-06-17 Thread Markus Lehtonen
Hi Paul, On Wed, 2015-06-17 at 10:36 +0100, Paul Eggleton wrote: > On Thursday 11 June 2015 14:34:15 Markus Lehtonen wrote: > > Signed-off-by: Markus Lehtonen > > --- > > scripts/devtool | 1 - > > scripts/lib/devtool/standard.py | 3 --- > &

[OE-core] [PATCH 1/2] combo-layer: only allow fast-forward when pulling

2015-07-08 Thread Markus Lehtonen
"last_revision" field of the combo-layer config to point to a git commit that is only present in the users local component repository but nowhere in upstream. Signed-off-by: Markus Lehtonen --- scripts/combo-layer | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scr

[OE-core] [PATCH 0/2] combo-layer pull changes

2015-07-08 Thread Markus Lehtonen
Markus Lehtonen (2): combo-layer: only allow fast-forward when pulling combo-layer: implement --hard-reset option scripts/combo-layer | 15 --- 1 file changed, 12 insertions(+), 3 deletions(-) -- 2.1.4 -- ___ Openembedded-core

[OE-core] [PATCH 2/2] combo-layer: implement --hard-reset option

2015-07-08 Thread Markus Lehtonen
This option causes combo-layer to do git fetch and hard reset instead of git pull in the component repositories. This makes sure that the local component repositories are always in sync with the remote - tolerating force pushes and overriding any locally made changes. Signed-off-by: Markus

[OE-core] [PATCH 1/2] devtool: extract: copy kernel config to srctree

2015-12-03 Thread Markus Lehtonen
This makes the correct kernel config to be used when building kernel from srctree (extrernalsrc). If no kernel config is present in the builddir 'do_configure' task copies .config from the srctree. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 8 1 fi

[OE-core] [PATCH 0/2] devtool: kernel config fixes

2015-12-03 Thread Markus Lehtonen
15:35:42 +0200) Markus Lehtonen (2): devtool: extract: copy kernel config to srctree devtool: extract: update SRCTREECOVEREDTASKS for kernel scripts/lib/devtool/standard.py | 11 ++- 1 file changed, 10 insertions(+), 1 deletion(-) -- 2.1.4

[OE-core] [PATCH 2/2] devtool: extract: update SRCTREECOVEREDTASKS for kernel

2015-12-03 Thread Markus Lehtonen
so because 'do_patch' which is a dependency of 'do_kernel_configme' is not being run. We now store .config in the srctree and 'do_configure' task is able to run successfully. Signed-off-by: Markus Lehtonen --- scripts/lib/devtool/standard.py | 3 ++- 1 file cha

[OE-core] [PATCH 2/2] oe/patch: print cleaner error message when patch fails to apply

2016-04-01 Thread Markus Lehtonen
[YOCTO #9344] Signed-off-by: Markus Lehtonen --- meta/lib/oe/patch.py | 14 +- 1 file changed, 9 insertions(+), 5 deletions(-) diff --git a/meta/lib/oe/patch.py b/meta/lib/oe/patch.py index 6ab4427..9d36172 100644 --- a/meta/lib/oe/patch.py +++ b/meta/lib/oe/patch.py @@ -214,13

[OE-core] [PATCH 1/2] oe/patch: more detailed error reporting

2016-04-01 Thread Markus Lehtonen
Show the actual command that failed when raising a CmdError. Makes figuring out what actually failed much easier. [YOCTO #9344] Signed-off-by: Markus Lehtonen --- meta/lib/oe/patch.py | 8 +--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/meta/lib/oe/patch.py b/meta/lib/oe

[OE-core] [PATCH] externalsrc: avoid race in temporary git index file

2016-04-05 Thread Markus Lehtonen
-by: Markus Lehtonen --- meta/classes/externalsrc.bbclass | 17 + 1 file changed, 9 insertions(+), 8 deletions(-) diff --git a/meta/classes/externalsrc.bbclass b/meta/classes/externalsrc.bbclass index dff6184..da7eb478 100644 --- a/meta/classes/externalsrc.bbclass +++ b/meta

[OE-core] [PATCH] rpm: more verbose errors in rpmTempFile

2016-04-13 Thread Markus Lehtonen
This patch adds better error logging inside the rpm tempfile function in order to be able to better analyze a rare and very hard-to-reproduce failure in oe-selftest for rpm signing. [YOCTO #9416] Signed-off-by: Markus Lehtonen --- ...more-verbose-error-logging-in-rpmTempFile.patch | 53

[OE-core] [PATCH] license.bbclass: do write_deploy_manifest in image postprocessing

2016-04-19 Thread Markus Lehtonen
Call write_deploy_manifest() in image postprocessing phase, instead of rootfs postprocessing. The reason being that not necessarily all do_deploy tasks are dependencies of the do_rootfs and we might miss something. [YOCTO #9446] Signed-off-by: Markus Lehtonen --- meta/classes/license.bbclass

[OE-core] [PATCH] license.bbclass: postpone image license manifest creation until image postprocessing phase

2016-04-19 Thread Markus Lehtonen
This is a proposed fix to yocto bug #9446. It should fix the reported issue although is was not able to reproduce the problem. Markus Lehtonen (1): license.bbclass: do write_deploy_manifest in image postprocessing meta/classes/license.bbclass | 5 - 1 file changed, 4 insertions(+), 1

[OE-core] [PATCH] license.bbclass: make sure that image manifest dir exists

2016-04-21 Thread Markus Lehtonen
. This patch fixes that by creating the directory hierarchy inside write_deploy_manifest(). [YOCTO #9446] Signed-off-by: Markus Lehtonen --- meta/classes/license.bbclass | 6 -- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/meta/classes/license.bbclass b/meta/classes

Re: [OE-core] [PATCH v3] base.bbclass wipe ${S} before unpacking source

2016-05-10 Thread Markus Lehtonen
Ping, Any comments on this one? Discussion on v2 of the patch: http://lists.openembedded.org/pipermail/openembedded-core/2016-March/119295.html Cheers, Markus On 22/03/16 18:47, "Markus Lehtonen" wrote: >Make sure that we have a pristine source tree after do_unpack. &g

[OE-core] [PATCH] license.bbclass: do not process LICENSE_pn variables

2016-05-26 Thread Markus Lehtonen
The loop iterating over LICENSE_pn variables has never worked. In addition, the LICENSE variable is supposed to contain all licenses defined in LICENSE_pn variables. Thus, it is simpler just to use LICENSE as the data we get is essentially the same. [YOCTO #9499] Signed-off-by: Markus Lehtonen

Re: [OE-core] [PATCH] license.bbclass: do not process LICENSE_pn variables

2016-05-30 Thread Markus Lehtonen
Hi Martin, On Fri, 2016-05-27 at 12:07 +0200, Martin Jansa wrote: > On Fri, May 27, 2016 at 09:26:10AM +0300, Markus Lehtonen wrote: > > The loop iterating over LICENSE_pn variables has never worked. In > > addition, the LICENSE variable is supposed to contain all licenses

Re: [OE-core] [PATCH v3] base.bbclass wipe ${S} before unpacking source

2016-06-22 Thread Markus Lehtonen
well. > > BR Petter > > Petter Mabäcker > > Technux > www.technux.se > 2016-05-10 09:56 skrev Markus Lehtonen: > > Ping, > > > > Any comments on this one? > > > > Discussion on v2 of the patch: > > http://lists.openembedded.org/pip

[OE-core] [PATCH 03/28] oeqa.utils.commands: runCmd: gracefully handle empty output

2016-06-24 Thread Markus Lehtonen
Don't crash if the caller redirects the command output e.g. into a file, causing the "output" seen by runCmd to be None. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/commands.py | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/meta/lib/oeqa/util

[OE-core] [PATCH 00/28] Implement build performance test script in Python

2016-06-24 Thread Markus Lehtonen
/log/?h=marquiz/build-perf/python-rewrite Markus Lehtonen (28): oeqa.utils.commands: Introduce get_bb_vars() oeqa.utils.commands: use get_bb_vars() in get_bb_var() oeqa.utils.commands: runCmd: gracefully handle empty output oeqa.utils.commands: runCmd: return stderr output, too scripts

[OE-core] [PATCH 02/28] oeqa.utils.commands: use get_bb_vars() in get_bb_var()

2016-06-24 Thread Markus Lehtonen
Get rid of duplicate code. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/commands.py | 20 +--- 1 file changed, 5 insertions(+), 15 deletions(-) diff --git a/meta/lib/oeqa/utils/commands.py b/meta/lib/oeqa/utils/commands.py index 0297e53..2e513be 100644 --- a/meta/lib

[OE-core] [PATCH 07/28] oe-build-perf-test: introduce oeqa.buildperf module

2016-06-24 Thread Markus Lehtonen
Wireframe of a new Python module for containing build performance tests and utility functions. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/__init__.py | 12 1 file changed, 12 insertions(+) create mode 100644 meta/lib/oeqa/buildperf/__init__.py diff --git a/meta

[OE-core] [PATCH 06/28] oe-build-perf-test: add pre-run sanity check

2016-06-24 Thread Markus Lehtonen
The script will be required to be run in an initialized bitbake build environment. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 28 1 file changed, 28 insertions(+) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build-perf-test index

[OE-core] [PATCH 01/28] oeqa.utils.commands: Introduce get_bb_vars()

2016-06-24 Thread Markus Lehtonen
A new function for getting values of multiple bitbake variables at the same time. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/commands.py | 33 + 1 file changed, 33 insertions(+) diff --git a/meta/lib/oeqa/utils/commands.py b/meta/lib/oeqa/utils

[OE-core] [PATCH 08/28] oeqa.buildperf: functionality to drop kernel caches

2016-06-24 Thread Markus Lehtonen
(with tee) is possible but not really dropping caches, yet. User can avoid giving the password by adding something like: ALL = NOPASSWD: /usr/bin/tee /proc/sys/vm/drop_caches to the system sudoers file. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/__init__.py | 1 + meta/lib/oeqa

[OE-core] [PATCH 04/28] oeqa.utils.commands: runCmd: return stderr output, too

2016-06-24 Thread Markus Lehtonen
Useful if one wants to separate stdout and stderr. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/commands.py | 1 + 1 file changed, 1 insertion(+) diff --git a/meta/lib/oeqa/utils/commands.py b/meta/lib/oeqa/utils/commands.py index 171c64f..17341aa 100644 --- a/meta/lib/oeqa/utils

[OE-core] [PATCH 05/28] scripts: introduce oe-build-perf-test

2016-06-24 Thread Markus Lehtonen
Initial wireframe for re-writing build-perf-test.sh in Python. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 51 ++ 1 file changed, 51 insertions(+) create mode 100755 scripts/oe-build-perf-test diff --git a/scripts/oe-build-perf

[OE-core] [PATCH 09/28] oeqa.buildperf: add BuildPerfTest class

2016-06-24 Thread Markus Lehtonen
The new class will be used as an abstract base class for build performance tests. This implementation contains some common functionality used in multiple tests, "copied" from the build-perf-test.sh shell script. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/__init

[OE-core] [PATCH 10/28] oeqa.buildperf: method for measuring system resource usage

2016-06-24 Thread Markus Lehtonen
nd 'legend' where name is supposed to function as a common key or id over test runs, making comparison and trending easier, for example. Legend is supposed to be a short human readable description. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/bu

[OE-core] [PATCH 11/28] oeqa.buildperf: add method to log shell commands

2016-06-24 Thread Markus Lehtonen
Add new methods to BuildPerfTest class for running a shell command and logging its output. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index d608061

[OE-core] [PATCH 19/28] oeqa.buildperf: add test Test3

2016-06-24 Thread Markus Lehtonen
Re-implement "test3" from build-perf-test.sh which measures bitbake parsing time. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/basic_tests.py | 20 1 file changed, 20 insertions(+) diff --git a/meta/lib/oeqa/buildperf/basic_tests.py b/meta/lib/oeqa

[OE-core] [PATCH 13/28] oeqa.buildperf: add method for saving buildstats

2016-06-24 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 5 + 1 file changed, 5 insertions(+) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index e29e9d1..c54b70c 100644 --- a/meta/lib/oeqa/buildperf/base.py +++ b/meta/lib/oeqa/buildperf/base.py

[OE-core] [PATCH 14/28] oeqa.buildperf: implement BuildPerfTestRunner class

2016-06-24 Thread Markus Lehtonen
The new class is responsible for actually running the tests and processing their results. This commit also adds a decorator function for adding new tests. No automatic test discovery, at least yet. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/__init__.py | 3 ++- meta/lib/oeqa

[OE-core] [PATCH 12/28] oeqa.buildperf: add method for measuring file disk usage

2016-06-24 Thread Markus Lehtonen
Add a new method to BuildPerfTest class for measuring the disk usage of a file of directory. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 19 +++ 1 file changed, 19 insertions(+) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf

[OE-core] [PATCH 17/28] oeqa.buildperf: add test Test1P3

2016-06-24 Thread Markus Lehtonen
Re-implement "test1_p3" from build-perf-test.sh which measures 'bitbake core-image-sato' with rm_work enabled. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/basic_tests.py | 26 ++ 1 file changed, 26 insertions(+) diff --git a/met

[OE-core] [PATCH 15/28] oeqa.buildperf: add test Test1P1

2016-06-24 Thread Markus Lehtonen
Re-implement "test1_p1" from build-perf-test.sh which measures 'bitbake core-image-sato'. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/__init__.py| 3 ++- meta/lib/oeqa/buildperf/basic_tests.py | 31 +++ 2 files changed,

[OE-core] [PATCH 16/28] oeqa.buildperf: add test Test1P2

2016-06-24 Thread Markus Lehtonen
Re-implement "test1_p2" from build-perf-test.sh which measures 'bitbake virtual/kernel'. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/basic_tests.py | 14 ++ 1 file changed, 14 insertions(+) diff --git a/meta/lib/oeqa/buildperf/basic_tests

[OE-core] [PATCH 22/28] oe-build-perf-test: enable logging into file

2016-06-24 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 16 +++- 1 file changed, 15 insertions(+), 1 deletion(-) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build-perf-test index 0a9fc9e..ca90f69 100755 --- a/scripts/oe-build-perf-test +++ b/scripts/oe-build-perf

[OE-core] [PATCH 20/28] oeqa.buildperf: add test Test4

2016-06-24 Thread Markus Lehtonen
Re-implement "test4" from build-perf-test.sh which measures eSDK metrics. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/basic_tests.py | 28 1 file changed, 28 insertions(+) diff --git a/meta/lib/oeqa/buildperf/basic_tests.py b/meta/lib/oeqa

[OE-core] [PATCH 25/28] oe-build-perf-test: implement --globalres-file option

2016-06-24 Thread Markus Lehtonen
Using this option the script appends test results into a 'global results file'. A CSV-formatted output of the results. This option is to provide compatibility with the old build-perf-test.sh. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/ba

[OE-core] [PATCH 18/28] oeqa.buildperf: add test Test2

2016-06-24 Thread Markus Lehtonen
Re-implement "test2" from build-perf-test.sh which measures 'bitbake core-image-sato -c rootfs'. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/basic_tests.py | 14 ++ 1 file changed, 14 insertions(+) diff --git a/meta/lib/oeqa/buildperf/basic_tests

[OE-core] [PATCH 24/28] oeqa.buildperf: add git revision and branch to result data

2016-06-24 Thread Markus Lehtonen
possible to run the build performance test script even if the top directory is not a git repository clone, for example. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 32 1 file changed, 32 insertions(+) diff --git a/meta/lib/oeqa/buildperf

[OE-core] [PATCH 23/28] oeqa.utils: add git module

2016-06-24 Thread Markus Lehtonen
operations can be added later. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/git.py | 38 ++ 1 file changed, 38 insertions(+) create mode 100644 meta/lib/oeqa/utils/git.py diff --git a/meta/lib/oeqa/utils/git.py b/meta/lib/oeqa/utils/git.py new file

[OE-core] [PATCH 21/28] oeqa.buildperf: archive build/conf into test results

2016-06-24 Thread Markus Lehtonen
Have the build/conf directory as part of test results. Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/buildperf/base.py | 8 1 file changed, 8 insertions(+) diff --git a/meta/lib/oeqa/buildperf/base.py b/meta/lib/oeqa/buildperf/base.py index 1bfcb71..c0318a1 100644 --- a/meta/lib

[OE-core] [PATCH 28/28] scripts/contrib: introduce build-perf-test-wrapper.sh

2016-06-24 Thread Markus Lehtonen
: Markus Lehtonen --- scripts/contrib/build-perf-test-wrapper.sh | 102 + 1 file changed, 102 insertions(+) create mode 100755 scripts/contrib/build-perf-test-wrapper.sh diff --git a/scripts/contrib/build-perf-test-wrapper.sh b/scripts/contrib/build-perf-test-wrapper.sh

[OE-core] [PATCH 26/28] oe-build-perf-test: enable locking

2016-06-24 Thread Markus Lehtonen
Makes it possible to guard that multiple tests are not run in parallel. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 23 +++ 1 file changed, 23 insertions(+) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build-perf-test index 9dd073c..64873c9

[OE-core] [PATCH 27/28] oe-build-perf-test: add --out-dir command line argument

2016-06-24 Thread Markus Lehtonen
The new option defines the output directory for the test result data. Signed-off-by: Markus Lehtonen --- scripts/oe-build-perf-test | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/scripts/oe-build-perf-test b/scripts/oe-build-perf-test index 64873c9..996996b 100755 --- a

[OE-core] [PATCH v2 00/28] Implement build performance test script in Python

2016-06-30 Thread Markus Lehtonen
ld -perf-python-rewrite http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/ build-perf-python-rewrite Markus Lehtonen (28): oeqa.utils.commands: Introduce get_bb_vars() oeqa.utils.commands: use get_bb_vars() in get_bb_var() oeqa.utils.commands: runCmd: gracefull

Re: [OE-core] [PATCH 09/28] oeqa.buildperf: add BuildPerfTest class

2016-06-30 Thread Markus Lehtonen
On Mon, 2016-06-27 at 13:12 +0100, Joshua G Lock wrote: > On Fri, 2016-06-24 at 13:37 +0300, Markus Lehtonen wrote: [...SNIP...] > > + > > +@staticmethod > > +def force_rm(path): > > +"""Equivalent of 'rm -rf'""" &

[OE-core] [PATCH] python: fix python-tests rdepends

2016-10-28 Thread Markus Lehtonen
test.regrtest depends on most of python modules so require all of them. [YOCTO #10522] Signed-off-by: Markus Lehtonen --- meta/recipes-devtools/python/python-2.7-manifest.inc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/recipes-devtools/python/python-2.7

[OE-core] [PATCH] sanity.bbclass: fix logging of an error

2016-11-10 Thread Markus Lehtonen
Fixes a crash in exception handler. All bb logging functions need an string instances as arguments. Signed-off-by: Markus Lehtonen --- meta/classes/sanity.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/meta/classes/sanity.bbclass b/meta/classes/sanity.bbclass index

[OE-core] [PATCH 0/2] Stop using update-alternatives to manage syslog init script

2016-11-21 Thread Markus Lehtonen
marquiz/fixes-10433 http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/fixes-10433 Markus Lehtonen (2): busybox: don't manage sysv init script with update-alternatives sysklogd: don't use update-alternatives meta/conf/distro/include/default-providers.inc | 1 + me

[OE-core] [PATCH 1/2] busybox: don't manage sysv init script with update-alternatives

2016-11-21 Thread Markus Lehtonen
indication that it is a bad idea is that no other system service package seems to manage init scripts with update-alternatives. The patch also adds a new virtual package, i.e. VIRTUAL-RUNTIME_syslog. [YOCTO #10433] Signed-off-by: Markus Lehtonen --- meta/conf/distro/include/default-providers.inc | 1

[OE-core] [PATCH 2/2] sysklogd: don't use update-alternatives

2016-11-21 Thread Markus Lehtonen
Using update-alternatives for managing init scripts has proved to be problematic. Thus, don't use this method and just conflict with busybox-syslog, instead. [YOCTO #10433] Signed-off-by: Markus Lehtonen --- meta/recipes-extended/sysklogd/sysklogd.inc | 15 +++ 1 file chang

Re: [OE-core] [PATCH v3] classes: Fix alternatives and rc.d ordering

2016-11-24 Thread Markus Lehtonen
On Thu, 2016-11-24 at 10:26 +0100, David Vincent wrote: > When using an alternative as an initscript, the ordering between > update-rc.d and update-alternatives tasks during prerm and postinst > tasks must always be the following in order to work: > * prerm: > - stop daemon > - remove alt

Re: [OE-core] [PATCHv2 2/3] oeqa/utils/metadata.py: Add metadata library

2016-12-05 Thread Markus Lehtonen
On Thu, 2016-12-01 at 09:37 -0600, mariano.lo...@linux.intel.com wrote: > From: Mariano Lopez > > Adds functions to get metadata from the host running the tests. > > [YOCTO #9954] > > Signed-off-by: Mariano Lopez > --- > meta/lib/oeqa/utils/metadata.py | 83 > +

[OE-core] [PATCH 0/8] oeqa.utils.metadata: update xml schema

2016-12-28 Thread Markus Lehtonen
-22 08:50:21 +) are available in the git repository at: git://git.openembedded.org/openembedded-core-contrib marquiz/oeqa-metaxml http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/oeqa-metaxml Markus Lehtonen (8): oeqa.utils.metadata: re-organise host distro

[OE-core] [PATCH 1/8] oeqa.utils.metadata: re-organise host distro information

2016-12-28 Thread Markus Lehtonen
Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/metadata.py | 26 +- 1 file changed, 21 insertions(+), 5 deletions(-) diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py index 5d8bf84..2316841 100644 --- a/meta/lib/oeqa/utils/metadata.py

[OE-core] [PATCH 2/8] oeqa.utils.metadata: re-organise distro information

2016-12-28 Thread Markus Lehtonen
Use the same format, based on /etc/os-release, as for host distro information. [YOCTO #10590] Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/metadata.py | 17 ++--- scripts/oe-selftest | 4 ++-- 2 files changed, 12 insertions(+), 9 deletions(-) diff --git a

[OE-core] [PATCH 3/8] oeqa.utils.metadata: drop 'unknown' git data elements

2016-12-28 Thread Markus Lehtonen
It's better just to not have the xml elements than to have elements with faux data. One could have git branch named 'unknown', for example. [YOCTO #10590] Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/metadata.py | 7 +++ scripts/oe-selftest | 4 ++--

[OE-core] [PATCH 6/8] oeqa.utils.metadata: add commit count information

2016-12-28 Thread Markus Lehtonen
Makes it easier to put the commits into a timeline. [YOCTO #10590] Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/metadata.py | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py index 2f7e8f2..d5cc290

[OE-core] [PATCH 8/8] oeqa.utils.metadata: add bitbake revision information

2016-12-28 Thread Markus Lehtonen
[YOCTO #10590] Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/metadata.py | 32 +++- 1 file changed, 19 insertions(+), 13 deletions(-) diff --git a/meta/lib/oeqa/utils/metadata.py b/meta/lib/oeqa/utils/metadata.py index 6331c21..23449fc 100644 --- a/meta/lib

[OE-core] [PATCH 5/8] oeqa.utils.metadata: rename 'revision' to 'commit'

2016-12-28 Thread Markus Lehtonen
Revision is a bit vague and could point to a tag, for example. Git commit objects are unambiguous and persistent so be explicit that the element should contain git commit hash. [YOCTO #10590] Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/metadata.py | 2 +- scripts/oe-selftest

[OE-core] [PATCH 7/8] oeqa.utils.metadata: have layer name as an attribute in xml

2016-12-28 Thread Markus Lehtonen
Have the layer name as an attribute instead of of the name of the element itself. That is, have instead of . A bit better XML design. [YOCTO #10590] Signed-off-by: Markus Lehtonen --- meta/lib/oeqa/utils/metadata.py | 8 +--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a

[OE-core] [PATCH 4/8] oeqa.utils.metadata: fix retrieval of git branch and revision

2016-12-28 Thread Markus Lehtonen
Always return a valid branch name, or, '(nobranch)' if the current HEAD is detached. Also, always return the hash of the commit object that HEAD is pointing to. Previous code returned an incorrect branch name (or crashed) e.g. in the case of detached HEAD. [YOCTO #10590] Signed-off-

Re: [OE-core] [PATCH 3/8] oeqa.utils.metadata: drop 'unknown' git data elements

2017-01-05 Thread Markus Lehtonen
On 04/01/2017, 17.30, "Mariano Lopez" wrote: >On 28/12/16 07:02, Markus Lehtonen wrote: >> It's better just to not have the xml elements than to have elements with >> faux data. One could have git branch named 'unknown', for example. >> >> >

Re: [OE-core] [PATCH 7/8] oeqa.utils.metadata: have layer name as an attribute in xml

2017-01-05 Thread Markus Lehtonen
On 04/01/2017, 17.43, "Mariano Lopez" wrote: > >On 28/12/16 07:02, Markus Lehtonen wrote: >> -def dict_to_XML(tag, dictionary): >> +def dict_to_XML(tag, dictionary, **kwargs): >> """ Return XML element converting dicts recursively. "&quo

Re: [OE-core] [PATCH 8/8] oeqa.utils.metadata: add bitbake revision information

2017-01-05 Thread Markus Lehtonen
On 04/01/2017, 17.45, "Mariano Lopez" wrote: >On 28/12/16 07:02, Markus Lehtonen wrote: >> [YOCTO #10590] >> >> Signed-off-by: Markus Lehtonen >> --- >> meta/lib/oeqa/utils/metadata.py | 32 +++- >> 1 file changed, 19

<    1   2   3   4   5   6   7   >