Re: [OE-core] [PATCH] lib/oe/rootfs: Fix DEBUGFS generation, without openssl

2016-06-01 Thread Martin Jansa
On Fri, May 20, 2016 at 11:01:01AM +0200, Anders Darander wrote: > In commit 20ea6d274bb0a9a5addb111f32793de49b907865, debugfs generation > for images using opkg, which included openssl was fixed. > > However, that broke the generation of the opkg-based images, that lacks > openssl. The error is a

Re: [OE-core] [oe-commits] [openembedded-core] branch master updated (bb4ead9 -> b746223)

2016-06-01 Thread Martin Jansa
On Mon, May 30, 2016 at 5:01 PM, wrote: > rpurdie pushed a change to branch master > in repository openembedded-core. > > > adds ac512ff libpam: update to 1.3.0 > . Maxim, you might want to check dependencies of libpam. In my bbappend for 1.2.1 (which still seems to be needed

Re: [OE-core] [oe-commits] [openembedded-core] branch master updated (bb4ead9 -> b746223)

2016-06-01 Thread Maxin B. John
Hi Martin, On Wed, Jun 01, 2016 at 01:06:08PM +0200, Martin Jansa wrote: >adds ac512ff libpam: update to 1.3.0 >. >Maxim, you might want to check dependencies of libpam. > >In my bbappend for 1.2.1 (which still seems to be needed for 1.3.0): ># Replace bison with bison-native, config

[OE-core] [PATCH 06/22] classes/lib: Update xrange -> range for python3

2016-06-01 Thread Richard Purdie
xrange() no longer exists in python 3, use range() Signed-off-by: Richard Purdie --- meta/classes/staging.bbclass| 2 +- meta/lib/oe/recipeutils.py | 4 ++-- meta/recipes-core/meta/uninative-tarball.bb | 2 +- meta/recipes-rt/rt-tests/files/rt_bmark.py | 2 +- s

[OE-core] [PATCH 02/22] classes/lib: Convert to use python3 octal syntax

2016-06-01 Thread Richard Purdie
The syntax for octal values changed in python3, adapt to it. Signed-off-by: Richard Purdie --- meta/classes/base.bbclass| 10 +- meta/classes/package_deb.bbclass | 4 ++-- meta/classes/package_ipk.bbclass | 2 +- meta/classes/package_rpm.bbclass | 6 +++--- meta/classes/sanity

[OE-core] [PATCH 13/22] scripts: Fix encoding errors for python3

2016-06-01 Thread Richard Purdie
From: Ed Bartosh Moved call of decode('utf-8') as close as possible to call of subprocess API to avoid calling it in a lot of other places. Decoded binary data to utf-8 where appropriate to fix devtool and recipetool tests in python 3 environment. Signed-off-by: Ed Bartosh Signed-off-by: Richa

[OE-core] [PATCH 07/22] sanity: Switch urlparse to urllib.parse

2016-06-01 Thread Richard Purdie
From: Jeremy Puhlman urlparse is replaced with urllib.parse functionality in python3 Signed-off-by: Jeremy Puhlman Signed-off-by: Richard Purdie --- meta/classes/sanity.bbclass | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/meta/classes/sanity.bbclass b/meta/classes

[OE-core] [PATCH 22/22] qemurunner: Use surrogateescape decoding

2016-06-01 Thread Richard Purdie
Since the stream can contain invalid binary characters (e.g. from ppc's bootloader) use surrogateescape decoding to ensure we do process the character stream, else it can hang/timeout. Signed-off-by: Richard Purdie --- meta/lib/oeqa/utils/qemurunner.py | 2 +- 1 file changed, 1 insertion(+), 1 d

[OE-core] [PATCH 05/22] classes/lib: Update to explictly create lists where needed

2016-06-01 Thread Richard Purdie
Iterators now return views, not lists in python3. Where we need lists, handle this explicitly. Signed-off-by: Richard Purdie --- meta/classes/buildhistory.bbclass | 2 +- meta/classes/license.bbclass | 2 +- meta/classes/package.bbclass | 4 +-- meta/lib/oe/classutils.py |

[OE-core] [PATCH 10/22] qemurunner: convert data when working with socket

2016-06-01 Thread Richard Purdie
From: Ed Bartosh Converted str to bytes before sending to socket. Converted bytes to str after receiving from socket. This should fix TypeError: 'str' does not support the buffer interface for qemurunner.run_serial method. Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- meta/lib/

[OE-core] [PATCH 04/22] classes/lib: Update to match python3 iter requirements

2016-06-01 Thread Richard Purdie
python3 standardises its use of iteration operations. Update the code to match the for python3 requires. Signed-off-by: Richard Purdie --- meta/classes/buildhistory.bbclass | 2 +- meta/classes/license.bbclass | 4 ++-- meta/classes/populate_sdk_ext.bbclass | 4 ++-- meta/lib/oe/bui

[OE-core] [PATCH 03/22] classes/lib: Update to use python3 command pipeline decoding

2016-06-01 Thread Richard Purdie
In python3, strings are unicode by default. We need to encode/decode from command pipelines and other places where we interface with the real world using the correct locales. This patch updates various call sites to use the correct encoding/decodings. Signed-off-by: Richard Purdie --- meta/class

[OE-core] [PATCH 01/22] oe-buildenv-internal: Update to python3

2016-06-01 Thread Richard Purdie
Check that 'python' is a python v2 since that is what we assume everywhere and upstream python devs recommend. We can need both python2 and python3 available since we don't control the software we might download and run. Also check that python 3 is >= 3.4.0, our minimum version for bitbake. Signe

[OE-core] [PATCH 21/22] oeqa/selftest/recipetool.py: Use regex to match warning line

2016-06-01 Thread Richard Purdie
From: Leonardo Sandoval We are observing cases (see below) where the 'WARNING:' prefix is not at the beginning of a line, so instead of expecting it in the beginning, match it with a regex. == FAIL: test_recipetool_appen

[OE-core] [PATCH 16/22] scripts: use python3 in shebang

2016-06-01 Thread Richard Purdie
From: Ed Bartosh As most of oe-test cases work for devtool and recipetool it makes sense to switch both tools to python 3 by explicitly referring to python3 in their shebangs. Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- scripts/devtool | 2 +- scripts/oe-pkgdata-util |

[OE-core] [PATCH 14/22] scripts: Rename ConfigParser -> configparser for python3

2016-06-01 Thread Richard Purdie
From: Ed Bartosh The ConfigParser API was renamed to configparser in python 3. Renamed ConfigParser -> configparser in scripts/ to make the code working in python 3. Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- scripts/combo-layer | 6 +++--- scripts

[OE-core] [PATCH 11/22] scripts: Fix deprecated dict methods for python3

2016-06-01 Thread Richard Purdie
From: Ed Bartosh Replaced iteritems -> items, itervalues -> values, iterkeys -> keys or 'in' Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- meta/lib/oe/recipeutils.py | 4 ++-- scripts/buildhistory-collect-srcrevs | 2 +- scripts/combo-layer

[OE-core] [PATCH 17/22] classes/lib: Complete transition to python3

2016-06-01 Thread Richard Purdie
This patch contains all the other misc pieces of the transition to python3 which didn't make sense to be broken into individual patches. Signed-off-by: Richard Purdie --- meta/classes/base.bbclass| 2 +- meta/classes/buildhistory.bbclass| 2 +- meta/classes/populate_sdk

[OE-core] [PATCH 15/22] scripts: Fix urlparse imports for python3

2016-06-01 Thread Richard Purdie
From: Ed Bartosh Used urllib.parse instead of urlparse to make code working in python 3. Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- scripts/lib/recipetool/create.py | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/scripts/lib/recipetool/create.py b/sc

[OE-core] [PATCH 08/22] wic: use python3 in shebang

2016-06-01 Thread Richard Purdie
From: Ed Bartosh Switched scripts/wic to use python3 as a default python interpreter. Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- scripts/wic | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/wic b/scripts/wic index 3d33430..5cc06f4 100755 --- a/scrip

[OE-core] [PATCH 18/22] selftest/devtool: Compare sets instead of arrays on AssertEqual

2016-06-01 Thread Richard Purdie
From: Leonardo Sandoval Sets are safer when comparing internal elements and positions are not important. This commit avoid errors observed on python3 builds as reported on the below bugzilla entry. [YOCTO #9661] Signed-off-by: Leonardo Sandoval Signed-off-by: Richard Purdie --- meta/lib/oeqa

[OE-core] [PATCH 20/22] devtool.py: Fix parsing of bitbake-layers' output

2016-06-01 Thread Richard Purdie
From: Leonardo Sandoval Current parsing was picking wrong targets, leading to the following problem: AssertionError: Command 'bitbake Parsing recipes..done. -e' returned non-zero exit status 1: Signed-off-by: Leonardo Sandoval Signed-off-by: Richard Purdie --- meta/lib/oeqa/selftes

[OE-core] [PATCH 12/22] scripts: Replace basestring -> str for python3

2016-06-01 Thread Richard Purdie
From: Ed Bartosh Python 3 doesn't have basestring type as all string are unicode strings. Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- meta/files/ext-sdk-prepare.py| 2 +- scripts/lib/devtool/__init__.py | 2 +- scripts/lib/recipetool/create

[OE-core] [PATCH 09/22] wic: encode help text

2016-06-01 Thread Richard Purdie
From: Ed Bartosh Encoded help text before sending it to pager.communicate as it expects binary. [YOCTO #9412] Signed-off-by: Ed Bartosh Signed-off-by: Richard Purdie --- scripts/lib/wic/help.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/scripts/lib/wic/help.py b/scri

[OE-core] [PATCH 19/22] buildhistory_analysis: Convert stream data (bytes) to strings

2016-06-01 Thread Richard Purdie
From: Leonardo Sandoval The bytes type variables are threat different as strings variables in python3, so convert bytes to strings. This was found when using the script buildhistory-diff, where the interpreter was yielding this error TypeError: Type str doesn't support the buffer API Signed

[OE-core] [PATCH] libsdl2: Fix build with wayland 1.10

2016-06-01 Thread Martin Jansa
Signed-off-by: Martin Jansa --- ...ideo-make-it-compatible-with-wayland-1.10.patch | 57 ++ meta/recipes-graphics/libsdl2/libsdl2_2.0.4.bb | 4 +- 2 files changed, 60 insertions(+), 1 deletion(-) create mode 100644 meta/recipes-graphics/libsdl2/libsdl2/0001-src-video-ma

[OE-core] [PATCH 2/2] libpam: update dependency list

2016-06-01 Thread Maxin B. John
Depend only on bison-native as configure script is checking only for bison binary and libpam itself doesn't need target bison. Add libxml2-native for deterministic build (it detects xmlcatalog and xmllint) Signed-off-by: Martin Jansa Signed-off-by: Maxin B. John --- meta/recipes-extended/pam/l

[OE-core] [PATCH 1/2] iw: update to version 4.7

2016-06-01 Thread Maxin B. John
4.3 -> 4.7 Refreshed the patch for new version: 1) 0001-iw-version.sh-don-t-use-git-describe-for-versioning.patch Signed-off-by: Maxin B. John --- sh-don-t-use-git-describe-for-versioning.patch | 42 -- .../iw/{iw_4.3.bb => iw_4.7.bb}| 4 +-- 2 f

Re: [OE-core] [PATCH 01/22] oe-buildenv-internal: Update to python3

2016-06-01 Thread Randle, William C
On Wed, 2016-06-01 at 13:35 +0100, Richard Purdie wrote: > Check that 'python' is a python v2 since that is what we assume everywhere > and upstream python devs recommend. We can need both python2 and python3 > available since we don't control the software we might download and run. > > Also check

Re: [OE-core] [PATCH 01/22] oe-buildenv-internal: Update to python3

2016-06-01 Thread Christopher Larson
On Wed, Jun 1, 2016 at 5:35 AM, Richard Purdie < richard.pur...@linuxfoundation.org> wrote: > Check that 'python' is a python v2 since that is what we assume everywhere > and upstream python devs recommend. We can need both python2 and python3 > available since we don't control the software we mig

Re: [OE-core] [PATCH 20/22] devtool.py: Fix parsing of bitbake-layers' output

2016-06-01 Thread Christopher Larson
On Wed, Jun 1, 2016 at 5:35 AM, Richard Purdie < richard.pur...@linuxfoundation.org> wrote: > From: Leonardo Sandoval > > Current parsing was picking wrong targets, leading to the following > problem: > > AssertionError: Command 'bitbake Parsing recipes..done. -e' > returned non-zero exi

Re: [OE-core] [PATCH] lib/oe/rootfs: Fix DEBUGFS generation, without openssl

2016-06-01 Thread Anders Darander
* Martin Jansa [160601 12:00]: > On Fri, May 20, 2016 at 11:01:01AM +0200, Anders Darander wrote: > > In commit 20ea6d274bb0a9a5addb111f32793de49b907865, debugfs generation > > for images using opkg, which included openssl was fixed. > > However, that broke the generation of the opkg-based image

[OE-core] [PATCH 3/5] testexport-tarball.bb: Add recipe

2016-06-01 Thread mariano . lopez
From: Mariano Lopez This new recipe is used when exporting runtime test outside packages that won't be installed in the testing system but are required for the runtime testing. This new recipe is almost identical to buildtools-tarball, but is able to define the SDK packages in local.conf. [YOCT

[OE-core] [PATCH 0/5] Enable installation of packages in DUT

2016-06-01 Thread mariano . lopez
From: Mariano Lopez This series enable the functionality to install packages in the DUT during runtime testing. Such packages must had been build previously by bitbake and the packages are specified using a JSON file. This functionality works with testimage and with testexport. This address the

[OE-core] [PATCH 2/5] testimage.bbclass: Make dependency of cpio when using RPMs

2016-06-01 Thread mariano . lopez
From: Mariano Lopez Exctraction of RPMs needs cpio, not all distros include cpio by default, so we need to build it. [YOCTO #8694] Signed-off-by: Mariano Lopez --- meta/classes/testexport.bbclass | 1 + meta/classes/testimage.bbclass | 2 ++ 2 files changed, 3 insertions(+) diff --git a/met

[OE-core] [PATCH 1/5] oetest.py: Add install/uninstall functionality for DUTs

2016-06-01 Thread mariano . lopez
From: Mariano Lopez Add the functionality to install/unistall packages in the DUTs without the use of the package manager. This is possible with the extraction introduced in the previous commits. testimage and testexport bbclasses has been modified in order to support this new feature. [YOCTO #

[OE-core] [PATCH 4/5] testexport.bbclass: Add support for testexport-tarball

2016-06-01 Thread mariano . lopez
From: Mariano Lopez Add support to export the SDK tarball needed when a test system doesn't have the required software to perform runtime tests. The support is when exporting the test and when running the test on a remote system. The user of this feature just need to set TEST_EXPORT_SDK_ENABLED

[OE-core] [PATCH 5/5] testexport.bbclass: Create tarballs for easy release

2016-06-01 Thread mariano . lopez
From: Mariano Lopez This create tarballs in the testexport directory in order to make easier to distribute the test in another systems. There are three tarballs, one for the metadata that is not arch dependant, another for packages needed by the DUT (this depends of target MACHINE), and the last

[OE-core] [PATCH] syslinux.bbclass: Added configurable SYSLINUX_ALLOWOPTIONS variable

2016-06-01 Thread Davis, Michael
The new variable allows for images to be created without an editable boot line in syslinux. Default behavior remains unchanged. Signed-off-by: Michael Davis --- meta/classes/syslinux.bbclass | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/meta/classes/syslinux.bbclass

Re: [OE-core] [PATCH 01/22] oe-buildenv-internal: Update to python3

2016-06-01 Thread Richard Purdie
On Wed, 2016-06-01 at 08:35 -0700, Christopher Larson wrote: > > On Wed, Jun 1, 2016 at 5:35 AM, Richard Purdie < > richard.pur...@linuxfoundation.org> wrote: > > Check that 'python' is a python v2 since that is what we assume > > everywhere > > and upstream python devs recommend. We can need both

Re: [OE-core] [PATCH 01/22] oe-buildenv-internal: Update to python3

2016-06-01 Thread Christopher Larson
On Wed, Jun 1, 2016 at 1:57 PM, Richard Purdie < richard.pur...@linuxfoundation.org> wrote: > On Wed, 2016-06-01 at 08:35 -0700, Christopher Larson wrote: > > > > On Wed, Jun 1, 2016 at 5:35 AM, Richard Purdie < > > richard.pur...@linuxfoundation.org> wrote: > > > Check that 'python' is a python v

Re: [OE-core] [PATCH 02/22] classes/lib: Convert to use python3 octal syntax

2016-06-01 Thread Christopher Larson
On Wed, Jun 1, 2016 at 5:35 AM, Richard Purdie < richard.pur...@linuxfoundation.org> wrote: > diff --git a/meta/classes/base.bbclass b/meta/classes/base.bbclass > index 4be0a7e..1ba1222 100644 > --- a/meta/classes/base.bbclass > +++ b/meta/classes/base.bbclass > @@ -456,15 +456,15 @@ python () { >

Re: [OE-core] [PATCH] ca-certificates: Add openssl as a runtime dependency

2016-06-01 Thread Paul Eggleton
On Mon, 30 May 2016 22:57:52 Richard Purdie wrote: > On Fri, 2016-05-27 at 07:28 -0300, Otavio Salvador wrote: > > The update-ca-certificates script uses the c_rehash utility which is > > installed by openssl. Add openssl as a runtime dependency to fulfill > > the utility requirement. > > > > Sign