Re: [yocto] Very strange issue where bitbake hangs at do_rootfs

2017-05-26 Thread Chris Z. 
Hi,

Have you tried to find on which syscall it hangs ?  sysdig or strace ?

Maybe it's issue with python subprocess, documentation mention that
subprocess can deadlock or hang with large data and no read from pipe
is done.

Br,
Chris Z

On Fri, May 26, 2017 at 11:35 PM, Andrei Gherzan  wrote:
> On Fri, May 26, 2017 at 5:19 PM, Khem Raj  wrote:
>>
>> On Fri, May 26, 2017 at 5:52 AM, Andrei Gherzan  wrote:
>> > Hello all,
>> >
>> > I moved recently on a new arch linux host and everything works fine with
>> > one
>> > exception: when I build a custom distribution based on morty with many
>> > packages including kernel-modules (beaglebone), the build system hangs
>> > without any details. I hooked into package_manager.py RPM install and
>> > streamed output from `process = subprocess.Popen(cmd.split(),
>> > stderr=subprocess.STDOUT, stdout=subprocess.PIPE)` and it seems that it
>> > hangs in different places every time. Output example:
>> >
>> > ---
>> >
>> > Result of kernel-module-industrialio-sw-trigger postinst: 0
>> > debug: Processing
>> > kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b@beaglebone in
>> >
>> > /work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rpms/beaglebone/kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b.beaglebone.rpm
>> > 1428:Installing kernel-module.. 
>> > [
>> > 55%]
>> > Output from kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b@beaglebone:
>> > Executing kernel-module-lm8333 postinst with: /bin/sh
>> >
>> > /work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rootfs///oe_install/tmp/rpm-tmp.76459
>> > 1
>> >
>> > # kernel-module-lm8333 - postinst
>> > #!/bin/sh
>> > if [ -z "$D" ]; then
>> > depmod -a 4.4.55+
>> > else
>> > # image.bbclass will call depmodwrapper after everything is
>> > installed,
>> > # no need to do it here as well
>> > :
>> > fi
>> > Result of kernel-module-lm8333 postinst: 0
>> > debug: Processing
>> > kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b@beaglebone in
>> >
>> > /work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rpms/beaglebone/kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b.beaglebone.rpm
>> > 1429:Installing kernel-module.. 
>> > [
>> > 55%]
>> > Output from
>> > kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b@beaglebone:
>> > Executing kernel-module-tca8418-keypad postinst with: /bin/sh
>> >
>> > /work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rootfs///oe_install/tmp/rpm-tmp.76459
>> > 1
>> >
>> > ---
>> >
>> > If I don't install kernel-modules build succeeds.
>> >
>> > Any hints on how to debug this further? I can't seem to find anything
>> > relevant in smart output.
>> >
>>
>> yeah rolling ditros are always intesting when you want to build fixed
>> releases from past.
>> one of things that helped me in past was to pin python3 to 3.5 but a
>> clean reinstall of arch
>> I got that problem solved automagically
>
>
> Downgraded to 3.5 and didn't help sadly.
>
> Regards,
> Andrei
>
>
> --
> ___
> yocto mailing list
> yocto@yoctoproject.org
> https://lists.yoctoproject.org/listinfo/yocto
>
-- 
___
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto

Re: [yocto] Very strange issue where bitbake hangs at do_rootfs

2017-05-26 Thread Andrei Gherzan 
On Fri, May 26, 2017 at 5:19 PM, Khem Raj  wrote:

> On Fri, May 26, 2017 at 5:52 AM, Andrei Gherzan  wrote:
> > Hello all,
> >
> > I moved recently on a new arch linux host and everything works fine with
> one
> > exception: when I build a custom distribution based on morty with many
> > packages including kernel-modules (beaglebone), the build system hangs
> > without any details. I hooked into package_manager.py RPM install and
> > streamed output from `process = subprocess.Popen(cmd.split(),
> > stderr=subprocess.STDOUT, stdout=subprocess.PIPE)` and it seems that it
> > hangs in different places every time. Output example:
> >
> > ---
> >
> > Result of kernel-module-industrialio-sw-trigger postinst: 0
> > debug: Processing
> > kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b@beaglebone in
> > /work/resin/resinos/resin-beaglebone/build/tmp/work/
> beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rpms/
> beaglebone/kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b.beaglebone.rpm
> > 1428:Installing kernel-module.. 
> [
> > 55%]
> > Output from kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b@beaglebone:
> > Executing kernel-module-lm8333 postinst with: /bin/sh
> > /work/resin/resinos/resin-beaglebone/build/tmp/work/
> beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rootfs///
> oe_install/tmp/rpm-tmp.76459
> > 1
> >
> > # kernel-module-lm8333 - postinst
> > #!/bin/sh
> > if [ -z "$D" ]; then
> > depmod -a 4.4.55+
> > else
> > # image.bbclass will call depmodwrapper after everything is
> > installed,
> > # no need to do it here as well
> > :
> > fi
> > Result of kernel-module-lm8333 postinst: 0
> > debug: Processing
> > kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b@beaglebone in
> > /work/resin/resinos/resin-beaglebone/build/tmp/work/
> beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rpms/
> beaglebone/kernel-module-tca8418-keypad-4.4.55+git0+
> 903eb64c68-r22b.beaglebone.rpm
> > 1429:Installing kernel-module.. 
> [
> > 55%]
> > Output from
> > kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b@beaglebone:
> > Executing kernel-module-tca8418-keypad postinst with: /bin/sh
> > /work/resin/resinos/resin-beaglebone/build/tmp/work/
> beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rootfs///
> oe_install/tmp/rpm-tmp.76459
> > 1
> >
> > ---
> >
> > If I don't install kernel-modules build succeeds.
> >
> > Any hints on how to debug this further? I can't seem to find anything
> > relevant in smart output.
> >
>
> yeah rolling ditros are always intesting when you want to build fixed
> releases from past.
> one of things that helped me in past was to pin python3 to 3.5 but a
> clean reinstall of arch
> I got that problem solved automagically
>

Downgraded to 3.5 and didn't help sadly.

Regards,
Andrei
-- 
___
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto

[yocto] Very strange issue where bitbake hangs at do_rootfs

2017-05-26 Thread Andrei Gherzan 
Hello all,

I moved recently on a new arch linux host and everything works fine with
one exception: when I build a custom distribution based on morty with many
packages including kernel-modules (beaglebone), the build system hangs
without any details. I hooked into package_manager.py RPM install and
streamed output from `process = subprocess.Popen(cmd.split(),
stderr=subprocess.STDOUT, stdout=subprocess.PIPE)` and it seems that it
hangs in different places every time. Output example:

---

Result of kernel-module-industrialio-sw-trigger postinst: 0
debug: Processing
kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b@beaglebone in
/work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rpms/beaglebone/kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b.beaglebone.rpm
1428:Installing kernel-module..  [
55%]
Output from kernel-module-lm8333-4.4.55+git0+903eb64c68-r22b@beaglebone:
Executing kernel-module-lm8333 postinst with: /bin/sh
/work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rootfs///oe_install/tmp/rpm-tmp.76459
1

# kernel-module-lm8333 - postinst
#!/bin/sh
if [ -z "$D" ]; then
depmod -a 4.4.55+
else
# image.bbclass will call depmodwrapper after everything is
installed,
# no need to do it here as well
:
fi
Result of kernel-module-lm8333 postinst: 0
debug: Processing
kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b@beaglebone in
/work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rpms/beaglebone/kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b.beaglebone.rpm
1429:Installing kernel-module..  [
55%]
Output from
kernel-module-tca8418-keypad-4.4.55+git0+903eb64c68-r22b@beaglebone:
Executing kernel-module-tca8418-keypad postinst with: /bin/sh
/work/resin/resinos/resin-beaglebone/build/tmp/work/beaglebone-poky-linux-gnueabi/resin-image/1.0-r0/rootfs///oe_install/tmp/rpm-tmp.76459
1

---

If I don't install kernel-modules build succeeds.

Any hints on how to debug this further? I can't seem to find anything
relevant in smart output.


--
Andrei Gherzan
-- 
___
yocto mailing list
yocto@yoctoproject.org
https://lists.yoctoproject.org/listinfo/yocto