Bug#986684: qtwebengine-opensource-src: does not honour DEB_BUILD_OPTIONS=parallel=3 when calling ninja

2021-04-12 Thread Lisandro Damián Nicanor Pérez Meyer
Hi!

On Fri, 9 Apr 2021 at 09:51, Andreas Beckmann  wrote:
>
> Source: qtwebengine-opensource-src
> Version: 5.15.3+dfsg-5
> Severity: important
>
> Hi,
>
> I'm not sure whether this a an error of qtwebengine-opensource-src or
> rather some underlying build tools it uses, please reassign if needed.
> I think that happens with other qt packages as well, but I haven't
> checked in detail

No, if anything it's a bug in [qt]webengine itself. The rest of the
packages honor the parameter, I know for sure because I have been
neddling with them all my life to be able to build the packages in
very limited setups.

-- 
Lisandro Damián Nicanor Pérez Meyer
http://perezmeyer.com.ar/
http://perezmeyer.blogspot.com/



Bug#986684: qtwebengine-opensource-src: does not honour DEB_BUILD_OPTIONS=parallel=3 when calling ninja

2021-04-09 Thread Andreas Beckmann
Source: qtwebengine-opensource-src
Version: 5.15.3+dfsg-5
Severity: important

Hi,

I'm not sure whether this a an error of qtwebengine-opensource-src or
rather some underlying build tools it uses, please reassign if needed.
I think that happens with other qt packages as well, but I haven't
checked in detail

While rebuilding experimental I just found again some excessive load:

1234  3192  0.0  0.0   2560  1336 pts/18   SN+  08:24   0:00 /bin/sh
1234  1938  0.0  0.0  15220 10196 pts/18   SN+  11:56   0:00 /usr/bin/perl 
/usr/bin/dpkg-buildpackage -us -uc
1234  3977  0.0  0.0   2708  1932 pts/18   SN+  12:28   0:00 /usr/bin/make 
-f debian/rules build
1234  4485  0.0  0.0  13856  9892 pts/18   SN+  12:28   0:00 /usr/bin/perl 
/usr/bin/dh build --with pkgkde_symbolshelper
1234 6  0.0  0.0   2844  1928 pts/18   SN+  12:28   0:00 /usr/bin/make 
-f debian/rules override_dh_auto_build-arch
1234 12149  0.0  0.0  13760  9980 pts/18   SN+  12:28   0:00 /usr/bin/perl 
/usr/bin/dh_auto_build -- -Onone
1234 12325  0.0  0.0   4124  3408 pts/18   SN+  12:28   0:00 make -j3 -Onone
1234 12438  0.0  0.0   2568   536 pts/18   SN+  12:28   0:00 /bin/sh -c cd 
src/ && ( test -e Makefile || /usr/lib/qt5/bin/qmake -o Makefile 
/build/qtwebengine-opensource-src-5.15.3+dfsg/src/src.pro QT_BUILD_PARTS+=tests 
'QMAKE_EXTRA_ARGS+=-proprietary-cod
1234 12459  0.0  0.0   4316  3456 pts/18   SN+  12:28   0:00 make -f 
Makefile
1234 14230  0.0  0.0   2568   540 pts/18   SN+  12:28   0:00 /bin/sh -c cd 
core/ && ( test -e Makefile || /usr/lib/qt5/bin/qmake -o Makefile 
/build/qtwebengine-opensource-src-5.15.3+dfsg/src/core/core.pro 
QT_BUILD_PARTS+=tests 'QMAKE_EXTRA_ARGS+=-propriet
1234 14236  0.0  0.0   4148  3420 pts/18   SN+  12:28   0:00 make -f 
Makefile
1234 15330  0.0  0.0   2568   524 pts/18   SN+  12:28   0:00 /bin/sh -c ( 
test -e Makefile.gn_run || /usr/lib/qt5/bin/qmake -o Makefile.gn_run 
/build/qtwebengine-opensource-src-5.15.3+dfsg/src/core/gn_run.pro 
QT_BUILD_PARTS+=tests 'QMAKE_EXTRA_ARGS+=-prop
1234 15343  0.0  0.0   4116  3332 pts/18   SN+  12:28   0:00 make -f 
Makefile.gn_run
1234  4179  0.2  0.4 278576 269500 pts/18  SN+  12:28   0:12 ninja -v -C 
/build/qtwebengine-opensource-src-5.15.3+dfsg/src/core/release QtWebEngineCore

ninja(4179)─┬─sh(7105)───g++(7108)─┬─as(7110)
│  └─cc1plus(7109)
├─sh(10106)───g++(10110)─┬─as(10114)
│└─cc1plus(10112)
├─sh(11878)───g++(11880)─┬─as(11884)
│└─cc1plus(11883)
├─sh(12229)───g++(12230)─┬─as(12232)
│└─cc1plus(12231)
├─sh(12532)───g++(12533)─┬─as(12535)
│└─cc1plus(12534)
├─sh(14164)───g++(14165)─┬─as(14173)
│└─cc1plus(14169)
├─sh(14519)───g++(14521)─┬─as(14526)
│└─cc1plus(14525)
├─sh(14843)───g++(14844)─┬─as(14847)
│└─cc1plus(14845)
├─sh(15375)───g++(15377)─┬─as(15380)
│└─cc1plus(15378)
├─sh(16167)───g++(16168)─┬─as(16171)
│└─cc1plus(16169)
├─sh(17887)───g++(17891)─┬─as(17896)
│└─cc1plus(17892)
├─sh(17894)───g++(17895)─┬─as(17904)
│└─cc1plus(17903)
├─sh(18172)───g++(18173)─┬─as(18176)
│└─cc1plus(18174)
├─sh(19554)───g++(19556)─┬─as(19559)
│└─cc1plus(19557)
├─sh(20054)───g++(20055)─┬─as(20059)
│└─cc1plus(20057)
├─sh(20247)───g++(20248)─┬─as(20253)
│└─cc1plus(20249)
├─sh(21800)───g++(21801)─┬─as(21807)
│└─cc1plus(21804)
└─sh(21931)───g++(21933)─┬─as(21942)
 └─cc1plus(21937)

The build starts nicely honoring the DEB_BUILD_OPTIONS=parallel=3 until
ninja gets invoked without a limiting -j option, so it forks off
$(nproc)+x processes (nproc is 16, but there are 18 forks).
And 18 g++ compilations each taking 1GB+ of memory is not a nice background 
load.

Andreas