* James McCoy <james...@debian.org>, 2013-11-20 00:58:
On Mon, Nov 04, 2013 at 10:12:45PM -0300, Lisandro Damián Nicanor Pérez Meyer
wrote:
Since gcc became mor everbose on it builds it's not strange to find
enourmous build logs (200+MB).
It would be really cool if getbuildlog could get the compressed
buildlog to save bandwith.
You may want to give pkgkde-getbuildlogs (from pkg-kde-tools) a try: it
requests compressed responses and (IMHO) has a nicer API.
As far as I know, there isn't a "compressed buildlog" available. We
could change our wget call to specify "Accept-Encoding: deflate, gzip"
Yup, that should be a matter of passing --compress=auto to wget.
but that relies on the server being configured to offer compression.
buildd.debian.org supports it. :) That said, it seems it compresses the
logs on the fly, which slows down things significantly. For example:
$
url='https://buildd.debian.org/status/fetch.php?pkg=gcc-12&arch=i386&ver=12.3.0-13&stamp=1702656593&raw=1'
$ wget "$url" -O /dev/null
--2024-01-17 13:53:58--
https://buildd.debian.org/status/fetch.php?pkg=gcc-12&arch=i386&ver=12.3.0-13&stamp=1702656593&raw=1
Resolving buildd.debian.org (buildd.debian.org)... 2607:f8f0:614:1::1274:60,
209.87.16.60
Connecting to buildd.debian.org
(buildd.debian.org)|2607:f8f0:614:1::1274:60|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/plain]
Saving to: ‘/dev/null’
/dev/null [ <=> ] 48.09M 15.6MB/s in 3.4s
2024-01-17 13:54:02 (14.2 MB/s) - ‘/dev/null’ saved [50423419]
$ wget --compress=auto "$url" -O /dev/null
--2024-01-17 13:54:08--
https://buildd.debian.org/status/fetch.php?pkg=gcc-12&arch=i386&ver=12.3.0-13&stamp=1702656593&raw=1
Resolving buildd.debian.org (buildd.debian.org)... 2607:f8f0:614:1::1274:60,
209.87.16.60
Connecting to buildd.debian.org
(buildd.debian.org)|2607:f8f0:614:1::1274:60|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/plain]
Saving to: ‘/dev/null’
/dev/null [ <=> ] 2.70M 1.05MB/s in 2.6s
2024-01-17 13:54:12 (1.05 MB/s) - ‘/dev/null’ saved [50423419]
The compressed log was ~18 times smaller, but the download took only 25%
less time. It's not clear --compress=auto is always going be a net
benefit.
--
Jakub Wilk
