Hello Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/14562
to look at the new patch set (#5).
Change subject: IMPALA-9107: Add toolchain maven cache to speed up maven builds
......................................................................
IMPALA-9107: Add toolchain maven cache to speed up maven builds
The maven build downloads a large number of artifacts from
various maven repositories. When starting with an empty .m2
directory (like most upstream Jenkins jobs), downloading
all the artifacts can take up to 30 minutes. This has been
slowing down our precommit builds by 15-20 minutes.
This adds a mode to download a tarball from the toolchain,
unpack it, and use it as a maven repository. The tarball is
constructed by doing a fresh Impala build with an empty .m2
directory, removing locations that should come from
impala.cdp.repo or impala.cdh.repo, then packing that into
a tarball.
The tarball is currently around 240MB and unpacks to about
309MB, so the space requirement is fairly modest. The jars
in the toolchain maven cache are copied to the .m2 directory,
so the toolchain maven cache can be removed/replaced without
impacting a running cluster.
Testing:
- Local testing shows a substantially faster build with an
empty .m2 directory.
- Ran gerrit-verify-dryrun-external and the jobs took about
15-20 minutes less.
Change-Id: I043912f5fbc7cf24ee80b2855354656aa587ca9f
---
M bin/bootstrap_toolchain.py
M bin/impala-config.sh
M bin/mvn-quiet.sh
M impala-parent/pom.xml
4 files changed, 122 insertions(+), 25 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/62/14562/5
--
To view, visit http://gerrit.cloudera.org:8080/14562
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I043912f5fbc7cf24ee80b2855354656aa587ca9f
Gerrit-Change-Number: 14562
Gerrit-PatchSet: 5
Gerrit-Owner: Joe McDonnell <joemcdonn...@cloudera.com>
Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Gerrit-Reviewer: Joe McDonnell <joemcdonn...@cloudera.com>
