Joe McDonnell has uploaded a new patch set (#9). ( http://gerrit.cloudera.org:8080/14562 )
Change subject: IMPALA-9107 (part 1): Add scripts to produce an m2 archive ...................................................................... IMPALA-9107 (part 1): Add scripts to produce an m2 archive The maven build downloads a large number of artifacts from various maven repositories. When starting with an empty .m2 directory (like most upstream Jenkins jobs), downloading all the artifacts can take up to 30 minutes. This has been slowing down our precommit builds by 15-20 minutes. This adds a script to archive the .m2 directory into a tarball while excluding artifacts from impala.cdp.repo and impala.cdh.repo. This will later be used to prepopulate the .m2 directory for Jenkins jobs. This adds a script to parse the maven log and output how many maven artifacts are downloaded from each repository. It also prints how many downloads were attempted for each repository. This might aid in diagnosing slowness. This also changes mvn-quiet.sh to add logging that prints a timestamp. It also adds the -B flag to mvn, which causes maven to run in batch mode. This makes the output easier to parse, because maven omits special console formatting characters such as ^M (carriange return). This changes build-all-flag-combinations.sh to print the maven statistics after each part of the build and call the script to produce an m2 archive at the end. Change-Id: I043912f5fbc7cf24ee80b2855354656aa587ca9f --- A bin/jenkins/archive_m2_directory.sh M bin/jenkins/build-all-flag-combinations.sh A bin/jenkins/get_maven_statistics.sh M bin/mvn-quiet.sh M impala-parent/pom.xml 5 files changed, 137 insertions(+), 1 deletion(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/62/14562/9 -- To view, visit http://gerrit.cloudera.org:8080/14562 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I043912f5fbc7cf24ee80b2855354656aa587ca9f Gerrit-Change-Number: 14562 Gerrit-PatchSet: 9 Gerrit-Owner: Joe McDonnell <joemcdonn...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Joe McDonnell <joemcdonn...@cloudera.com> Gerrit-Reviewer: Tim Armstrong <tarmstr...@cloudera.com>