[ https://issues.apache.org/jira/browse/CASSANDRA-14985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16745246#comment-16745246 ]
Stefan Podkowinski commented on CASSANDRA-14985: ------------------------------------------------ The maven dependencies should be pulled only once by the single CI "build" step and persisted to the workspace, before spawning the parallel containers. But it just does this for the version that is to be tested. I also get why github would block us for downloading 200x cassandra distributions in parallel. Can you create a separate Dockerfile with your added steps that is based on the one we used so far (referred to by {{From}})? I'd like to avoid unintentionally upgrading packages in the base image, in case you just want to update maven/ccm deps. Also collapsing run commands, using multi-line arguments, should prevent creating a new layer for every line and make them more readable. On the long run, we should probably give the CircleCI [caching feature|https://circleci.com/docs/2.0/caching/] a try, after CASSANDRA-14806 was merged. > CircleCI docker image should bake in more dependencies > -------------------------------------------------------- > > Key: CASSANDRA-14985 > URL: https://issues.apache.org/jira/browse/CASSANDRA-14985 > Project: Cassandra > Issue Type: Test > Components: Test/dtest, Test/unit > Reporter: Ariel Weisberg > Assignee: Ariel Weisberg > Priority: Major > Fix For: 4.0 > > > It's pretty frequent especially in the upgrade tests for either maven or > github to fail. I think they are detecting the thundering herd of containers > all pulling stuff at the same time and opting out. > We can reduce this especially for maven dependencies since most are hardly > ever changing by downloading everything we can in advance and baking it into > the image. > When building the docker image Initialize the local maven repository by > running ant maven-ant-tasks-retrieve-build for 2.1-trunk and do the same with > CCM and the Apache repository. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org