Sean Owen beat me to (strongly) recommending running zinc server. Using the -pl option is great too - but be careful to only use it when your work is restricted to the modules in the (comma separated) list you provide to -pl. Also before using -pl you should do a mvn compile package install on all modules. Use the -pl after those steps are done - and then it is very effective.
2014-10-24 13:08 GMT-07:00 Sean Owen <so...@cloudera.com>: > On Fri, Oct 24, 2014 at 8:59 PM, Koert Kuipers <ko...@tresata.com> wrote: > > "mvn clean package -DskipTests" takes about 30 mins for me. thats painful > > since its needed for the tests. does anyone know any tricks to speed it > up? > > (besides getting a better laptop). does zinc help? > > Zinc helps by about 50-100%. Worthwhile for sure. brew install zinc > and zinc -start > > > mvn test runs through the projects until one fails. then it skips the > rest! > > since its very likely that i get a failure in some subproject, this means > > its nearly impossible to do a general test run and get a good sense of > the > > status of the project. for example: > > You can mvn test -pl [module] to test just one module. > It will also indicate to you that after a failure you can mvn test -rf > :[module] to continue where it left off -- you can use this to resume > at the next module. > > Or try "-Dscalatest.testFailureIgnore=true" if the mvn flags > themselves don't work, for continuing after a test failure. > > > [INFO] > > ------------------------------------------------------------------------ > > [INFO] Reactor Summary: > > [INFO] > > [INFO] Spark Project Parent POM .......................... SUCCESS > [2.199s] > > [INFO] Spark Project Core ................................ SUCCESS > > [39:43.028s] > > [INFO] Spark Project Bagel ............................... SUCCESS > [42.569s] > > [INFO] Spark Project GraphX .............................. SUCCESS > > [3:22.104s] > > [INFO] Spark Project Streaming ........................... SUCCESS > > [7:12.592s] > > [INFO] Spark Project ML Library .......................... SUCCESS > > [10:32.682s] > > [INFO] Spark Project Tools ............................... SUCCESS > [17.070s] > > [INFO] Spark Project Catalyst ............................ SUCCESS > > [3:03.470s] > > [INFO] Spark Project SQL ................................. SUCCESS > > [5:23.993s] > > [INFO] Spark Project Hive ................................ FAILURE > > [2:08.387s] > > [INFO] Spark Project REPL ................................ SKIPPED > > [INFO] Spark Project Assembly ............................ SKIPPED > > [INFO] Spark Project External Twitter .................... SKIPPED > > [INFO] Spark Project External Kafka ...................... SKIPPED > > [INFO] Spark Project External Flume Sink ................. SKIPPED > > [INFO] Spark Project External Flume ...................... SKIPPED > > [INFO] Spark Project External ZeroMQ ..................... SKIPPED > > [INFO] Spark Project External MQTT ....................... SKIPPED > > [INFO] Spark Project Examples ............................ SKIPPED > > > > in this case i dont care about Hive, but i would have liked to see REPL > > run, and Kafka. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
