thanks everyone, very helpful On Fri, Oct 24, 2014 at 4:22 PM, Stephen Boesch <java...@gmail.com> wrote:
> Sean Owen beat me to (strongly) recommending running zinc server. Using > the -pl option is great too - but be careful to only use it when your work > is restricted to the modules in the (comma separated) list you provide to > -pl. Also before using -pl you should do a mvn compile package install > on all modules. Use the -pl after those steps are done - and then it is > very effective. > > 2014-10-24 13:08 GMT-07:00 Sean Owen <so...@cloudera.com>: > >> On Fri, Oct 24, 2014 at 8:59 PM, Koert Kuipers <ko...@tresata.com> wrote: >> > "mvn clean package -DskipTests" takes about 30 mins for me. thats >> painful >> > since its needed for the tests. does anyone know any tricks to speed it >> up? >> > (besides getting a better laptop). does zinc help? >> >> Zinc helps by about 50-100%. Worthwhile for sure. brew install zinc >> and zinc -start >> >> > mvn test runs through the projects until one fails. then it skips the >> rest! >> > since its very likely that i get a failure in some subproject, this >> means >> > its nearly impossible to do a general test run and get a good sense of >> the >> > status of the project. for example: >> >> You can mvn test -pl [module] to test just one module. >> It will also indicate to you that after a failure you can mvn test -rf >> :[module] to continue where it left off -- you can use this to resume >> at the next module. >> >> Or try "-Dscalatest.testFailureIgnore=true" if the mvn flags >> themselves don't work, for continuing after a test failure. >> >> > [INFO] >> > ------------------------------------------------------------------------ >> > [INFO] Reactor Summary: >> > [INFO] >> > [INFO] Spark Project Parent POM .......................... SUCCESS >> [2.199s] >> > [INFO] Spark Project Core ................................ SUCCESS >> > [39:43.028s] >> > [INFO] Spark Project Bagel ............................... SUCCESS >> [42.569s] >> > [INFO] Spark Project GraphX .............................. SUCCESS >> > [3:22.104s] >> > [INFO] Spark Project Streaming ........................... SUCCESS >> > [7:12.592s] >> > [INFO] Spark Project ML Library .......................... SUCCESS >> > [10:32.682s] >> > [INFO] Spark Project Tools ............................... SUCCESS >> [17.070s] >> > [INFO] Spark Project Catalyst ............................ SUCCESS >> > [3:03.470s] >> > [INFO] Spark Project SQL ................................. SUCCESS >> > [5:23.993s] >> > [INFO] Spark Project Hive ................................ FAILURE >> > [2:08.387s] >> > [INFO] Spark Project REPL ................................ SKIPPED >> > [INFO] Spark Project Assembly ............................ SKIPPED >> > [INFO] Spark Project External Twitter .................... SKIPPED >> > [INFO] Spark Project External Kafka ...................... SKIPPED >> > [INFO] Spark Project External Flume Sink ................. SKIPPED >> > [INFO] Spark Project External Flume ...................... SKIPPED >> > [INFO] Spark Project External ZeroMQ ..................... SKIPPED >> > [INFO] Spark Project External MQTT ....................... SKIPPED >> > [INFO] Spark Project Examples ............................ SKIPPED >> > >> > in this case i dont care about Hive, but i would have liked to see REPL >> > run, and Kafka. >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> For additional commands, e-mail: dev-h...@spark.apache.org >> >> >
