On Fri, Oct 24, 2014 at 8:59 PM, Koert Kuipers <ko...@tresata.com> wrote:
> "mvn clean package -DskipTests" takes about 30 mins for me. thats painful
> since its needed for the tests. does anyone know any tricks to speed it up?
> (besides getting a better laptop). does zinc help?

Zinc helps by about 50-100%. Worthwhile for sure. brew install zinc
and zinc -start

> mvn test runs through the projects until one fails. then it skips the rest!
> since its very likely that i get a failure in some subproject, this means
> its nearly impossible to do a general test run and get a good sense of the
> status of the project. for example:

You can mvn test -pl [module] to test just one module.
It will also indicate to you that after a failure you can mvn test -rf
:[module] to continue where it left off -- you can use this to resume
at the next module.

Or try "-Dscalatest.testFailureIgnore=true" if the mvn flags
themselves don't work, for continuing after a test failure.

> [INFO]
> ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Spark Project Parent POM .......................... SUCCESS [2.199s]
> [INFO] Spark Project Core ................................ SUCCESS
> [39:43.028s]
> [INFO] Spark Project Bagel ............................... SUCCESS [42.569s]
> [INFO] Spark Project GraphX .............................. SUCCESS
> [3:22.104s]
> [INFO] Spark Project Streaming ........................... SUCCESS
> [7:12.592s]
> [INFO] Spark Project ML Library .......................... SUCCESS
> [10:32.682s]
> [INFO] Spark Project Tools ............................... SUCCESS [17.070s]
> [INFO] Spark Project Catalyst ............................ SUCCESS
> [3:03.470s]
> [INFO] Spark Project SQL ................................. SUCCESS
> [5:23.993s]
> [INFO] Spark Project Hive ................................ FAILURE
> [2:08.387s]
> [INFO] Spark Project REPL ................................ SKIPPED
> [INFO] Spark Project Assembly ............................ SKIPPED
> [INFO] Spark Project External Twitter .................... SKIPPED
> [INFO] Spark Project External Kafka ...................... SKIPPED
> [INFO] Spark Project External Flume Sink ................. SKIPPED
> [INFO] Spark Project External Flume ...................... SKIPPED
> [INFO] Spark Project External ZeroMQ ..................... SKIPPED
> [INFO] Spark Project External MQTT ....................... SKIPPED
> [INFO] Spark Project Examples ............................ SKIPPED
>
> in this case i dont care about Hive, but i would have liked to see REPL
> run, and Kafka.

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org

Reply via email to