Marcelo Vanzin created SPARK-9284: ------------------------------------- Summary: Remove tests' dependency on the assembly Key: SPARK-9284 URL: https://issues.apache.org/jira/browse/SPARK-9284 Project: Spark Issue Type: Improvement Components: Tests Reporter: Marcelo Vanzin Priority: Minor
Some tests - in particular tests that have to spawn child processes - currently rely on the generated Spark assembly to run properly. This is sub-optimal for a few reasons: - Users have to use an unnatural "package everything first, then run tests" approach - Sometimes tests are run using old code because the user forgot to rebuild the assembly The latter is particularly annoying in {{YarnClusterSuite}}. If you modify some code outside of the {{yarn/}} module, you have to rebuild the whole assembly before that test picks it up. We should make all tests run without the need to have an assembly around, making sure that they always pick up the latest code compiled by the user. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org