Marcelo Vanzin created SPARK-9284:
-------------------------------------
Summary: Remove tests' dependency on the assembly
Key: SPARK-9284
URL: https://issues.apache.org/jira/browse/SPARK-9284
Project: Spark
Issue Type: Improvement
Components: Tests
Reporter: Marcelo Vanzin
Priority: Minor
Some tests - in particular tests that have to spawn child processes - currently
rely on the generated Spark assembly to run properly.
This is sub-optimal for a few reasons:
- Users have to use an unnatural "package everything first, then run tests"
approach
- Sometimes tests are run using old code because the user forgot to rebuild the
assembly
The latter is particularly annoying in {{YarnClusterSuite}}. If you modify some
code outside of the {{yarn/}} module, you have to rebuild the whole assembly
before that test picks it up.
We should make all tests run without the need to have an assembly around,
making sure that they always pick up the latest code compiled by the user.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
