[ 
https://issues.apache.org/jira/browse/SPARK-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Patrick Wendell reassigned SPARK-1843:
--------------------------------------

    Assignee: Patrick Wendell  (was: Prashant Sharma)

> Provide a simpler alternative to assemble-deps
> ----------------------------------------------
>
>                 Key: SPARK-1843
>                 URL: https://issues.apache.org/jira/browse/SPARK-1843
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>            Reporter: Patrick Wendell
>            Assignee: Patrick Wendell
>             Fix For: 1.1.0
>
>
> Right now we have the assemble-deps tool for speeding up local development.
> I was thinking about a simpler solution to this problem where, instead of 
> creating a fancy assembly jar, we just add an environment variable: 
> USE_COMPILED_SPARK and, if that variable is present, we simply add the Spark 
> classes on the classpath before the assembly jar. Since the compiled classes 
> are on the classpath first, they will take precedence.
> This would allow us to remove the entire assemble-deps build and associated 
> logic in the bash scripts. We'd need to make sure it's propagated correctly 
> during tests (like SPARK_TESTING) but other than that I think it should work.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to