[ 
https://issues.apache.org/jira/browse/SPARK-3951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14173289#comment-14173289
 ] 

Patrick Wendell commented on SPARK-3951:
----------------------------------------

I think the best solution here is actually to mark spark as "provided" in these 
external library poms. That way users can link against them and build their own 
assemblies that won't include Spark itself. This is consistent with the way 
that users in general build Spark applications.

> Make the external-* jars fat jars
> ---------------------------------
>
>                 Key: SPARK-3951
>                 URL: https://issues.apache.org/jira/browse/SPARK-3951
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>
> I am not sure this is the right solution to the issue of having to pull in 
> the external jars and all of the dependencies and transitive dependencies, 
> but building them as fat jars will definitely solve this, though not in a not 
> so elegant way.
> If we build the fat jar, the user can simply deploy this jar and not  worry 
> about all of the dependencies.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to