[
https://issues.apache.org/jira/browse/SPARK-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-3962:
-----------------------------------
Description:
Right now there is not an easy way for users to link against the external
streaming libraries and not accidentally pull Spark into their assembly jar. We
should mark Spark as "provided" in the external connector pom's so that user
applications can simply include those like any other dependency in the user's
jar.
This is also the best format for third-party libraries that depend on Spark (of
which there will eventually be many) so it would be nice for our own build to
conform to this nicely.
was:Right now there is not an easy way for users to link against the external
streaming libraries and not accidentally pull Spark into their assembly jar. We
should mark Spark as "provided" in the external connector pom's so that user
applications can simply include those like any other dependency in the user's
jar.
> Mark spark dependency as "provided" in external libraries
> ---------------------------------------------------------
>
> Key: SPARK-3962
> URL: https://issues.apache.org/jira/browse/SPARK-3962
> Project: Spark
> Issue Type: Improvement
> Components: Streaming
> Reporter: Patrick Wendell
> Priority: Blocker
>
> Right now there is not an easy way for users to link against the external
> streaming libraries and not accidentally pull Spark into their assembly jar.
> We should mark Spark as "provided" in the external connector pom's so that
> user applications can simply include those like any other dependency in the
> user's jar.
> This is also the best format for third-party libraries that depend on Spark
> (of which there will eventually be many) so it would be nice for our own
> build to conform to this nicely.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
