[ https://issues.apache.org/jira/browse/SPARK-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214480#comment-14214480 ]
Patrick Wendell commented on SPARK-3962: ---------------------------------------- I think this is causing the build to fail because of this bug: https://jira.codehaus.org/browse/MSHADE-148 Would it be possible to remove the test-jar dependency on streaming for these modules (/cc @tdas)? If we need to have a moderate amount of code duplication I think it's fine because as it stands now these aren't really usable for people. I looked and I only found some minor dependencies that could be inlined into the modules. > Mark spark dependency as "provided" in external libraries > --------------------------------------------------------- > > Key: SPARK-3962 > URL: https://issues.apache.org/jira/browse/SPARK-3962 > Project: Spark > Issue Type: Bug > Components: Streaming > Reporter: Patrick Wendell > Assignee: Prashant Sharma > Priority: Blocker > > Right now there is not an easy way for users to link against the external > streaming libraries and not accidentally pull Spark into their assembly jar. > We should mark Spark as "provided" in the external connector pom's so that > user applications can simply include those like any other dependency in the > user's jar. > This is also the best format for third-party libraries that depend on Spark > (of which there will eventually be many) so it would be nice for our own > build to conform to this nicely. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org