[ 
https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302756#comment-15302756
 ] 

Steve Loughran commented on SPARK-13599:
----------------------------------------

presumably, now that groovy,jar isn't in the spark assembly, you've got to get 
out to all the executors. Have you tried that?

> Groovy-all ends up in spark-assembly if hive profile set
> --------------------------------------------------------
>
>                 Key: SPARK-13599
>                 URL: https://issues.apache.org/jira/browse/SPARK-13599
>             Project: Spark
>          Issue Type: Improvement
>          Components: Build
>    Affects Versions: 1.5.0, 1.6.0
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Minor
>             Fix For: 1.6.2, 2.0.0
>
>
> If you do a build with {{-Phive,hive-thriftserver}} then the contents of 
> {{org.codehaus.groovy:groovy-all}} gets into the spark-assembly.jar
> This bad because
> * it makes the JAR bigger
> * it makes the build longer
> * it's an uber-JAR itself, so can include things (maybe even conflicting 
> things)
> * It's something else that needs to be kept up to date security-wise



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to