[ 
https://issues.apache.org/jira/browse/OOZIE-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

abhishek bafna updated OOZIE-2437:
----------------------------------
    Fix Version/s:     (was: trunk)
                   4.3.0

> Exclude additional Hadoop dependencies from Spark Sharelib
> ----------------------------------------------------------
>
>                 Key: OOZIE-2437
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2437
>             Project: Oozie
>          Issue Type: Improvement
>    Affects Versions: trunk
>            Reporter: Robert Kanter
>            Assignee: Robert Kanter
>             Fix For: 4.3.0
>
>         Attachments: OOZIE-2437.001.patch
>
>
> If you try to use later versions of Spark (say 1.6), spark_hive pulls in 
> hbase, which pulls in hadoop-common and hadoop-annotations, and any other 
> dependencies that these pull in.  It's best not to include hadoop jars in any 
> of the sharelibs so we should exclude these from the Spark sharelib.  This is 
> not a problem for the default version of Spark in Oozie (1.1), but extra 
> exclusions don't hurt anything.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to