[
https://issues.apache.org/jira/browse/SPARK-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14098656#comment-14098656
]
Maxim Ivanov commented on SPARK-1828:
-------------------------------------
Because of this change any incompatibilities with Hive in Hadoop distros are
hidden untile you run job on an actual cluster. Unless you are willing to keep
your fork up to date with every major Hadoop distro of course.
Right now we see incompatibility with CDH5.0.2 Hive, but I'd rather have it
failing to compile rather that seeing problems at runtime
> Created forked version of hive-exec that doesn't bundle other dependencies
> --------------------------------------------------------------------------
>
> Key: SPARK-1828
> URL: https://issues.apache.org/jira/browse/SPARK-1828
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.0.0
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Priority: Blocker
> Fix For: 1.0.0
>
>
> The hive-exec jar includes a bunch of Hive's dependencies in addition to hive
> itself (protobuf, guava, etc). See HIVE-5733. This breaks any attempt in
> Spark to manage those dependencies.
> The only solution to this problem is to publish our own version of hive-exec
> 0.12.0 that behaves correctly. While we are doing this, we might as well
> re-write the protobuf dependency to use the shaded version of protobuf 2.4.1
> that we already have for Akka.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
