[
https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16496187#comment-16496187
]
Saisai Shao commented on SPARK-18673:
-------------------------------------
I created a PR for this issue [https://github.com/JoshRosen/hive/pull/2]
Actually one line fix is enough, most of other changes in Hive is related to
HBase, which is not required for us.
I'm not sure what is our plan for Hive support, are we still planning to use
1.2.1spark2 as a built-in version for Spark in future, or we plan to upgrade to
latest Hive version. If we plan to upgrade to the latest one, then this PR is
not necessary.
> Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version
> ------------------------------------------------------------------
>
> Key: SPARK-18673
> URL: https://issues.apache.org/jira/browse/SPARK-18673
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.1.0
> Environment: Spark built with -Dhadoop.version=3.0.0-alpha2-SNAPSHOT
> Reporter: Steve Loughran
> Priority: Major
>
> Spark Dataframes fail to run on Hadoop 3.0.x, because hive.jar's shimloader
> considers 3.x to be an unknown Hadoop version.
> Hive itself will have to fix this; as Spark uses its own hive 1.2.x JAR, it
> will need to be updated to match.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
