[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101110#comment-17101110 ]
Dongjoon Hyun edited comment on SPARK-29250 at 5/6/20, 7:25 PM: ---------------------------------------------------------------- Thanks for the update. For now, we are not aiming to downgrade from Hadoop 3.2.x to Hadoop 3.1.x. If we find a way how to handle Apache Hive 1.2 and Hive 2.3's guava dependency, it will be with Hadoop 3.2+. Since Apache Hive community doesn't have any plan for Guava update in `branch-2.3`, Apache Spark community needs another way to handle them. For Apache Hive 1.2, I want to drop it as soon as possible after Apache Spark 3.0.0 release. It will narrow down this issue to Apache Hive 2.3's guava dependency. was (Author: dongjoon): Thanks for the update. For now, we are not aiming to downgrade Hadoop 3.2.x to Hadoop 3.1.x. If we find a way how to handle Apache Hive 1.2 and Hive 2.3's guava dependency, it will be with Hadoop 3.2+. Since Apache Hive community doesn't have any plan for Guava update in `branch-2.3`, Apache Spark community needs another way to handle them. For Apache Hive 1.2, I want to drop it as soon as possible after Apache Spark 3.0.0 release. It will narrow down this issue to Apache Hive 2.3's guava dependency. > Upgrade to Hadoop 3.2.1 > ----------------------- > > Key: SPARK-29250 > URL: https://issues.apache.org/jira/browse/SPARK-29250 > Project: Spark > Issue Type: Improvement > Components: Build > Affects Versions: 3.1.0 > Reporter: Dongjoon Hyun > Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org