[ https://issues.apache.org/jira/browse/SPARK-30783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yin Huai updated SPARK-30783: ----------------------------- Attachment: hive-service-rpc-2.3.6-classes spark-hive-thriftserver_2.12-3.0.0-20200207.021914-364-classes > Hive 2.3 profile should exclude hive-service-rpc > ------------------------------------------------ > > Key: SPARK-30783 > URL: https://issues.apache.org/jira/browse/SPARK-30783 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.0.0 > Reporter: Yin Huai > Assignee: Yin Huai > Priority: Blocker > Attachments: hive-service-rpc-2.3.6-classes, > spark-hive-thriftserver_2.12-3.0.0-20200207.021914-364-classes > > > hive-service-rpc 2.3.6 and spark sql's thrift server module have duplicate > classes. Leaving hive-service-rpc 2.3.6 in the class path means that spark > can pick up classes defined in hive instead of its thrift server module, > which can cause hard to debug runtime errors due to class loading order and > compilation errors for applications depend on spark. > > If you compare hive-service-rpc 2.3.6's jar > ([https://search.maven.org/remotecontent?filepath=org/apache/hive/hive-service-rpc/2.3.6/hive-service-rpc-2.3.6.jar]) > and spark thrift server's jar (e.g. > [https://repository.apache.org/content/groups/snapshots/org/apache/spark/spark-hive-thriftserver_2.12/3.0.0-SNAPSHOT/spark-hive-thriftserver_2.12-3.0.0-20200207.021914-364.jar),] > you will see that all of classes provided by hive-service-rpc-2.3.6.jar are > covered by spark thrift server's jar. I am attaching the list of jar contents > for your reference. > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org