GitHub user zhengsg added a comment to the discussion: How to configure SparkSQL to access the Hive catalog in Gravitino?
By specifying spark.sql.hive.metastore.jars, the SELECT query can be executed to retrieve Hive data. However, when executing an INSERT INTO statement, the error NoSuchMethodException: org.apache.hadoop.hive.ql.metadata.Hive.loadTableerror occurs. This indicates an API mismatch caused by version incompatibility between Spark and Hive. Therefore, specifying spark.sql.hive.metastore.jarsis not a recommended approach? However, without using Gravitino, and by directly connecting to the Hive metastore using --conf spark.sql.hive.metastore.uris, both SELECTand INSERTstatements can be executed normally GitHub link: https://github.com/apache/gravitino/discussions/9161#discussioncomment-15000435 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
