spark.sql.hive.metastore.version0.13.1 Version of the Hive metastore.
Available options are 0.12.0 through 1.2.1.
spark.sql.hive.metastore.jars builtin Location of the jars that
should be
used to instantiate the HiveMetastoreClient. This property can be one of
three options:
builtin
Use Hive 1.2.1, which is bundled with the Spark assembly jar when -Phive
is enabled. When this option is chosen, spark.sql.hive.metastore.version
must be either 1.2.1 or not defined.
maven
Use Hive jars of specified version downloaded from Maven repositories.
This configuration is not generally recommended for production deployments.
A classpath in the standard format for the JVM. This classpath must
include all of Hive and its dependencies, including the correct version of
Hadoop. These jars only need to be present on the driver, but if you are
running in yarn cluster mode then you must ensure they are packaged with you
application.
I config the parms like this:
spark.sql.hive.metastore.version=0.14.0
spark.sql.hive.metastore.jars=$HIVE_HOME/lib/*:hadoop classpath
I have put all the jars in the classpath,but don't work
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Interacting-with-Different-Versions-of-Hive-Metastore-how-to-config-tp24683.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
