Re: Spark 3 connect to Hive 1.2

2020-07-26 Thread Ashika Umanga
thank you. But i think this document doesnt address Spark 3.0 (Databrick runtime 7.0? ) When I ran spark-shell as explained in the document : spark-shell --deploy-mode client --conf > spark.sql.hive.metastore.version=1.2.1 --conf > spark.sql.hive.metastore.jars="builtin" It throws the same

Spark 3 connect to Hive 1.2

2020-07-22 Thread Ashika Umanga
Greetings, Our standalone Spark 3 cluster is trying to connect to Hadoop 2.6 cluster running Hive server 1.2 (/usr/hdp/2.6.2.0-205/hive/lib/hive-service-1.2.1000.2.6.2.0-205.jar) import org.apache.spark.sql.functions._ import java.sql.Timestamp val df1 = spark.createDataFrame( Seq(