Re: Spark and Hive connection

Hi, the connection is made to HIVE thrift server. Regards, Gourav On Thu, Apr 6, 2017 at 6:06 AM, infa elance wrote: > Hi all, > When using spark-shell my understanding is spark connects to hive through > metastore. > The question i have is does spark connect to

Re: Spark and Hive connection

Spark connects directly to the Hive metastore service in order to manage table definitions and locations and such. If you are using the CLI interfaces and turn on INFO level logging, you can see when you instantiate a HiveContext that it is connecting to the Hive Metastore and the URL its using

Spark and Hive connection

Hi all, When using spark-shell my understanding is spark connects to hive through metastore. The question i have is does spark connect to metastore , is it JDBC? Thanks and Regards, Ajay.

Re: spark-submit hive connection through spark Initial job has not accepted any resources

master URL through spark submit command. Thnx -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-submit-hive-connection-through-spark-Initial-job-has-not-accepted-any-resources-tp24993p27074.html Sent from the Apache Spark User List mailing list archive

Re: spark-submit hive connection through spark Initial job has not accepted any resources

;>>>> count is > "+df.count()); > } > } > > command to submit job ./spark-submit --master spark://masterIp:7077 > --deploy-mode client --class com.ceg.spark.hive.sparkhive.SparkHiveInsertor > --executor-cores 2 --executor-memory 1gb > /home/someuser/Desk

Re: spark-submit hive connection through spark Initial job has not accepted any resources

gt;>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> count is "+df.count()); } } command to submit job ./spark-submit --master spark://masterIp:7077 --deploy-mode client --class com.ceg.spark.hive

spark-submit hive connection through spark Initial job has not accepted any resources

es; check your cluster UI to ensure that workers are registered and have sufficient resources -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-submit-hive-connection-through-spark-Initial-job-has-not-accepted-any-resources-tp24993.html Sent from the Apache Spark User List mailing list archive at Nabble.com.