Re: quick question: best to use cluster mode or client mode for production?
I personally use spark submit as it's agnostic to which platform your spark clusters are working on e.g. Emr dataproc databricks etc On Thu, 23 Feb 2017 at 08:53, nancy henry wrote: > Hi Team, > > I have set of hc.sql("hivequery") kind of scripts which i am running right > now in spark-shell > > How should i schedule it in production > making it spark-shell -i script.scala > or keeping it in jar file through eclipse and use spark-submit deploy mode > cluster? > > which is advisable? >
quick question: best to use cluster mode or client mode for production?
Hi Team, I have set of hc.sql("hivequery") kind of scripts which i am running right now in spark-shell How should i schedule it in production making it spark-shell -i script.scala or keeping it in jar file through eclipse and use spark-submit deploy mode cluster? which is advisable?