Re: quick question: best to use cluster mode or client mode for production?

I personally use spark submit as it's agnostic to which platform your spark clusters are working on e.g. Emr dataproc databricks etc On Thu, 23 Feb 2017 at 08:53, nancy henry wrote: > Hi Team, > > I have set of hc.sql("hivequery") kind of scripts which i am running

quick question: best to use cluster mode or client mode for production?

Hi Team, I have set of hc.sql("hivequery") kind of scripts which i am running right now in spark-shell How should i schedule it in production making it spark-shell -i script.scala or keeping it in jar file through eclipse and use spark-submit deploy mode cluster? which is advisable?

quick question

Assume I am running a Spark Client Program in client mode and Spark Cluster in Stand alone mode. I want some clarification of the following things 1. Build a DAG 2. DAG Scheduler 3. TASK Scheduler I want to which of the above part is done by SPARK CLIENT and which of the above parts are done by

Re: quick question

I/WebSockets_API Hope this helps! - Kevin On Wed, Aug 24, 2016 at 3:52 PM, kant kodali < kanth...@gmail.com > wrote: -- Forwarded message -- From: kant kodali < kanth...@gmail.com > Date: Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us

Re: quick question

...@gmail.com> wrote: >>>> In the diagram you referenced, a real-time dashboard can be created using >>>> WebSockets. This technology essentially allows your web page to keep an >>>> active line of communication between the client and server, in which case >

Re: quick question

kant kodali < kanth...@gmail.com > Date: Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us...@spark.apache.org In this picture what does "Dashboards" really mean? is there a open source project which can allow me to push the results back to Dashb

Re: quick question

ring any user input >>> of page refreshes. The link below contains additional information on this >>> concept, as well as links to several different implementations (based on >>> your programming language preferences). >>> >>> https://developer.mozilla.org/en-US

Re: quick question

orwarded message -- From: kant kodali < kanth...@gmail.com > Date: Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us...@spark.apache.org In this picture what does "Dashboards" really mean? is there a open source project whi

Re: quick question

API/WebSockets_API> >> >> Hope this helps! >> - Kevin >> >> On Wed, Aug 24, 2016 at 3:52 PM, kant kodali <kanth...@gmail.com >> <mailto:kanth...@gmail.com>> wrote: >> >> -- Forwarded message -- >> From: kant kodali

Re: quick question

Wed, Aug 24, 2016 at 1:49 PM Subject: quick question To: d...@spark.apache.org , us...@spark.apache.org In this picture what does "Dashboards" really mean? is there a open source project which can allow me to push the results back to Dashboards such that Dashboards are always in sync with rea

Re: quick question

;> wrote: > > -- Forwarded message -- > From: kant kodali <kanth...@gmail.com <mailto:kanth...@gmail.com>> > Date: Wed, Aug 24, 2016 at 1:49 PM > Subject: quick question > To: d...@spark.apache.org <mailto:d...@spark.apache.org>, > us...@spark.ap