Re: is there any way to submit spark application from outside of spark cluster

Hi Prateek! You might want to have a look at spark job server: https://github.com/spark-jobserver/spark-jobserver Warm regards, Sunil Manikani. On 25 March 2016 at 23:34, Ted Yu wrote: > Do you run YARN in your production environment (and plan to run Spark jobs > on

Error while running a job in yarn-client mode

parkSubmit$.main(SparkSubmit.scala:120) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Thanks in advance. Warm regards, Sunil M.

Logging spark output to hdfs file

regards, Sunil M

Associating spark jobs with logs

are welcome! Thanks in advance. Warm regards, Sunil M.

Re: Associating spark jobs with logs

to YARN. I am looking for a feature like this but we need to get logs irrespective of the master being YARN, MESSOS or stand-alone spark. Warm regards, Sunil M. On 9 December 2015 at 00:48, Ted Yu <yuzhih...@gmail.com> wrote: > Have you looked at the REST API section of:

Available options for Spark REST API

a example. Are there any known disadvantages of using it? Is there anything better available, which is used in Production environment? Any advise is appreciated. We are using Spark 1.5.1. Thanks in advance. Warm regards, Sunil M.

Queue in Spark standalone mode

Hi! I am using Spark 1.5.1 and pretty new to Spark... Like Yarn, is there a way to configure queues in Spark standalone mode? If yes, can someone point me to a good documentation / reference. Sometimes I get strange behavior while running multiple jobs simultaneously. Thanks in advance.

Spark JDBCRDD query

... Warm regards, Sunil M.