Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ?

running Spark job in programmatic way on Yarn cluster without using spark-submit script ? I cannot include Spark jars on my Java application (due o dependency conflict and other reasons), so I'll be shipping Spark assembly uber jar (spark-assembly-1.3.1-hadoop2.3.0.jar) to Yarn cluster

Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ?

Hi all, Is there any way running Spark job in programmatic way on Yarn cluster without using spark-submit script ? I cannot include Spark jars on my Java application (due o dependency conflict and other reasons), so I'll be shipping Spark assembly uber jar (spark-assembly-1.3.1-hadoop2.3.0.jar

Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ?

elkhan8...@gmail.com wrote: Hi all, Is there any way running Spark job in programmatic way on Yarn cluster without using spark-submit script ? I cannot include Spark jars on my Java application (due o dependency conflict and other reasons), so I'll be shipping Spark assembly uber jar

Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ?

] https://github.com/calrissian/spark-jetty-server https://github.com/calrissian/spark-jetty-server On Wed, Jun 17, 2015 at 8:29 PM, Elkhan Dadashov elkhan8...@gmail.com mailto:elkhan8...@gmail.com wrote: Hi all, Is there any way running Spark job in programmatic way on Yarn cluster without

Re: Is there programmatic way running Spark job on Yarn cluster without using spark-submit script ?

An example of being able to do this is provided in the Spark Jetty Server project [1] [1] https://github.com/calrissian/spark-jetty-server On Wed, Jun 17, 2015 at 8:29 PM, Elkhan Dadashov elkhan8...@gmail.com wrote: Hi all, Is there any way running Spark job in programmatic way on Yarn