Re: Do we always need to go through spark-submit?

2017-08-30 Thread vaquar khan
Hi Kant, Ans :Yes The org.apache.spark.launcher package provides classes for launching Spark jobs as child processes using a simple Java API. *Doc:*

Re: Do we always need to go through spark-submit?

2017-08-30 Thread Irving Duran
I don't know how this would work, but maybe your .jar calls spark-submit from within your jar if you were to compile the jar with the spark-submit class. Thank You, Irving Duran On Wed, Aug 30, 2017 at 10:57 AM, kant kodali wrote: > Hi All, > > I understand spark-submit

Do we always need to go through spark-submit?

2017-08-30 Thread kant kodali
Hi All, I understand spark-submit sets up its own class loader and other things but I am wondering if it is possible to just compile the code and run it using "java -jar mysparkapp.jar" ? Thanks, kant