Re: Unable to execute sparkr jobs through Chronos

2016-06-16 Thread Sun Rui
I saw in the job definition an Env Var: SPARKR_MASTER. What is that for? I don’t think SparkR uses it. > On Jun 17, 2016, at 10:08, Sun Rui wrote: > > It seems that spark master URL is not correct. What is it? >> On Jun 16, 2016, at 18:57, Rodrick Brown

Re: Unable to execute sparkr jobs through Chronos

2016-06-16 Thread Sun Rui
It seems that spark master URL is not correct. What is it? > On Jun 16, 2016, at 18:57, Rodrick Brown wrote: > > Master must start with yarn, spark, mesos, or local

Unable to execute sparkr jobs through Chronos

2016-06-16 Thread Rodrick Brown
We use Chronos extensively for running our batch based spark jobs and recently started using sparkr however I'm seeing an issue trying to get sparkr jobs to run successfully when launched through Chronos basically always failing with a generic error below Launching java with spark-submit