Re: spark run shell On yarn

2016-07-28 Thread Marcelo Vanzin
Well, it's more of an unfortunate incompatibility caused by dependency hell. There's a YARN issue to make this better by avoiding that code path when it's not needed, but I'm not sure what's the status of that. On Thu, Jul 28, 2016 at 6:54 PM, censj wrote: > ok ! solved !! >

Re: spark run shell On yarn

2016-07-28 Thread Marcelo Vanzin
You can probably do that in Spark's conf too: spark.hadoop.yarn.timeline-service.enabled=false On Thu, Jul 28, 2016 at 5:13 PM, Jeff Zhang wrote: > One workaround is disable timeline in yarn-site, > > set yarn.timeline-service.enabled as false in yarn-site.xml > > On Thu, Jul

Re: spark run shell On yarn

2016-07-28 Thread Jeff Zhang
One workaround is disable timeline in yarn-site, set yarn.timeline-service.enabled as false in yarn-site.xml On Thu, Jul 28, 2016 at 5:31 PM, censj wrote: > 16/07/28 17:07:34 WARN shortcircuit.DomainSocketFactory: The short-circuit > local reads feature cannot be used