Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
Hi Experts, I am facing issue in which spark job is running infinitely. When I start spark job on 4 node cluster. In which there is no space left on one machine then it is running infinity. Does any one can across such an issue. Is any why to kill job when such thing happens. -- Thanks

Re: Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
> Thanks > > On Mon, Oct 12, 2015 at 10:07 AM, Saurav Sinha <sauravsinh...@gmail.com> > wrote: > >> Hi Experts, >> >> I am facing issue in which spark job is running infinitely. >> >> When I start spark job on 4 node cluster. >> >> In

Re: Spark job is running infinitely

2015-10-12 Thread Ted Yu
wrote: > Hi Experts, > > I am facing issue in which spark job is running infinitely. > > When I start spark job on 4 node cluster. > > In which there is no space left on one machine then it is running infinity. > > Does any one can across such an issue. Is any why to k

Re: Spark job is running infinitely

2015-10-12 Thread Ted Yu
Spark, command line for 'spark-submit' in >> your reply. >> >> Thanks >> >> On Mon, Oct 12, 2015 at 10:07 AM, Saurav Sinha <sauravsinh...@gmail.com> >> wrote: >> >>> Hi Experts, >>> >>> I am facing issue in which spar

Re: Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
n, Oct 12, 2015 at 10:46 PM, Ted Yu <yuzhih...@gmail.com> wrote: >>> >>>> Do you have monitoring put in place to detect 'no space left' scenario >>>> ? >>>> >>>> By 'way to kill job', do you mean automatic kill ? >>>> >>>&g

Re: Spark job is running infinitely

2015-10-12 Thread Ted Yu
job', do you mean automatic kill ? >>>> >>>> Please include the release of Spark, command line for 'spark-submit' in >>>> your reply. >>>> >>>> Thanks >>>> >>>> On Mon, Oct 12, 2015 at 10:07 AM, Saurav Sinha &

Re: Spark job is running infinitely

2015-10-12 Thread Saurav Sinha
ne for 'spark-submit' in >>> your reply. >>> >>> Thanks >>> >>> On Mon, Oct 12, 2015 at 10:07 AM, Saurav Sinha <sauravsinh...@gmail.com> >>> wrote: >>> >>>> Hi Experts, >>>> >>>> I am facing iss