Re: keep or remove sc.stop() coz of RpcEnv already stopped error

2017-03-13 Thread Alex
k 1.x, you can ignore this Warning. It shouldn't affect any functions. > > > Yong > > -- > *From:* nancy henry <nancyhenry6...@gmail.com> > *Sent:* Monday, March 13, 2017 7:08 AM > *To:* user @spark > *Subject:* keep or remove sc.stop() coz of RpcE

Re: keep or remove sc.stop() coz of RpcEnv already stopped error

2017-03-13 Thread Yong Zhang
rch 13, 2017 7:08 AM To: user @spark Subject: keep or remove sc.stop() coz of RpcEnv already stopped error Hi Team, getting this error if we put sc.stop() in application.. can we remove it from application but i read if yu dont explicitly stop using sc.stop the yarn application will n

keep or remove sc.stop() coz of RpcEnv already stopped error

2017-03-13 Thread nancy henry
Hi Team, getting this error if we put sc.stop() in application.. can we remove it from application but i read if yu dont explicitly stop using sc.stop the yarn application will not get registered in history service.. SO what to do ? WARN Dispatcher: Message RemoteProcessDisconnected