Can you provide additional logs. On Tue, Aug 2, 2016 at 2:13 PM, Liangzhao Zeng <liangzhao.z...@gmail.com> wrote:
> It is 2.6 and code is very simple. I load data file from Hdfs to create > rdd then same some samples. > > > Thanks > > 发自我的 iPhone > > 在 Aug 2, 2016,11:01 AM,Ted Yu <yuzhih...@gmail.com> 写道: > > Which hadoop version are you using ? > > Can you show snippet of your code ? > > Thanks > > On Tue, Aug 2, 2016 at 10:06 AM, Liangzhao Zeng <liangzhao.z...@gmail.com> > wrote: > >> Hi, >> >> >> I migrate my code to Spark 2.0 from 1.6. It finish last stage (and result is >> correct) but get following errors then start over. >> >> >> Any idea on what happen? >> >> >> 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has >> already stopped! Dropping event >> SparkListenerExecutorMetricsUpdate(2,WrappedArray()) >> 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has >> already stopped! Dropping event >> SparkListenerExecutorMetricsUpdate(115,WrappedArray()) >> 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has >> already stopped! Dropping event >> SparkListenerExecutorMetricsUpdate(70,WrappedArray()) >> 16/08/02 16:59:33 WARN yarn.YarnAllocator: Expected to find pending >> requests, but found none. >> 16/08/02 16:59:33 WARN netty.Dispatcher: Message >> RemoteProcessDisconnected(17.138.53.26:55338) dropped. Could not find >> MapOutputTracker. >> >> >> >> Cheers, >> >> >> LZ >> >> > -- -Dhruve Ashar