It try to execute the job again, from the first stage. 发自我的 iPhone
> 在 Aug 2, 2016，11:24 AM，dhruve ashar <dhruveas...@gmail.com> 写道： > > Hi LZ, > > Getting those error messages in logs is normal behavior. When the job > completes, it shuts down the SparkListenerBus as there's no need of relaying > any spark events to the interested registered listeners. So trying to add > events from executors which are yet to shutdown, logs the error message > because the event listener bus has stopped. > > "I migrate my code to Spark 2.0 from 1.6. It finish last stage (and result is > correct) but get following errors then start over." > > Can you elaborate on what do you mean by start over? > > -Dhruve > > > >> On Tue, Aug 2, 2016 at 1:01 PM, Ted Yu <yuzhih...@gmail.com> wrote: >> Which hadoop version are you using ? >> >> Can you show snippet of your code ? >> >> Thanks >> >>> On Tue, Aug 2, 2016 at 10:06 AM, Liangzhao Zeng <liangzhao.z...@gmail.com> >>> wrote: >>> Hi, >>> >>> I migrate my code to Spark 2.0 from 1.6. It finish last stage (and result >>> is correct) but get following errors then start over. >>> >>> Any idea on what happen? >>> >>> 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has >>> already stopped! Dropping event >>> SparkListenerExecutorMetricsUpdate(2,WrappedArray()) >>> 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has >>> already stopped! Dropping event >>> SparkListenerExecutorMetricsUpdate(115,WrappedArray()) >>> 16/08/02 16:59:33 ERROR scheduler.LiveListenerBus: SparkListenerBus has >>> already stopped! Dropping event >>> SparkListenerExecutorMetricsUpdate(70,WrappedArray()) >>> 16/08/02 16:59:33 WARN yarn.YarnAllocator: Expected to find pending >>> requests, but found none. >>> 16/08/02 16:59:33 WARN netty.Dispatcher: Message >>> RemoteProcessDisconnected(17.138.53.26:55338) dropped. Could not find >>> MapOutputTracker. >>> >>> >>> Cheers, >>> >>> LZ > > > > -- > -Dhruve Ashar >
