Can you look in the executor logs and see why the sparkcontext is being shutdown? Similar discussion happened here previously. http://apache-spark-user-list.1001560.n3.nabble.com/RECEIVED-SIGNAL-15-SIGTERM-td23668.html
Thanks Best Regards On Thu, Jan 21, 2016 at 5:11 PM, Soni spark <soni2015.sp...@gmail.com> wrote: > Hi Friends, > > I spark job is successfully running on local mode but failing on cluster > mode. Below is the error message i am getting. anyone can help me. > > > > 16/01/21 16:38:07 INFO twitter4j.TwitterStreamImpl: Establishing connection. > 16/01/21 16:38:07 INFO twitter.TwitterReceiver: Twitter receiver started > 16/01/21 16:38:07 INFO receiver.ReceiverSupervisorImpl: Called receiver > onStart > 16/01/21 16:38:07 INFO receiver.ReceiverSupervisorImpl: Waiting for receiver > to be stopped*16/01/21 16:38:10 ERROR yarn.ApplicationMaster: RECEIVED SIGNAL > 15: SIGTERM* > 16/01/21 16:38:10 INFO streaming.StreamingContext: Invoking > stop(stopGracefully=false) from shutdown hook > 16/01/21 16:38:10 INFO scheduler.ReceiverTracker: Sent stop signal to all 1 > receivers > 16/01/21 16:38:10 INFO receiver.ReceiverSupervisorImpl: Received stop signal > 16/01/21 16:38:10 INFO receiver.ReceiverSupervisorImpl: Stopping receiver > with message: Stopped by driver: > 16/01/21 16:38:10 INFO twitter.TwitterReceiver: Twitter receiver stopped > 16/01/21 16:38:10 INFO receiver.ReceiverSupervisorImpl: Called receiver onStop > 16/01/21 16:38:10 INFO receiver.ReceiverSupervisorImpl: Deregistering > receiver 0*16/01/21 16:38:10 ERROR scheduler.ReceiverTracker: Deregistered > receiver for stream 0: Stopped by driver* > 16/01/21 16:38:10 INFO receiver.ReceiverSupervisorImpl: Stopped receiver 0 > 16/01/21 16:38:10 INFO receiver.BlockGenerator: Stopping BlockGenerator > 16/01/21 16:38:10 INFO yarn.ApplicationMaster: Waiting for spark context > initialization ... > > Thanks > > Soniya > >
