Hi, I have spark standalone cluster on AWS EC2 and recently my spark stream jobs stopping abrubptly. When I check the logs I found this
17/03/07 06:09:39 INFO ProtocolStateActor: No response from remote. Handshake timed out or transport failure detector triggered. 17/03/07 06:09:39 ERROR WorkerWatcher: Lost connection to worker rpc endpoint akka.tcp://sparkwor...@xxx.xx.xx.xxx:44271/user/Worker. Exiting. 17/03/07 06:09:39 WARN CoarseGrainedExecutorBackend: An unknown (xxx.xx.x.xxx:44271) driver disconnected. 17/03/07 06:09:39 INFO DiskBlockManager: Shutdown hook called My suspect it is due to network connection between AWS instances of spark cluster. Could somebody help me put more light on it? Thanks Divya
