Mohammed, As i have mentioned in latest email, it was failing due to a communication issue with cassandra. Once i fixed that the issue is no more there.
Regards, Vivek M ________________________________ From: Mohammed Guller <moham...@glassbeam.com> Sent: Thursday, January 14, 2016 4:38 AM To: Vivek Meghanathan (WT01 - NEP); user@spark.apache.org Subject: RE: spark job failure - akka error Association with remote system has failed Check the entries in your /etc/hosts file. Also check what the hostname command returns. Mohammed From: vivek.meghanat...@wipro.com [mailto:vivek.meghanat...@wipro.com] Sent: Tuesday, January 12, 2016 11:36 PM To: user@spark.apache.org Subject: RE: spark job failure - akka error Association with remote system has failed I have used master_ip as ip address and spark conf also has Ip address . But the following logs shows hostname. (The spark Ui shows master details in IP) 16/01/13 12:31:38 WARN ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkDriver@masternode1:36537] has failed, address is now gated for [5000] ms. Reason is: [Disassociated]. From: Vivek Meghanathan (WT01 - NEP) Sent: 13 January 2016 12:18 To: user@spark.apache.org<mailto:user@spark.apache.org> Subject: spark job failure - akka error Association with remote system has failed Hi All, I am running spark 1.3.0 standalone cluster mode, we have rebooted the cluster servers (system reboot). After that the spark jobs are failing by showing following error (it fails within 7-8 seconds). 2 of the jobs are running fine. All the jobs used to be stable before the system reboot. We have not enabled any default configurations in the conf file other than spark-env.sh, slaves and log4j.properties. Warning in the master log: 16/01/13 11:58:16 WARN ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkDriver@masternode1:41419] has failed, address is now gated for [5000] ms. Reason is: [Disassociated]. Regards, Vivek M The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com<http://www.wipro.com> The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
