Re: remote Akka client disassociated - some timeout?

2015-01-17 Thread Akhil Das
​Try setting the following property: .set(spark.akka.frameSize,50)​ Also make sure that spark is able read from hbase (you can try it with small amount data). Thanks Best Regards On Fri, Jan 16, 2015 at 11:30 PM, Antony Mayi antonym...@yahoo.com.invalid wrote: Hi, I believe this is some

Re: remote Akka client disassociated - some timeout?

2015-01-17 Thread Ted Yu
Antony: Please check hbase master log to see if there was something noticeable in that period of time. If the hbase cluster is not big, check region server log as well. Cheers On Jan 16, 2015, at 10:00 AM, Antony Mayi antonym...@yahoo.com.INVALID wrote: Hi, I believe this is some

remote Akka client disassociated - some timeout?

2015-01-16 Thread Antony Mayi
Hi, I believe this is some kind of timeout problem but can't figure out how to increase it. I am running spark 1.2.0 on yarn (all from cdh 5.3.0). I submit a python task which first loads big RDD from hbase - I can see in the screen output all executors fire up then no more logging output for