Re: spark 1.4.1 - LZFException

2015-09-03 Thread Yadid Ayzenberg
Hi Akhil, No, it seems I have plenty of more disk space available on that node. I look at the logs and one minute before that exception I am seeing the following exception. 15/09/03 12:51:39 ERROR TransportChannelHandler: Connection to /x.y.z.w:44892 has been quiet for 12 ms while there

spark 1.4.1 - LZFException

2015-08-22 Thread Yadid Ayzenberg
Hi All, We have a spark standalone cluster running 1.4.1 and we are setting spark.io.compression.codec to lzf. I have a long running interactive application which behaves as normal, but after a few days I get the following exception in multiple jobs. Any ideas on what could be causing this