Re: Spark job hangs when History server events are written to hdfs

and Regards Pankaj From: Archit Thakur archit279tha...@gmail.commailto:archit279tha...@gmail.com Date: Wednesday, 8 July 2015 4:36 pm To: Akhil Das ak...@sigmoidanalytics.commailto:ak...@sigmoidanalytics.com Cc: Pankaj Arora pankaj.ar...@guavus.commailto:pankaj.ar...@guavus.com, dev

Spark job hangs when History server events are written to hdfs

Hi, I am running long running application over yarn using spark and I am facing issues while using spark’s history server when the events are written to hdfs. It seems to work fine for some time and in between I see following exception. 2015-06-01 00:00:03,247 [SparkListenerBus] ERROR