RE: Spark Streaming empty RDD issue

2014-12-04 Thread Shao, Saisai
Hi, According to my knowledge of current Spark Streaming Kafka connector, I think there's no chance for APP user to detect such kind of failure, this will either be done by Kafka consumer with ZK coordinator, either by ReceiverTracker in Spark Streaming, so I think you don't need to take care

Re: Spark Streaming empty RDD issue

2014-12-03 Thread Akhil Das
You can setup nagios based monitoring for these, also setting up a high availability environment will be more fault tolerant. Thanks Best Regards On Thu, Dec 4, 2014 at 12:17 PM, Hafiz Mujadid hafizmujadi...@gmail.com wrote: Hi Experts I am using Spark Streaming to integrate Kafka for real