RE: Spark streaming -> cassandra : Fault Tolerance

2015-09-09 Thread Samya MAITI
From: Cody Koeninger [mailto:c...@koeninger.org] Sent: Thursday, September 10, 2015 1:13 AM To: Samya MAITI <samya.ma...@amadeus.com> Cc: user@spark.apache.org Subject: Re: Spark streaming -> cassandra : Fault Tolerance It's been a while since I've looked at the cassandra connector, s

Re: Spark streaming -> cassandra : Fault Tolerance

2015-09-09 Thread Cody Koeninger
It's been a while since I've looked at the cassandra connector, so I can't give you specific advice on it. But in general, if a spark task fails (uncaught exception), it will be retried automatically. In the case of the kafka direct stream rdd, it will have exactly the same messages as the first