Very nice! will try and let you know, thanks. On Tue, May 12, 2015 at 2:25 PM, Akhil Das <ak...@sigmoidanalytics.com> wrote:
> Yep, you can try this lowlevel Kafka receiver > https://github.com/dibbhatt/kafka-spark-consumer. Its much more > flexible/reliable than the one comes with Spark. > > Thanks > Best Regards > > On Tue, May 12, 2015 at 5:15 PM, James King <jakwebin...@gmail.com> wrote: > >> What I want is if the driver dies for some reason and it is restarted I >> want to read only messages that arrived into Kafka following the restart of >> the driver program and re-connection to Kafka. >> >> Has anyone done this? any links or resources that can help explain this? >> >> Regards >> jk >> >> >> >