Hi All,
I'm using Kafka 0.9.0.1.
I have a requirement in which consumption of records are asynchronous.
*for (ConsumerRecord record : records) {*
* executor.submit(new Runnable() {*
* public void run() {*
* // process record; }*
* });*
*}*
*consumer.commitSync(); //Shouldn't commit here*
The completion of *for()* loop doesn't mean that records are processed. A
record is processed only when a job gets executed successfully.
On application failure / restart, I've to submit the unprocessed records. I
came up with a ack based approach but it's not scalable. How to track the
offsets of processed records?
--Kamal