Hi, We are running a Kafka consumer using Spark consumer based approach with redis to store offset. We have set a message read rate as 200 per sec with 5min as interval. We are facing some issues with offset while streaming the data. The consumer skip offsets in some iterations, mostly when its not able to process the data within in 5min and the process go down. Can anyone help us to figure out why consumer is skipping some offset?
Thanks, Prayag Surendran
