bhasudha commented on issue #1653: URL: https://github.com/apache/incubator-hudi/issues/1653#issuecomment-632516157
@prashanthpdesai sorry I assumed you were referring to your own check pointing. Your understanding is right. Checkpoints are written to hoodie commit metadata after each round of DeltaStreamer run. The Exception you described seems to be possible if the offfsets supplied is larger or smaller than what the server has for a given partition. I am suspecting if this could be be because of retention policy of the kafka topic kicking in. It should be easy to check this. I think some command like this ```kafka-topics.sh --bootstrap-server server_ip:9092 --describe --topic topic_name``` will help print the topic config. Can we start to debug from there? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
