Viewing the offsets stored in a Savepoint

2021-05-07 Thread Zachary Manno
Hello, Someone else asked this question on Stackoverflow and we would also find it very helpful: https://stackoverflow.com/questions/66256168/querying-kafka-offsets-from-flink-savepoint Is there a way to check the external savepoint data for what Kafka offset it is going to resume from? We produce

Flink Resuming From Checkpoint With "-s" FAILURE

2021-04-28 Thread Zachary Manno
Hello, I am running Flink version 1.10 on Amazon EMR. We use RocksDB/S3 for state. I have "Persist Checkpoints Externally" enabled. Periodically I must tear down the current infrastructure and bring it back up. To do this, I terminate the EMR, bring up a fresh EMR cluster, and then I resume the Fli