joeyutong commented on PR #885: URL: https://github.com/apache/flink-agents/pull/885#issuecomment-4965259631
Thanks for addressing the growth of Kafka action-state records. However, writing tombstones unconditionally may break recovery from older checkpoints or savepoints. For example, if C0 is followed by action state S and then C1 tombstones S, restoring C0 will replay both S and the tombstone. `rebuildState()` removes S, so the action may execute again. This happens even when Kafka compaction is disabled. Could tombstone emission be opt-in, for example through `kafkaActionStateTombstoneEnabled` defaulting to `false`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
