Colt McNealy created KAFKA-15308: ------------------------------------ Summary: Wipe Stores upon OffsetOutOfRangeException in ALOS Key: KAFKA-15308 URL: https://issues.apache.org/jira/browse/KAFKA-15308 Project: Kafka Issue Type: Bug Components: streams Affects Versions: 3.5.0, 3.4.0, 3.3.0 Reporter: Colt McNealy
As per this [Confluent Community Slack Thread|https://confluentcommunity.slack.com/archives/C48AHTCUQ/p1690843733272449?thread_ts=1690663361.858559&cid=C48AHTCUQ], Streams currently does not wipe away RocksDB state upon encountering an `OffsetOutOfRangeException` in ALOS. `OffsetOutOfRangeException` is a rare case that occurs when a standby task requests offsets that no longer exist in the topic. We should wipe the store for three reasons: # Not wiping the store can be a violation of ALOS since some of the now-missing offsets could have contained tombstone records. # Wiping the store has no performance cost since we need to replay the entirety of what's in the changelog topic anyways. # I have heard (not yet confirmed myself) that we wipe the store in EOS anyways, so fixing this bug could remove a bit of complexity from supporting EOS and ALOS. -- This message was sent by Atlassian Jira (v8.20.10#820010)