Mital Awachat created KAFKA-15301:
-------------------------------------
Summary: [Tiered Storage] Historically compacted topics send
request to remote for acive segment
Key: KAFKA-15301
URL: https://issues.apache.org/jira/browse/KAFKA-15301
Project: Kafka
Issue Type: Bug
Components: core
Affects Versions: 3.6.0
Reporter: Mital Awachat
In AWS MSK (Kafka 2.8) tiered storage a case surfaced where tiered storage
plugin received requests for active segments. The topics for which it happened
were historically compacted topics for which compaction was disabled and
tiering was enabled.
Create topic with compact cleanup policy -> Produce data with few repeat keys
and create multiple segments -> let compaction happen -> change cleanup policy
to delete -> produce some more data for segment rollover -> enable tiering on
topic -> wait for segments to be uploaded to s3 and cleanup from local (active
segment would remain), consume from beginning -> Observe logs.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
