Pradeep Bansal created KAFKA-7879:
-------------------------------------
Summary: Data directory size decreases every few minutes when
producer is sending large amount of data
Key: KAFKA-7879
URL: https://issues.apache.org/jira/browse/KAFKA-7879
Project: Kafka
Issue Type: Improvement
Reporter: Pradeep Bansal
I am running kafka broker with 6 nodes and have set reteion hours to 24 hours
and retention bytes to 5 GB.
I have set retention bytes to 250GB on topic configuration.
Now when producing message in async mode with 1000 bytes message with very high
frequency. I am seeing that kafka data directory size increases but every 5
minutes it decreases by some percentage (in my observation it increases by 40G
and then reduces to 20G, so in every 5 minutes we are seeing increase by 20G
instead of 40G).
Is there any extra configuration we need to set to avoid this data loss or is
there some sort of compression that is going on here.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
