Kafka preallocates the index files so this is normal. This size is configurable using the property: segment.index.bytes
You can find more information by searching that property in the documentation: https://kafka.apache.org/documentation/ On Tue, Feb 19, 2019 at 6:39 AM Soheil Pourbafrani <soheil.i...@gmail.com> wrote: > Recently I noticed that when I create a new empty topic, each partition > will have 21MB data! I even change the Kafka version from 0.11.3 to 2.1.0 > but it shows the same behavior. For example, if I create a new topic using > the command : > > kafka-topics.sh --zookeeper zoo1:2181 --create --topic test > --replication-factor 1 --partitions 5 > > here is the list of files in the LOG_DIR/test-1 (Partition one of the topic > test) > > 10M test-1/00000000000000000000.index > 0 test-1/00000000000000000000.log > 10M test-1/00000000000000000000.timeindex > 4.0K test-1/leader-epoch-checkpoint > > Is it natural behavior? >
