haiyangyu created KAFKA-7690:
--------------------------------
Summary: Change disk allocation policy for multiple partitions on
a broker when topic is created
Key: KAFKA-7690
URL: https://issues.apache.org/jira/browse/KAFKA-7690
Project: Kafka
Issue Type: Improvement
Affects Versions: 2.0.0, 1.0.0, 0.10.2.0
Reporter: haiyangyu
h3. *Background*
if target topic partitions lager than broker size when create a topic or add
partition, one broker will be assigned more than one partition. if current all
disk is not balance, such as one disk has one partition and the other one has
four partitions due to topic delete or others, the mutil partitions will be all
allocated in the first disk, and if the target topic has a large flow, it is
easily to fill up the disk io.
h3. *Improvement strategy*
when mutil ** partition is going to be allocated on a broker, the strategy is
as follow:
1、calculate the target topic partition count and total partition count on each
disk.
topic count
2、sorted by the target topic partition count wich ascending order, if the
target topic partition count is equal, sorted by the total partitions on each
disk.
h3. *Example*
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)