Hi All, I've renamed my KIP as its name was a bit confusing so we'll continue it in this thread. The previous thread for record: https://lists.apache.org/thread.html/0e97e30271f80540d4da1947bba94832639767e511a87bb2ba530fe7@%3Cdev.kafka.apache.org%3E
A short summary of the KIP: In case of a vast partition reassignment (thousands of partitions at once) Kafka can collapse under the increased replication traffic. This KIP will mitigate it by introducing internal batching done by the controller. Besides putting a bandwidth limit on the replication it is useful to batch partition movements as fewer number of partitions will use the available bandwidth for reassignment and they finish faster. The main control handles are: - the number of parallel leader movements, - the number of parallel partition movements - and the number of parallel replica movements. Thank you for the feedback and ideas so far in the previous thread and I'm happy to receive more. Regards, Viktor
