Hi all, I created a Kafka rebalancer (in bash) which minimizes the number of partitions to be moved around when a broker (or more than one) is added or removed from the cluster.
Contrarily to the already available 'kafka-reassign-partitions' (which comes with Kafka package), this new tool works in a least effort way, and that makes a big difference on big (in size) clusters. It does not require extra packages to be installed because it is written in bash. That means also K8s ready! It can run in an unattended way to downscale a cluster in an automagic way, and with very little scripting around it, it can also run unattended when upscaling. You can find the newborn tool here: https://github.com/dba-git/kafka_smart_rebalancer/ Feedback and contributions are welcome! Regards, Fabio Pardi Agileos Consulting LTD https://www.agileosconsulting.com/
