How to achieve uniform distribution of non-keyed messages per topic across all partitions?
We have tried to do this uniform distribution across partition using custom partitioning from each producer instance using round robing ( count(messages) % number of partition for topic). This strategy results in very poor performance. So we have switched back to random stickiness that Kafka provide out of box per some interval ( 10 minutes not sure exactly ) per topic. The above strategy results in consumer side lags sometime for some partitions because we have some applications/producers producing more messages for same topic than other servers. Can Kafka provide out of box uniform distribution by using coordination among all producers and rely on measure rate such as # messages per minute or # of bytes produce per minute to achieve uniform distribution and coordinate stickiness of partition among hundreds of producers for same topic ? Thanks, Bhavesh
