Increasing replica.fetch.max.bytes will help, but will only get diminishing
returns at some point.
Increasing num.replica.fetchers will also help. You need to make sure that
the leaders are balanced in the cluster. See
http://kafka.apache.org/documentation.html#basic_ops_leader_balancing
Thanks,
What kind of network do you have? gigabit? if so 90 MB/s would make
sense
Also since you have one partition what's your raw transfer speed to the
disk? 90 MB/s makes sense here as well...
If I were looking for rapid replica catch up I'd have at least 2x Gbit and
partitioned topics spread out
Hi All,
I am trying to figure out best configuration for my Kafka brokers so that
in case of restarted, the new node catch up with Leader at quick pace.
My test environment has 2 kafka brokers and 1 Topic with one Partition.
I first ran the test (Test#1) with default setting, i.e.
