If you are also planning on a version upgrade as part of this, it might be safer to create the new cluster separately and use the mirror maker to copy data over. On Aug 26, 2014 6:29 AM, "Marcin Michalski" <mmichal...@tagged.com> wrote:
> Hi, I would like to migrate my Kafka setup from old servers to new servers. > Let say I have 8 really old servers that have the kafka topics/partitions > replicated 4 ways and want to migrate the data to 4 brand new servers and > want the replication factor be 3. I wonder if anyone has ever performed > this type of migration? > > Will auto rebalancing take care of this automatically if I do the > following? > > Let say I bring down old broker id 1 down and startup new server broker id > 100 up, is there a way to migrate all of the data of the topic that had the > topic (where borker id 1 was the leader) over to the new broker 100? > > Or do I need to use *bin/kafka-preferred-replica-election.sh *to reassign > the topics/partitions from old broker 1 to broker 100? And then just keep > doing the same thing until all of the old brokers are decommissioned? > > Also, would kafka-preferred-replica-election.sh let me actually lower the > number of replicas as well, if I just simply make sure that given > topic/partition was only elected 3 times versus 4? > > Thanks for your insight, > Marcin >