Re: adding replicas to existing topic partitions - KAFKA-1313

2015-03-10 Thread Neha Narkhede
As Ewen suggests, you might want to take a look at KIP-6. The only thing to be careful about is not moving data for partitions other than those belonging to the topics whose replication factor is being changed by the tool. It seems logical to expose this via the kafka-topics --alter option. Thank

Re: adding replicas to existing topic partitions - KAFKA-1313

2015-03-09 Thread Ewen Cheslack-Postava
Geoff, First, if you haven't already, take a look at https://cwiki.apache.org/confluence/display/KAFKA/KIP-6+-+New+reassignment+partition+logic+for+rebalancing and the associated JIRA. My opinion is that we shouldn't do anything to the existing partitions -- it would probably violate the principl

adding replicas to existing topic partitions - KAFKA-1313

2015-03-09 Thread Geoffrey Anderson
Hi dev list, I have a few questions regarding KAFKA-1313 ( https://issues.apache.org/jira/browse/KAFKA-1313) It is currently possible albeit in a kindof hacky way to increase replication factor on a topic by using the partition reassignment tool with a hand-crafted reassignment plan. The preferre