Re: taking broker down and returning it does not restore cluster state (nor rebalance)

2014-10-21 Thread Shlomi Hazan
trying to reproduce failed: after somewhat long minutes I noticed that the partition leaders regained balance again, and the only issue left is that the preferred replica was not balanced as it was before taking the broker down. meaning, that the output of the topic description shows broker 1 (out

Re: taking broker down and returning it does not restore cluster state (nor rebalance)

2014-10-21 Thread Jun Rao
To balance the leaders, you can run the tool in http://kafka.apache.org/documentation.html#basic_ops_leader_balancing In the upcoming 0.8.2 release, we have fixed the auto leader balancing logic. So leaders will be balanced automatically. Thanks, Jun On Tue, Oct 21, 2014 at 12:19 AM, Shlomi

taking broker down and returning it does not restore cluster state (nor rebalance)

2014-10-20 Thread Shlomi Hazan
Hi, Running some tests on 0811 and wanted to see what happens when a broker is taken down with 'kill'. I bumped into the situation at the subject where launching the broker back left him a bit out of the game as far as I could see using stack driver metrics. Trying to rebalance with verify

Re: taking broker down and returning it does not restore cluster state (nor rebalance)

2014-10-20 Thread Neha Narkhede
Did you ensure that your replication factor was set higher than 1? If so, things should recover automatically after adding the killed broker back into the cluster. On Mon, Oct 20, 2014 at 1:32 AM, Shlomi Hazan shl...@viber.com wrote: Hi, Running some tests on 0811 and wanted to see what

Re: taking broker down and returning it does not restore cluster state (nor rebalance)

2014-10-20 Thread Shlomi Hazan
Yes I did. It is set to 2. On Oct 20, 2014 5:38 PM, Neha Narkhede neha.narkh...@gmail.com wrote: Did you ensure that your replication factor was set higher than 1? If so, things should recover automatically after adding the killed broker back into the cluster. On Mon, Oct 20, 2014 at 1:32

Re: taking broker down and returning it does not restore cluster state (nor rebalance)

2014-10-20 Thread Joel Koshy
As Neha mentioned, with rep factor 2x, this shouldn't normally cause an issue. Taking the broker down will cause the leader to move to another replica; consumers and producers will rediscover the new leader; no rebalances should be triggered. When you bring the broker back up, unless you run a