Have you verified that the old leader of the partition is using the same I'd as before? Check in zk /brokers/ids to get a list of available brokers. I would use the reassignment tool to move partition 3 to brokers in the list from zk (specifying only 3 brokers). Make sure to include broker with ID 1 since it was the only ISR in the list before restart. I would start there On Jun 1, 2016 11:40 AM, "Tushar Agrawal" <agrawal.tus...@gmail.com> wrote:
> Hi, > > We have 5 brokers running on 0.9.0.1 with 5 ZK. This morning, multiple > topics were having "unavailable-partitions" (whose leader is not > available). After looking at multiple logs, forums and google results, we > finally restarted all the brokers one by one and issue seems to be > resolved. > > However, for that particular partition now we have "five" ISR instead of > "3". What should we do to fix this issue? > > > *Before restart* > > Topic:topic1 PartitionCount:8 ReplicationFactor:3 Configs:retention.ms > =259200000 > Topic: topic1 Partition: 0 Leader: 0 Replicas: 0,3,4 Isr: 0,3,4 > Topic: topic1 Partition: 1 Leader: 1 Replicas: 1,4,0 Isr: 0,1,4 > Topic: topic1 Partition: 2 Leader: 2 Replicas: 2,0,1 Isr: 1,2,0 > Topic: topic1 Partition: 3 Leader: -1 Replicas: 0,1,2,3,4 Isr: 1 > Topic: topic1 Partition: 4 Leader: 4 Replicas: 4,2,3 Isr: 4,3,2 > Topic: topic1 Partition: 5 Leader: 1 Replicas: 0,4,1 Isr: 1,4,0 > Topic: topic1 Partition: 6 Leader: 2 Replicas: 1,0,2 Isr: 2,0,1 > Topic: topic1 Partition: 7 Leader: 3 Replicas: 2,1,3 Isr: 3,2,1 > > *After restart* > > Topic:topic1 PartitionCount:8 ReplicationFactor:3 Configs:retention.ms > =259200000 > Topic: topic1 Partition: 0 Leader: 0 Replicas: 0,3,4 Isr: 0,3,4 > Topic: topic1 Partition: 1 Leader: 1 Replicas: 1,4,0 Isr: 0,1,4 > Topic: topic1 Partition: 2 Leader: 2 Replicas: 2,0,1 Isr: 2,0,1 > Topic: topic1 Partition: 3 Leader: 0 Replicas: 0,1,2,3,4 Isr: 0,1,2,3,4 > Topic: topic1 Partition: 4 Leader: 4 Replicas: 4,2,3 Isr: 3,4,2 > Topic: topic1 Partition: 5 Leader: 0 Replicas: 0,4,1 Isr: 0,1,4 > Topic: topic1 Partition: 6 Leader: 1 Replicas: 1,0,2 Isr: 0,1,2 > Topic: topic1 Partition: 7 Leader: 2 Replicas: 2,1,3 Isr: 2,1,3 > > Thank you, > Tushar >
