vikash kumar created KAFKA-9163: ----------------------------------- Summary: Re-assignment of Partition gets infinitely stuck "Still in progress" state Key: KAFKA-9163 URL: https://issues.apache.org/jira/browse/KAFKA-9163 Project: Kafka Issue Type: Bug Affects Versions: 0.10.1.1 Environment: Amazon Linux 1 x86_64 GNU/Linux Reporter: vikash kumar
We have 6 node kafka cluster. Out of the 6 machines, 3 of them have both Kafka + zookeeper, and the remaining 3 of them have just kafka. Recently, we added one more kafka node. While re-assigning the partition to all the nodes (including the newer one), we executed the below command: /opt/kafka/bin/kafka-reassign-partitions.sh --reassignment-json-file new_assignment_details.json --execute --zookeeper localhost:2181 However, when we verified the status by using the below command, /opt/kafka/bin/kafka-reassign-partitions.sh --reassignment-json-file new_assignment_details.json --verify --zookeeper localhost:2181 We get the below output. Some of the partitions are re-assignment is still in progress. /opt/kafka/bin/kafka-reassign-partitions.sh --reassignment-json-file new_assignment_details.json --verify --zookeeper localhost:2181 | grep 'progress' Reassignment of partition [topic-name,854] is still in progress Reassignment of partition [topic-name,674] is still in progress Reassignment of partition [topic-name,944] is still in progress Reassignment of partition [topic-name,404] is still in progress Reassignment of partition [topic-name,314] is still in progress Reassignment of partition [topic-name,853] is still in progress Reassignment of partition [prom-metrics,403] is still in progress Reassignment of partition [prom-metrics,134] is still in progress There is no way to either: 1. Cancel the on-going partition re-assignment. 2. Rollback is also not possible. ( When we try doing that it says that "There is an existing assignment running." -- This message was sent by Atlassian Jira (v8.3.4#803005)