[jira] [Commented] (KAFKA-886) Update info on Controlled shutdown and Preferred replica election tool
[ https://issues.apache.org/jira/browse/KAFKA-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13646092#comment-13646092 ] Joel Koshy commented on KAFKA-886: -- Thanks for the great write-up. Couple of comments: 1) We should probably add a note on the controlled shutdown tool (script) usage that it is currently JMX-based and depends on the jmx.remote.port property being set (otherwise you won't be be able to use the script and will need to poke jmx through other means). We can reference KAFKA-817 which will remedy this and make it zookeeper-based instead of JMX. 2) Due to the above, in case people need to use local JMX operations and essentially do manually what the script does automatically then it is best to do a controlled shutdown and bounce of the controller last (as otherwise there would be unnecessary controller re-elections). 3) For the ListTopicCommand tool - maybe we should mention that if there are a lot of topics and we list info for all topics it can take a while to run unless it is in the same datacenter as the ZK cluster. Actually I think the ListTopicCommand should really be using the SimpleConsumer or producer to fetch metadata instead of reading ZK directly. That way, people don't have to zip up Kafka and copy it over to their production environment. What do you think? Update info on Controlled shutdown and Preferred replica election tool -- Key: KAFKA-886 URL: https://issues.apache.org/jira/browse/KAFKA-886 Project: Kafka Issue Type: Sub-task Affects Versions: 0.8 Reporter: Sriram Subramanian Assignee: Sriram Subramanian Priority: Blocker Labels: p1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-886) Update info on Controlled shutdown and Preferred replica election tool
[ https://issues.apache.org/jira/browse/KAFKA-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644787#comment-13644787 ] Sriram Subramanian commented on KAFKA-886: -- https://cwiki.apache.org/confluence/display/KAFKA/Replication+tools Update info on Controlled shutdown and Preferred replica election tool -- Key: KAFKA-886 URL: https://issues.apache.org/jira/browse/KAFKA-886 Project: Kafka Issue Type: Sub-task Affects Versions: 0.8 Reporter: Sriram Subramanian Assignee: Sriram Subramanian Priority: Blocker Labels: p1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-886) Update info on Controlled shutdown and Preferred replica election tool
[ https://issues.apache.org/jira/browse/KAFKA-886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644863#comment-13644863 ] Jun Rao commented on KAFKA-886: --- Thanks for the write-up. Some comments. 1. It would be useful to highlight the motivation of the controlled shutdown tool. Basically, it reduces the unavailable window. If we simply shutdown a broker without running the tool first, partitions with leader on the broker are not available until the new leaders are elected. Since we currently elect leaders sequentially one partition at a time and each leader election involves reads/writes to ZK, it may take some time for all leaders to be elected, especially when there are many partitions. Running the controlled shutdown tool allows us to move the leader proactively one at a time and thus reduce the unavailable window. 2. We also need to add that once the controlled shutdown tool runs successfully, one can shutdown the broker as normal. 3. We need to describe how to find the controller. 4. It would be useful to describe the list-topic and the create-topic tool as well. Update info on Controlled shutdown and Preferred replica election tool -- Key: KAFKA-886 URL: https://issues.apache.org/jira/browse/KAFKA-886 Project: Kafka Issue Type: Sub-task Affects Versions: 0.8 Reporter: Sriram Subramanian Assignee: Sriram Subramanian Priority: Blocker Labels: p1 -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
