Gwen Shapira created KAFKA-8180: ----------------------------------- Summary: Deleting large number of topics can block the controller for the time it takes to delete all of them Key: KAFKA-8180 URL: https://issues.apache.org/jira/browse/KAFKA-8180 Project: Kafka Issue Type: Bug Components: controller Reporter: Gwen Shapira
Scenario: - Create large number of topics (In my experiment: 400 topics with 12 partitions each ) - Use the admin client to delete all of them in a single batch operation - Try to bounce another broker while this is going on As you can see from the logs and metrics - topic deletion happens synchronously in the controller and it does not do anything else (leader elections for instance) while it is busy deleting (which can take many minutes for large batches). I recommend fixing it by throttling the deletes - no matter how large a batch the client sent, the controller should delete a subset and complete a full cycle before deleting the next subset. -- This message was sent by Atlassian JIRA (v7.6.3#76005)