Chia-Ping Tsai created KAFKA-14874:
--------------------------------------

             Summary: Unable to create > 5000 topics for once when using Kraft
                 Key: KAFKA-14874
                 URL: https://issues.apache.org/jira/browse/KAFKA-14874
             Project: Kafka
          Issue Type: Bug
            Reporter: Chia-Ping Tsai
            Assignee: Chia-Ping Tsai


the error happens due to 
[https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/controller/QuorumController.java#L779]

I encountered this error when creating >5000 topics for mirroring the cluster 
from zk to Kraft. The operation of creating a bunch of topics is allowed by 
zk-based kafka.

It seems to me there are two improvements for this issue.

1) add more precise error message for such case.

2) make `maxRecordsPerBatch` configurable (there is already a setter 
[https://github.com/apache/kafka/blob/trunk/metadata/src/main/java/org/apache/kafka/controller/QuorumController.java#L272])



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to