Kafka 3.6.2 – thanks, Paul From: Ömer Şiar Baysal <[email protected]> Date: Thursday, 11 July 2024 at 9:57 PM To: [email protected] <[email protected]> Subject: Re: Error creating a topic with 10k partitions but not altering existing topic to 10k partitions? Why [You don't often get email from [email protected]. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ]
EXTERNAL EMAIL - USE CAUTION when clicking links or attachments Hi, I have never seen PolicyViolationException before with vanilla Kafka. What is the flavor? This may caused by the controller mutation rate checks introduced by KIP-599, it may be triggered for non-existing topics but not for the existing resources. Hope this help you track it down. OSB On Thu, Jul 11, 2024, 08:04 Brebner, Paul <[email protected]> wrote: > Hi – just curious if anyone can suggest why the following occurs: > > 1 – try to create a topic with 10,000 partitions with Kafka CLI > (kafka-topics.sh) > Fails with ERROR org.apache.kafka.common.errors.PolicyViolationException: > Unable to perform excessively large batch operation. > > 2- create a topic with 1 partition with Kafka CLI, and alter to 10k > partitions - works fine > > Paul > > >
