[
https://issues.apache.org/jira/browse/KAFKA-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edoardo Comar updated KAFKA-17993:
----------------------------------
Description:
Running the reassignment script when a topic had 5000 partitions, with both
throttle options being set, the tool remained stuck with an exception
The same json file previously passed the --verify step
Reproduced on today's trunk (4.0), here's the Stack trace for 3.9.1-SNAPSHOT :
{{[2024-11-12 16:15:43,516] ERROR Uncaught exception in thread
'kafka-admin-client-thread | reassign-partitions-tool':
(org.apache.kafka.common.utils.KafkaThread)}}
{{java.lang.RuntimeException: 'value' field is too long to be serialized}}
{{ at
org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterableConfig.addSize(IncrementalAlterConfigsRequestData.java:776)}}
{{ at
org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterConfigsResource.addSize(IncrementalAlterConfigsRequestData.java:463)}}
{{ at
org.apache.kafka.common.message.IncrementalAlterConfigsRequestData.addSize(IncrementalAlterConfigsRequestData.java:187)}}
{{ at
org.apache.kafka.common.protocol.SendBuilder.buildSend(SendBuilder.java:218)}}
{{ at
org.apache.kafka.common.protocol.SendBuilder.buildRequestSend(SendBuilder.java:187)}}
{{ at
org.apache.kafka.common.requests.AbstractRequest.toSend(AbstractRequest.java:108)}}
{{ at org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:559)}}
{{ at org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:533)}}
{{ at org.apache.kafka.clients.NetworkClient.send(NetworkClient.java:493)}}
{{ at
org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.sendEligibleCalls(KafkaAdminClient.java:1317)}}
{{ at
org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.processRequests(KafkaAdminClient.java:1530)}}
{{ at
org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1473)}}
{{ at java.base/java.lang.Thread.run(Thread.java:840)}}
was:
Running the reassignment script for about 6000 partitions, with both throttle
options being set, the tool remained stuck with this exception
The same json file previously passed the --verify step
reproduced on today's trunk (4.0), here's the Stack trace for 3.9.1-SNAPSHOT :
{{[2024-11-12 16:15:43,516] ERROR Uncaught exception in thread
'kafka-admin-client-thread | reassign-partitions-tool':
(org.apache.kafka.common.utils.KafkaThread)}}
{{java.lang.RuntimeException: 'value' field is too long to be serialized}}
{{ at
org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterableConfig.addSize(IncrementalAlterConfigsRequestData.java:776)}}
{{ at
org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterConfigsResource.addSize(IncrementalAlterConfigsRequestData.java:463)}}
{{ at
org.apache.kafka.common.message.IncrementalAlterConfigsRequestData.addSize(IncrementalAlterConfigsRequestData.java:187)}}
{{ at
org.apache.kafka.common.protocol.SendBuilder.buildSend(SendBuilder.java:218)}}
{{ at
org.apache.kafka.common.protocol.SendBuilder.buildRequestSend(SendBuilder.java:187)}}
{{ at
org.apache.kafka.common.requests.AbstractRequest.toSend(AbstractRequest.java:108)}}
{{ at org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:559)}}
{{ at org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:533)}}
{{ at org.apache.kafka.clients.NetworkClient.send(NetworkClient.java:493)}}
{{ at
org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.sendEligibleCalls(KafkaAdminClient.java:1317)}}
{{ at
org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.processRequests(KafkaAdminClient.java:1530)}}
{{ at
org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1473)}}
{{ at java.base/java.lang.Thread.run(Thread.java:840)}}
> reassign partition tool stuck with uncaught exception: 'value' field is too
> long to be serialized
> -------------------------------------------------------------------------------------------------
>
> Key: KAFKA-17993
> URL: https://issues.apache.org/jira/browse/KAFKA-17993
> Project: Kafka
> Issue Type: Bug
> Components: clients
> Affects Versions: 4.0.0, 3.6.2, 3.9.0
> Reporter: Edoardo Comar
> Priority: Major
>
> Running the reassignment script when a topic had 5000 partitions, with both
> throttle options being set, the tool remained stuck with an exception
> The same json file previously passed the --verify step
> Reproduced on today's trunk (4.0), here's the Stack trace for 3.9.1-SNAPSHOT :
> {{[2024-11-12 16:15:43,516] ERROR Uncaught exception in thread
> 'kafka-admin-client-thread | reassign-partitions-tool':
> (org.apache.kafka.common.utils.KafkaThread)}}
> {{java.lang.RuntimeException: 'value' field is too long to be serialized}}
> {{ at
> org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterableConfig.addSize(IncrementalAlterConfigsRequestData.java:776)}}
> {{ at
> org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterConfigsResource.addSize(IncrementalAlterConfigsRequestData.java:463)}}
> {{ at
> org.apache.kafka.common.message.IncrementalAlterConfigsRequestData.addSize(IncrementalAlterConfigsRequestData.java:187)}}
> {{ at
> org.apache.kafka.common.protocol.SendBuilder.buildSend(SendBuilder.java:218)}}
> {{ at
> org.apache.kafka.common.protocol.SendBuilder.buildRequestSend(SendBuilder.java:187)}}
> {{ at
> org.apache.kafka.common.requests.AbstractRequest.toSend(AbstractRequest.java:108)}}
> {{ at
> org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:559)}}
> {{ at
> org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:533)}}
> {{ at org.apache.kafka.clients.NetworkClient.send(NetworkClient.java:493)}}
> {{ at
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.sendEligibleCalls(KafkaAdminClient.java:1317)}}
> {{ at
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.processRequests(KafkaAdminClient.java:1530)}}
> {{ at
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1473)}}
> {{ at java.base/java.lang.Thread.run(Thread.java:840)}}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
