[ https://issues.apache.org/jira/browse/KAFKA-16969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luke Chen resolved KAFKA-16969. ------------------------------- Fix Version/s: 3.8.0 3.7.1 Assignee: Igor Soarez Resolution: Fixed > KRaft unable to upgrade to v3.7.1 and later when multiple log dir is set > ------------------------------------------------------------------------ > > Key: KAFKA-16969 > URL: https://issues.apache.org/jira/browse/KAFKA-16969 > Project: Kafka > Issue Type: Bug > Affects Versions: 3.8.0, 3.7.1 > Reporter: Luke Chen > Assignee: Igor Soarez > Priority: Blocker > Fix For: 3.8.0, 3.7.1 > > > After KAFKA-16606, we added validation metadata version for JBOD support. > This validation works well in isolated KRaft mode (i.e. separate > controller/broker node). But when in combined mode, this validation will let > the node fail to startup. The log will be like this: > {code:java} > [2024-06-15 16:00:45,621] INFO [BrokerServer id=1] Waiting for the broker > metadata publishers to be installed (kafka.server.BrokerServer) > [2024-06-15 16:00:45,621] INFO [BrokerServer id=1] Finished waiting for the > broker metadata publishers to be installed (kafka.server.BrokerServer) > [2024-06-15 16:00:45,621] INFO [BrokerServer id=1] Waiting for the controller > to acknowledge that we are caught up (kafka.server.BrokerServer) > [2024-06-15 16:00:45,621] INFO [MetadataLoader id=1] InitializeNewPublishers: > initializing MetadataVersionPublisher(id=1) with a snapshot at offset 4 > (org.apache.kafka.image.loader.MetadataLoader) > [2024-06-15 16:00:45,621] ERROR Encountered metadata publishing fault: Broker > configuration does not support the cluster MetadataVersion > (org.apache.kafka.server.fault.LoggingFaultHandler) > java.lang.IllegalArgumentException: requirement failed: Multiple log > directories (aka JBOD) are not supported in the current MetadataVersion > 3.6-IV2. Need 3.7-IV2 or higher > at scala.Predef$.require(Predef.scala:337) > at > kafka.server.KafkaConfig.validateWithMetadataVersion(KafkaConfig.scala:2545) > at > kafka.server.MetadataVersionConfigValidator.onMetadataVersionChanged(MetadataVersionConfigValidator.java:62) > at > kafka.server.MetadataVersionConfigValidator.onMetadataUpdate(MetadataVersionConfigValidator.java:55) > at > org.apache.kafka.image.loader.MetadataLoader.initializeNewPublishers(MetadataLoader.java:309) > at > org.apache.kafka.image.loader.MetadataLoader.lambda$scheduleInitializeNewPublishers$0(MetadataLoader.java:266) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:1623) > [2024-06-15 16:00:45,622] ERROR Encountered fatal fault: Unhandled error > initializing MetadataVersionPublisher(id=1) with a snapshot at offset 4 > (org.apache.kafka.server.fault.ProcessTerminatingFaultHandler) > org.apache.kafka.server.fault.FaultHandlerException: Broker configuration > does not support the cluster MetadataVersion > at scala.Predef$.require(Predef.scala:337) > at > kafka.server.KafkaConfig.validateWithMetadataVersion(KafkaConfig.scala:2545) > at > kafka.server.MetadataVersionConfigValidator.onMetadataVersionChanged(MetadataVersionConfigValidator.java:62) > at > kafka.server.MetadataVersionConfigValidator.onMetadataUpdate(MetadataVersionConfigValidator.java:55) > at > org.apache.kafka.image.loader.MetadataLoader.initializeNewPublishers(MetadataLoader.java:309) > at > org.apache.kafka.image.loader.MetadataLoader.lambda$scheduleInitializeNewPublishers$0(MetadataLoader.java:266) > at > org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java:127) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQueue.java:210) > at > org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java:181) > at java.base/java.lang.Thread.run(Thread.java:1623) > Caused by: java.lang.IllegalArgumentException: requirement failed: Multiple > log directories (aka JBOD) are not supported in the current MetadataVersion > 3.6-IV2. Need 3.7-IV2 or higher > ... 10 more{code} > > This will block combined node setting multiple log dirs upgrade to v3.7.1 or > later. -- This message was sent by Atlassian Jira (v8.20.10#820010)