Hello,

we currently have an "UnwritableMetadataException" error starting Kafka in
our test environment. Unfortunately, I don't know whether it is due to an
incorrect configuration or something similar. Kafka is running in a Docker
Container, but I don't think that's the cause. When I Google this error, I
unfortunately don't find any results. 

We are currently using Kafka version 3.7.0.

Does anyone have any tips or did anyone experience this error before? The
following is a log excerpt:

 

 

kafka  | kafka 06:17:49.01 INFO  ==>

kafka  | kafka 06:17:49.02 INFO  ==> Welcome to the Bitnami kafka container

kafka  | kafka 06:17:49.02 INFO  ==> Subscribe to project updates by
watching https://github.com/bitnami/containers

kafka  | kafka 06:17:49.02 INFO  ==> Submit issues and feature requests at
https://github.com/bitnami/containers/issues

kafka  | kafka 06:17:49.02 INFO  ==> Upgrade to Tanzu Application Catalog
for production environments to access custom-configured and pre-packaged
software components. Gain enhanced features, including Software Bill of
Materials (SBOM), CVE scan result reports, and VEX documents. To learn more,
visit https://bitnami.com/enterprise

kafka  | kafka 06:17:49.02 INFO  ==>

kafka  | kafka 06:17:49.03 INFO  ==> ** Starting Kafka setup **

kafka  | kafka 06:17:50.68 INFO  ==> Initializing Kafka...

kafka  | kafka 06:17:50.69 INFO  ==> No injected configuration files found,
creating default config files

kafka  | kafka 06:17:51.24 INFO  ==> Initializing KRaft storage metadata

kafka  | kafka 06:17:51.25 INFO  ==> Formatting storage directories to add
metadata...

kafka  |
metaPropertiesEnsemble=MetaPropertiesEnsemble(metadataLogDir=Optional.empty,
dirs={/bitnami/kafka/data: MetaProperties(version=1, clusterId=<cluster_id>,
nodeId=2, directoryId=85zdFJUTcbfYz0NwP8U3iA)})

kafka  | All of the log directories are already formatted.

kafka  | kafka 06:17:53.21 INFO  ==> ** Kafka setup finished! **

kafka  |

kafka  | kafka 06:17:53.23 INFO  ==> ** Starting Kafka **

kafka  | [2024-04-16 06:17:54,210] INFO Registered
kafka:type=kafka.Log4jController MBean
(kafka.utils.Log4jControllerRegistration$)

kafka  | [2024-04-16 06:17:54,607] INFO Setting -D
jdk.tls.rejectClientInitiatedRenegotiation=true to disable client-initiated
TLS renegotiation (org.apache.zookeeper.common.X509Util)

kafka  | [2024-04-16 06:17:54,815] INFO Registered signal handlers for TERM,
INT, HUP (org.apache.kafka.common.utils.LoggingSignalHandler)

kafka  | [2024-04-16 06:17:54,819] INFO [ControllerServer id=2] Starting
controller (kafka.server.ControllerServer)

kafka  | [2024-04-16 06:17:55,465] INFO Updated connection-accept-rate max
connection creation rate to 2147483647 (kafka.network.ConnectionQuotas)

kafka  | [2024-04-16 06:17:56,298] INFO [SocketServer
listenerType=CONTROLLER, nodeId=2] Created data-plane acceptor and
processors for endpoint : ListenerName(CONTROLLER)
(kafka.network.SocketServer)

kafka  | [2024-04-16 06:17:56,302] INFO CONTROLLER: resolved wildcard host
to kafka (org.apache.kafka.metadata.ListenerInfo)

kafka  | [2024-04-16 06:17:56,312] INFO authorizerStart completed for
endpoint CONTROLLER. Endpoint is now READY.
(org.apache.kafka.server.network.EndpointReadyFutures)

kafka  | [2024-04-16 06:17:56,312] INFO [SharedServer id=2] Starting
SharedServer (kafka.server.SharedServer)

kafka  | [2024-04-16 06:17:56,405] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Recovering
unflushed segment 2639301. 0/3 recovered for __cluster_metadata-0.
(kafka.log.LogLoader)

kafka  | [2024-04-16 06:17:56,408] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Loading producer
state till offset 2639301 with message format version 2
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:17:56,409] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Reloading from
producer snapshot and rebuilding producer state from offset 2639301
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:17:56,410] INFO Deleted producer state snapshot
/bitnami/kafka/data/__cluster_metadata-0/00000000000003954853.snapshot
(org.apache.kafka.storage.internals.log.SnapshotFile)

kafka  | [2024-04-16 06:17:56,410] INFO Deleted producer state snapshot
/bitnami/kafka/data/__cluster_metadata-0/00000000000005164322.snapshot
(org.apache.kafka.storage.internals.log.SnapshotFile)

kafka  | [2024-04-16 06:17:56,411] INFO Deleted producer state snapshot
/bitnami/kafka/data/__cluster_metadata-0/00000000000006183812.snapshot
(org.apache.kafka.storage.internals.log.SnapshotFile)

kafka  | [2024-04-16 06:17:56,420] INFO [ProducerStateManager
partition=__cluster_metadata-0] Wrote producer snapshot at offset 2639301
with 0 producer ids in 7 ms.
(org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:17:56,420] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Producer state
recovery took 1ms for snapshot load and 9ms for segment recovery from offset
2639301 (kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:01,061] INFO [ProducerStateManager
partition=__cluster_metadata-0] Wrote producer snapshot at offset 3954853
with 0 producer ids in 1 ms.
(org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:18:01,061] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Recovering
unflushed segment 3954853. 1/3 recovered for __cluster_metadata-0.
(kafka.log.LogLoader)

kafka  | [2024-04-16 06:18:01,063] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Loading producer
state till offset 3954853 with message format version 2
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:01,063] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Reloading from
producer snapshot and rebuilding producer state from offset 3954853
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:01,063] INFO [ProducerStateManager
partition=__cluster_metadata-0] Loading producer state from snapshot file
'SnapshotFile(offset=3954853,
file=/bitnami/kafka/data/__cluster_metadata-0/00000000000003954853.snapshot)
' (org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:18:01,066] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Producer state
recovery took 3ms for snapshot load and 0ms for segment recovery from offset
3954853 (kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:05,185] INFO [ProducerStateManager
partition=__cluster_metadata-0] Wrote producer snapshot at offset 5164322
with 0 producer ids in 1 ms.
(org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:18:05,186] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Recovering
unflushed segment 5164322. 2/3 recovered for __cluster_metadata-0.
(kafka.log.LogLoader)

kafka  | [2024-04-16 06:18:05,187] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Loading producer
state till offset 5164322 with message format version 2
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:05,187] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Reloading from
producer snapshot and rebuilding producer state from offset 5164322
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:05,187] INFO [ProducerStateManager
partition=__cluster_metadata-0] Loading producer state from snapshot file
'SnapshotFile(offset=5164322,
file=/bitnami/kafka/data/__cluster_metadata-0/00000000000005164322.snapshot)
' (org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:18:05,188] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Producer state
recovery took 1ms for snapshot load and 0ms for segment recovery from offset
5164322 (kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:08,466] INFO [ProducerStateManager
partition=__cluster_metadata-0] Wrote producer snapshot at offset 6183828
with 0 producer ids in 1 ms.
(org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:18:08,480] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Loading producer
state till offset 6183828 with message format version 2
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:08,480] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Reloading from
producer snapshot and rebuilding producer state from offset 6183828
(kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:08,480] INFO Deleted producer state snapshot
/bitnami/kafka/data/__cluster_metadata-0/00000000000002639301.snapshot
(org.apache.kafka.storage.internals.log.SnapshotFile)

kafka  | [2024-04-16 06:18:08,480] INFO [ProducerStateManager
partition=__cluster_metadata-0] Loading producer state from snapshot file
'SnapshotFile(offset=6183828,
file=/bitnami/kafka/data/__cluster_metadata-0/00000000000006183828.snapshot)
' (org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:18:08,480] INFO [LogLoader
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Producer state
recovery took 0ms for snapshot load and 0ms for segment recovery from offset
6183828 (kafka.log.UnifiedLog$)

kafka  | [2024-04-16 06:18:08,520] INFO Initialized snapshots with IDs
Set(OffsetAndEpoch(offset=2639301, epoch=235)) from
/bitnami/kafka/data/__cluster_metadata-0 (kafka.raft.KafkaMetadataLog$)

kafka  | [2024-04-16 06:18:08,692] INFO [raft-expiration-reaper]: Starting
(kafka.raft.TimingWheelExpirationService$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:08,912] INFO [RaftManager id=2] Completed
transition to FollowerState(fetchTimeoutMs=2000, epoch=2327, leaderId=1,
voters=[1, 2], highWatermark=Optional.empty,
fetchingSnapshot=Optional.empty) from null
(org.apache.kafka.raft.QuorumState)

kafka  | [2024-04-16 06:18:08,916] INFO
[kafka-2-raft-outbound-request-thread]: Starting
(org.apache.kafka.raft.KafkaNetworkChannel$SendThread)

kafka  | [2024-04-16 06:18:08,917] INFO [kafka-2-raft-io-thread]: Starting
(kafka.raft.KafkaRaftManager$RaftIoThread)

kafka  | [2024-04-16 06:18:08,939] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:08,941] INFO [ControllerServer id=2] Waiting for
controller quorum voters future (kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:08,942] INFO [RaftManager id=2] Registered the
listener org.apache.kafka.image.loader.MetadataLoader@1969093581
(org.apache.kafka.raft.KafkaRaftClient)

kafka  | [2024-04-16 06:18:08,942] INFO [ControllerServer id=2] Finished
waiting for controller quorum voters future (kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:09,031] INFO [QuorumController id=2] Creating new
QuorumController with clusterId <cluster_id>.
(org.apache.kafka.controller.QuorumController)

kafka  | [2024-04-16 06:18:09,032] INFO [RaftManager id=2] Registered the
listener
org.apache.kafka.controller.QuorumController$QuorumMetaLogListener@635384855
(org.apache.kafka.raft.KafkaRaftClient)

kafka  | [2024-04-16 06:18:09,040] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,040] INFO
[controller-2-ThrottledChannelReaper-Fetch]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,041] INFO
[controller-2-ThrottledChannelReaper-Produce]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,042] INFO
[controller-2-ThrottledChannelReaper-Request]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,045] INFO
[controller-2-ThrottledChannelReaper-ControllerMutation]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,077] INFO [ExpirationReaper-2-AlterAcls]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:09,108] INFO [ControllerServer id=2] Waiting for
the controller metadata publishers to be installed
(kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:09,108] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,109] INFO [ControllerServer id=2] Finished
waiting for the controller metadata publishers to be installed
(kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:09,112] INFO [SocketServer
listenerType=CONTROLLER, nodeId=2] Enabling request processing.
(kafka.network.SocketServer)

kafka  | [2024-04-16 06:18:09,117] INFO Awaiting socket connections on
0.0.0.0:9091. (kafka.network.DataPlaneAcceptor)

kafka  | [2024-04-16 06:18:09,198] INFO [RaftManager id=2] Completed
transition to Unattached(epoch=138222, voters=[1, 2],
electionTimeoutMs=1496) from FollowerState(fetchTimeoutMs=2000, epoch=2327,
leaderId=1, voters=[1, 2], highWatermark=Optional.empty,
fetchingSnapshot=Optional.empty) (org.apache.kafka.raft.QuorumState)

kafka  | [2024-04-16 06:18:09,201] INFO [QuorumController id=2] In the new
epoch 138222, the leader is (none).
(org.apache.kafka.controller.QuorumController)

kafka  | [2024-04-16 06:18:09,209] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,300] INFO [RaftManager id=2] Completed
transition to Voted(epoch=138222, votedId=1, voters=[1, 2],
electionTimeoutMs=1449) from Unattached(epoch=138222, voters=[1, 2],
electionTimeoutMs=1496) (org.apache.kafka.raft.QuorumState)

kafka  | [2024-04-16 06:18:09,301] INFO [RaftManager id=2] Vote request
VoteRequestData(clusterId='<cluster_id>',
topics=[TopicData(topicName='__cluster_metadata',
partitions=[PartitionData(partitionIndex=0, candidateEpoch=138222,
candidateId=1, lastOffsetEpoch=2327, lastOffset=6183834)])]) with epoch
138222 is granted (org.apache.kafka.raft.KafkaRaftClient)

kafka  | [2024-04-16 06:18:09,310] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,319] INFO [RaftManager id=2] Completed
transition to FollowerState(fetchTimeoutMs=2000, epoch=138222, leaderId=1,
voters=[1, 2], highWatermark=Optional.empty,
fetchingSnapshot=Optional.empty) from Voted(epoch=138222, votedId=1,
voters=[1, 2], electionTimeoutMs=1449) (org.apache.kafka.raft.QuorumState)

kafka  | [2024-04-16 06:18:09,320] INFO [QuorumController id=2] In the new
epoch 138222, the leader is 1.
(org.apache.kafka.controller.QuorumController)

kafka  | [2024-04-16 06:18:09,340] INFO
[controller-2-to-controller-registration-channel-manager]: Starting
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:09,341] INFO [ControllerServer id=2] Waiting for
all of the authorizer futures to be completed
(kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:09,341] INFO [ControllerServer id=2] Finished
waiting for all of the authorizer futures to be completed
(kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:09,341] INFO [ControllerServer id=2] Waiting for
all of the SocketServer Acceptors to be started
(kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:09,341] INFO [ControllerServer id=2] Finished
waiting for all of the SocketServer Acceptors to be started
(kafka.server.ControllerServer)

kafka  | [2024-04-16 06:18:09,342] INFO [ControllerRegistrationManager id=2
incarnation=UKrUxI-6ROCM4xnCzRTr8Q] initialized channel manager.
(kafka.server.ControllerRegistrationManager)

kafka  | [2024-04-16 06:18:09,342] INFO [BrokerServer id=2] Transition from
SHUTDOWN to STARTING (kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:09,342] INFO
[controller-2-to-controller-registration-channel-manager]: Recorded new
controller, from now on will use node <node_1_id>:9091 (id: 1 rack: null)
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:09,344] INFO [BrokerServer id=2] Starting broker
(kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:09,344] INFO [ControllerRegistrationManager id=2
incarnation=UKrUxI-6ROCM4xnCzRTr8Q] maybeSendControllerRegistration: cannot
register yet because the metadata version is still 3.0-IV1, which does not
support KIP-919 controller registration.
(kafka.server.ControllerRegistrationManager)

kafka  | [2024-04-16 06:18:09,355] INFO
[broker-2-ThrottledChannelReaper-Fetch]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,355] INFO
[broker-2-ThrottledChannelReaper-Produce]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,355] INFO
[broker-2-ThrottledChannelReaper-Request]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,356] INFO
[broker-2-ThrottledChannelReaper-ControllerMutation]: Starting
(kafka.server.ClientQuotaManager$ThrottledChannelReaper)

kafka  | [2024-04-16 06:18:09,365] INFO [LocalLog
partition=__cluster_metadata-0, dir=/bitnami/kafka/data] Rolled new log
segment at offset 6183834 in 4 ms. (kafka.log.LocalLog)

kafka  | [2024-04-16 06:18:09,366] INFO [ProducerStateManager
partition=__cluster_metadata-0] Wrote producer snapshot at offset 6183834
with 0 producer ids in 1 ms.
(org.apache.kafka.storage.internals.log.ProducerStateManager)

kafka  | [2024-04-16 06:18:09,387] INFO [BrokerServer id=2] Waiting for
controller quorum voters future (kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:09,387] INFO [BrokerServer id=2] Finished waiting
for controller quorum voters future (kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:09,410] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,510] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,541] INFO
[broker-2-to-controller-forwarding-channel-manager]: Starting
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:09,541] INFO
[broker-2-to-controller-forwarding-channel-manager]: Recorded new
controller, from now on will use node <node_1_id>:9091 (id: 1 rack: null)
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:09,611] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,627] INFO Updated connection-accept-rate max
connection creation rate to 2147483647 (kafka.network.ConnectionQuotas)

kafka  | [2024-04-16 06:18:09,711] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,812] INFO [MetadataLoader id=2]
initializeNewPublishers: the loader is still catching up because we still
don't know the high water mark yet.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,878] INFO [RaftManager id=2] High watermark
set to Optional[LogOffsetMetadata(offset=6183835, metadata=Optional.empty)]
for the first time for epoch 138222 (org.apache.kafka.raft.FollowerState)

kafka  | [2024-04-16 06:18:09,886] INFO [MetadataLoader id=2]
handleLoadSnapshot(00000000000002639301-0000000235): incrementing
HandleLoadSnapshotCount to 1. (org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,892] INFO [QuorumController id=2] Starting to
load snapshot 00000000000002639301-0000000235. Previous lastCommittedOffset
was -1. Previous transactionStartOffset was -1.
(org.apache.kafka.controller.OffsetControlManager)

kafka  | [2024-04-16 06:18:09,935] INFO [QuorumController id=2] Replayed a
FeatureLevelRecord setting metadata version to 3.5-IV2
(org.apache.kafka.controller.FeatureControlManager)

kafka  | [2024-04-16 06:18:09,940] INFO [QuorumController id=2] Replayed
initial RegisterBrokerRecord for broker 1: RegisterBrokerRecord(brokerId=1,
isMigratingZkBroker=false, incarnationId=reiuYG1aT3K2b9l0OBEKUw,
brokerEpoch=2601314, endPoints=[BrokerEndpoint(name='BROKER',
host='<node_1_id>', port=9092, securityProtocol=1)],
features=[BrokerFeature(name='metadata.version', minSupportedVersion=1,
maxSupportedVersion=19)], rack='rack1', fenced=false,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:09,940] INFO [QuorumController id=2] Replayed
initial RegisterBrokerRecord for broker 2: RegisterBrokerRecord(brokerId=2,
isMigratingZkBroker=false, incarnationId=U-yYc2WoQsG4aBo4JL6oLg,
brokerEpoch=2597822, endPoints=[BrokerEndpoint(name='BROKER',
host='<node_2_id>', port=9092, securityProtocol=1)],
features=[BrokerFeature(name='metadata.version', minSupportedVersion=1,
maxSupportedVersion=19)], rack='rack1', fenced=false,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:09,941] INFO [QuorumController id=2] Replayed
TopicRecord for ....

kafka  | [2024-04-16 06:18:09,946] INFO [QuorumController id=2] Replayed
PartitionRecord .....

kafka  | [2024-04-16 06:18:09,966] INFO [MetadataLoader id=2]
handleLoadSnapshot(00000000000002639301-0000000235): generated a metadata
delta between offset -1 and this snapshot in 79315 us.
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,966] INFO [QuorumController id=2] Replayed
....

kafka  | [2024-04-16 06:18:09,972] INFO [MetadataLoader id=2]
maybePublishMetadata(SNAPSHOT): The loader is still catching up because we
have loaded up to offset 2639300, but the high water mark is 6183835
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,972] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:09,973] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 2639300, but the high water mark is 6183835
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:09,973] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:10,221] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:10,306] INFO [SocketServer listenerType=BROKER,
nodeId=2] Created data-plane acceptor and processors for endpoint :
ListenerName(BROKER) (kafka.network.SocketServer)

kafka  | [2024-04-16 06:18:10,306] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:10,346] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:10,346] INFO [QuorumController id=2] Replaying
ProducerIdsRecord ProducerIdsRecord(brokerId=-1, brokerEpoch=-1,
nextProducerId=2000) (org.apache.kafka.controller.ProducerIdControlManager)

kafka  | [2024-04-16 06:18:10,346] INFO [QuorumController id=2] Successfully
loaded snapshot 00000000000002639301-0000000235.
(org.apache.kafka.controller.OffsetControlManager)

kafka  | [2024-04-16 06:18:10,383] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:10,584] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:10,627] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 2756187, but the high water mark is 6183836
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:10,628] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 2756187, but the high water mark is 6183836
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:10,791] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 2872695, but the high water mark is 6183836
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:10,793] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 2872695, but the high water mark is 6183836
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:10,871] INFO
[broker-2-to-controller-directory-assignments-channel-manager]: Starting
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:10,871] INFO
[broker-2-to-controller-directory-assignments-channel-manager]: Recorded new
controller, from now on will use node <node_1_id>:9091 (id: 1 rack: null)
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:10,921] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 2989203, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:10,921] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 2989203, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:10,924] INFO [ExpirationReaper-2-Produce]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:10,925] INFO [ExpirationReaper-2-Fetch]: Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:10,927] INFO [ExpirationReaper-2-DeleteRecords]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:10,932] INFO [ExpirationReaper-2-ElectLeader]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:10,944] INFO [ExpirationReaper-2-RemoteFetch]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:10,987] INFO [ExpirationReaper-2-Heartbeat]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:10,988] INFO [ExpirationReaper-2-Rebalance]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:11,033] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,081] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,081] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3105887, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,081] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,082] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,082] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 3105887, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,084] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,161] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,198] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3222395, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,199] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 3222395, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,292] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3338903, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,313] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,320] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,351] INFO [QuorumController id=2] Replaying
ProducerIdsRecord ProducerIdsRecord(brokerId=1, brokerEpoch=2601314,
nextProducerId=3000) (org.apache.kafka.controller.ProducerIdControlManager)

kafka  | [2024-04-16 06:18:11,400] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3455462, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,400] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 3455462, but the high water mark is 6183837
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,454] INFO
[broker-2-to-controller-heartbeat-channel-manager]: Starting
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:11,454] INFO
[broker-2-to-controller-heartbeat-channel-manager]: Recorded new controller,
from now on will use node <node_1_id>:9091 (id: 1 rack: null)
(kafka.server.NodeToControllerRequestThread)

kafka  | [2024-04-16 06:18:11,460] INFO [BrokerLifecycleManager id=2]
Incarnation ESDRkaqDSJmxIj4k9ACvUw of broker 2 in cluster <cluster_id> is
now STARTING. (kafka.server.BrokerLifecycleManager)

kafka  | [2024-04-16 06:18:11,482] INFO [ExpirationReaper-2-AlterAcls]:
Starting (kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)

kafka  | [2024-04-16 06:18:11,496] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3571970, but the high water mark is 6183838
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,508] INFO [BrokerServer id=2] Waiting for the
broker metadata publishers to be installed (kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:11,527] INFO [BrokerLifecycleManager id=2]
Successfully registered broker 2 with broker epoch 6183839
(kafka.server.BrokerLifecycleManager)

kafka  | [2024-04-16 06:18:11,588] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3688478, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,588] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 3688478, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,589] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 3688478, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,589] INFO [BrokerServer id=2] Finished waiting
for the broker metadata publishers to be installed
(kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:11,589] INFO [BrokerServer id=2] Waiting for the
controller to acknowledge that we are caught up (kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:11,686] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3804986, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,777] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3921494, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,777] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 3921494, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,803] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 3954852, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,846] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,854] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:11,896] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4071360, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:11,896] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 4071360, but the high water mark is 6183839
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,045] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4187868, but the high water mark is 6183840
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,045] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 4187868, but the high water mark is 6183840
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,134] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4304376, but the high water mark is 6183840
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,223] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4420884, but the high water mark is 6183840
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,223] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 4420884, but the high water mark is 6183840
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,320] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4537443, but the high water mark is 6183840
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,417] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4653952, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,417] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 4653952, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,500] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:12,505] INFO [QuorumController id=2] Replayed ...

kafka  | [2024-04-16 06:18:12,514] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4770460, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,620] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 4886968, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,620] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 4886968, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,700] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=2597822, fenced=0,
inControlledShutdown=1, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,711] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5003477, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,721] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=2597822, fenced=1,
inControlledShutdown=0, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,722] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=ZvbsPfyrR8GJ4cc0aCL02A, brokerEpoch=6041410,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,722] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=_2rCXoIgRGWKR32t-7tJqg, brokerEpoch=6041428,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,722] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=UVoarKodTla3dDLDqiGaQQ, brokerEpoch=6041443,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,722] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=poevzBPiTb6BPhK_R3_LSA, brokerEpoch=6041459,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,723] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=DnJG9_4FTTmg48sO4Zfamw, brokerEpoch=6041474,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,723] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=VzXk6c95ReSm42XKqFA3VQ, brokerEpoch=6041490,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,723] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=Pjzw3LroRmCnn9mDGBPEsQ, brokerEpoch=6041506,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,723] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=sci4Y0e2TXmvK4CLoL1aJg, brokerEpoch=6041520,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,723] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=SkfViPK2SUShc7wneiFtnQ, brokerEpoch=6041537,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,723] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=UDaV1NgTSviJe_f_-MxkxA, brokerEpoch=6041552,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,723] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=hnH-57LGTuO9ePW8jU1IQw, brokerEpoch=6041565,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,724] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=J062VeMVRvGZ8bmdHdd2gQ, brokerEpoch=6041583,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,724] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=wKbCjunERjyxGVkxomEVFw, brokerEpoch=6041598,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,724] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=SdOmPk6UQqGGFlCWB8x-Og, brokerEpoch=6041613,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,724] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=XrU8-1prR4KOdBEOf8TwSA, brokerEpoch=6041628,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,724] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=n3_FD0T6QJC1YoIO-FnN1A, brokerEpoch=6041643,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,725] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=by2PFpvmRCmyH3PsyLpeng, brokerEpoch=6041658,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,725] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=vDPICjnHT96sZtLa68U52w, brokerEpoch=6041673,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,725] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=XXBAgPB5TXW36GU3N-p2sw, brokerEpoch=6041687,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,725] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=4mzQ2v9EQZ-hLoWsZAjZnw, brokerEpoch=6041707,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,725] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6041707, fenced=-1,
inControlledShutdown=0, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,735] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6041707, fenced=0,
inControlledShutdown=1, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,745] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6041707, fenced=1,
inControlledShutdown=0, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,745] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=4G8BLM5XT4ybKlskKroO5w, brokerEpoch=6045198,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,745] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6045198, fenced=-1,
inControlledShutdown=0, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,766] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6045198, fenced=0,
inControlledShutdown=1, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,781] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6045198, fenced=1,
inControlledShutdown=0, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,782] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=RdBeuoS4S9-leR_SmNXXwg, brokerEpoch=6051801,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,782] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=qB3jO1QnToehcL-bl2e2yg, brokerEpoch=6051818,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,782] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=xDGc84TmRZKJtGRsXvAsaw, brokerEpoch=6051833,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,782] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=BPMyQdoUQjyg5ZIsQW6Ofw, brokerEpoch=6051847,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,782] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=O6Wm25JFQcyjlvFSsIBgiQ, brokerEpoch=6051863,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,783] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=_L8d9C48SOaa3zFlvVpf1w, brokerEpoch=6051878,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,783] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=2EMhEj6oQJ-Rmi57dmiijA, brokerEpoch=6051893,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,783] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=GDQ3JnogTsOwLmF6dyJj6Q, brokerEpoch=6051908,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,783] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=3sJW96P_ScaImNQ2kbLmqg, brokerEpoch=6051923,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,783] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=qeJ7PyRhSSCOoCtKllDcQA, brokerEpoch=6051938,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,783] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=sWtIC7-xTeS8YVCHQNF1DA, brokerEpoch=6051952,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,784] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6051952, fenced=-1,
inControlledShutdown=0, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,802] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5119985, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,802] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 5119985, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,836] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5164321, but the high water mark is 6183841
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,880] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6051952, fenced=0,
inControlledShutdown=1, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,896] INFO [QuorumController id=2] Replayed
BrokerRegistrationChangeRecord modifying the registration for broker 2:
BrokerRegistrationChangeRecord(brokerId=2, brokerEpoch=6051952, fenced=1,
inControlledShutdown=0, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,896] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=wZykJcpkQN2kUYyIQAR8Bw, brokerEpoch=6183805,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,896] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=rXbFK5YiTEauBpZ8wFgfZA, brokerEpoch=6183822,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,897] INFO [QuorumController id=2] Replayed
RegisterBrokerRecord establishing a new incarnation of broker 2:
RegisterBrokerRecord(brokerId=2, isMigratingZkBroker=false,
incarnationId=ESDRkaqDSJmxIj4k9ACvUw, brokerEpoch=6183839,
endPoints=[BrokerEndpoint(name='BROKER', host='<node_2_id>', port=9092,
securityProtocol=1)], features=[BrokerFeature(name='metadata.version',
minSupportedVersion=1, maxSupportedVersion=19)], rack='rack1', fenced=true,
inControlledShutdown=false, logDirs=[])
(org.apache.kafka.controller.ClusterControlManager)

kafka  | [2024-04-16 06:18:12,927] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5280829, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:12,928] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 5280829, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,018] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5397337, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,107] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5513845, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,107] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 5513845, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,208] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5630353, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,209] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 5630353, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,300] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5746913, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,396] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5863421, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,396] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 5863421, but the high water mark is 6183842
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,487] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 5979929, but the high water mark is 6183843
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,612] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 6102430, but the high water mark is 6183843
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,612] INFO [MetadataLoader id=2]
initializeNewPublishers: The loader is still catching up because we have
loaded up to offset 6102430, but the high water mark is 6183843
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,701] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader is still catching up because we
have loaded up to offset 6183833, but the high water mark is 6183843
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,702] INFO [MetadataLoader id=2]
maybePublishMetadata(LOG_DELTA): The loader finished catching up to the
current high water mark of 6183843
(org.apache.kafka.image.loader.MetadataLoader)

kafka  | [2024-04-16 06:18:13,706] INFO [BrokerLifecycleManager id=2] The
broker has caught up. Transitioning from STARTING to RECOVERY.
(kafka.server.BrokerLifecycleManager)

kafka  | [2024-04-16 06:18:13,706] INFO [BrokerServer id=2] Finished waiting
for the controller to acknowledge that we are caught up
(kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:13,706] INFO [BrokerServer id=2] Waiting for the
initial broker metadata update to be published (kafka.server.BrokerServer)

kafka  | [2024-04-16 06:18:13,707] ERROR Encountered fatal fault: Unhandled
error initializing new publishers
(org.apache.kafka.server.fault.ProcessTerminatingFaultHandler)

kafka  | org.apache.kafka.image.writer.UnwritableMetadataException: Metadata
has been lost because the following could not be represented in metadata
version 3.5-IV2: the directory assignment state of one or more replicas

kafka  |        at
org.apache.kafka.image.writer.ImageWriterOptions.handleLoss(ImageWriterOptio
ns.java:94)

kafka  |        at
org.apache.kafka.metadata.PartitionRegistration.toRecord(PartitionRegistrati
on.java:391)

kafka  |        at
org.apache.kafka.image.TopicImage.write(TopicImage.java:71)

kafka  |        at
org.apache.kafka.image.TopicsImage.write(TopicsImage.java:84)

kafka  |        at
org.apache.kafka.image.MetadataImage.write(MetadataImage.java:155)

kafka  |        at
org.apache.kafka.image.loader.MetadataLoader.initializeNewPublishers(Metadat
aLoader.java:295)

kafka  |        at
org.apache.kafka.image.loader.MetadataLoader.lambda$scheduleInitializeNewPub
lishers$0(MetadataLoader.java:266)

kafka  |        at
org.apache.kafka.queue.KafkaEventQueue$EventContext.run(KafkaEventQueue.java
:127)

kafka  |        at
org.apache.kafka.queue.KafkaEventQueue$EventHandler.handleEvents(KafkaEventQ
ueue.java:210)

kafka  |        at
org.apache.kafka.queue.KafkaEventQueue$EventHandler.run(KafkaEventQueue.java
:181)

kafka  |        at java.base/java.lang.Thread.run(Thread.java:840)

kafka exited with code 0

Reply via email to