dgiri created KAFKA-15328:
-----------------------------

             Summary: Inter broker partition reassignment triggers offline log 
dirs randomly
                 Key: KAFKA-15328
                 URL: https://issues.apache.org/jira/browse/KAFKA-15328
             Project: Kafka
          Issue Type: Bug
          Components: core, tools
    Affects Versions: 3.3.2
         Environment: RHEL 8.8 (Ootpa)
            Reporter: dgiri
         Attachments: kafka_partition_reassignment_offline_lod_dir_errors.txt

When running the intra-broker partition reassignments from one disk to another, 
kafka triggers offline log dir. This happens randomly and can be reproduced 
only after running the intra-broker reassignments multiple times.

 

Observations made:
 # After running the partition reassignment from (/data1 to /data2), kafka 
creates a *_topic-partition.uniqueId-future_* location on /data2 and starts 
copying the data.
 # Partition reassignment completes as expected by renaming the 
_*topic-partition.uniqueId-future*_ location __ to _*topic-partition*_ on 
/data2.
 # Within few milliseconds kafka still looks for 
_*topic-partition.uniqueId-future*_ location{_},{_} since it won't find that 
location anymore it marks the /data2 log dir as offline

 

Broker logs filtered with particular partition and error has been attached for 
more details.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to