Dong Lin created KAFKA-6175:
-------------------------------
Summary: AbstractIndex should cache index file to avoid
unnecessary disk access during resize()
Key: KAFKA-6175
URL: https://issues.apache.org/jira/browse/KAFKA-6175
Project: Kafka
Issue Type: Improvement
Reporter: Dong Lin
Assignee: Dong Lin
Currently when we shutdown a broker, we will call AbstractIndex.resize() for
all segments on the broker, regardless of whether the log segment is active or
not. AbstractIndex.resize() incurs raf.setLength(), which is expensive because
it accesses disks. If we do a threaddump during either LogManger.shutdown() or
LogManager.loadLogs(), most threads are in RUNNABLE state at
java.io.RandomAccessFile.setLength().
This patch intends to speed up broker startup and shutdown time by skipping
AbstractIndex.resize() for inactive log segments.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)