[
https://issues.apache.org/jira/browse/KAFKA-14912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17742722#comment-17742722
]
Manyanda Chitimbo commented on KAFKA-14912:
-------------------------------------------
Hi [~divijvaidya] [~satish.duggana]
I've started to have a look at this and I've got a question.
There is already the `remote.log.index.file.cache.total.size.bytes` internal
configuration which is currently not used anywhere in the code base. This
matches closely the `remote.log.index.file.cache.total.size.mb` config defined
in the KIP, and it seems to align to what we want to do in this JIRA. My
question is, do we know size of each individual segment entry in the cache? The
idea, I've will be then to leverage the
`remote.log.index.file.cache.total.size.bytes` config and compute the max
entries the cache can hold.
If not, my alternative idea is to introduce another internal config
`remote.log.index.file.cache.total.size`, and in this case, I think we'll need
to update the KIP-405. WDYT?
> Introduce a configuration for remote index cache size, preferably a dynamic
> config.
> -----------------------------------------------------------------------------------
>
> Key: KAFKA-14912
> URL: https://issues.apache.org/jira/browse/KAFKA-14912
> Project: Kafka
> Issue Type: Sub-task
> Components: core
> Reporter: Satish Duggana
> Assignee: Manyanda Chitimbo
> Priority: Major
>
> Context: We need to make the 1024 value here [1] as dynamically configurable
> [1]
> https://github.com/apache/kafka/blob/8d24716f27b307da79a819487aefb8dec79b4ca8/storage/src/main/java/org/apache/kafka/storage/internals/log/RemoteIndexCache.java#L119
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
