[
https://issues.apache.org/jira/browse/KAFKA-15231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17745602#comment-17745602
]
Divij Vaidya commented on KAFKA-15231:
--------------------------------------
Hey [~jeqo]
If the RSM is unavailable (for maintenance as you say), wouldn't it result in
availability drop? I am saying this because the clients won't be able to read
data that is stored in remote and leader failover won't work correctly (because
followers fetch producer snapshot when joining a quorum as part of buildAux
state). If what I am saying is correct, then I don't quite understand how
"pause" will help?
> Add ability to pause/resume Remote Log Manager tasks
> -----------------------------------------------------
>
> Key: KAFKA-15231
> URL: https://issues.apache.org/jira/browse/KAFKA-15231
> Project: Kafka
> Issue Type: Improvement
> Components: core
> Reporter: Jorge Esteban Quilcate Otoya
> Priority: Major
> Labels: tiered-storage
>
> Once Tiered Storage is enabled, there may be situations where needed to pause
> uploading tasks to a remote-tier. e.g. remote storage maintenance,
> troubleshooting, etc.
> An RSM implementation may not be able to do this by itself without throwing
> exceptions, polluting the logs, etc.
> Could we consider adding this ability to the Tiered Storage framework? Remote
> Log Manager seems like a good candidate place for this; though I'm wondering
> on how to expose it.
> Would be interested to hear if this sounds like a good idea, and what options
> we have to include these.
> We have been considering extending RLM tasks with a pause flag, and having an
> MBean to switch them on demand. Another option may be to extend the Kafka
> protocol to expose this – but seems much moved involved.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
