[ https://issues.apache.org/jira/browse/KAFKA-3184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17096965#comment-17096965 ]
Matthias J. Sax commented on KAFKA-3184: ---------------------------------------- [~guozhang] – from a naming perspective, we do have "checkpoint files" already that only store some offset metadata. It might be good to resolve this naming clash to avoid confusion in future discussion. Not sure atm, how to resolve it though. Thoughts? > Add Checkpoint for In-memory State Store > ---------------------------------------- > > Key: KAFKA-3184 > URL: https://issues.apache.org/jira/browse/KAFKA-3184 > Project: Kafka > Issue Type: Improvement > Components: streams > Reporter: Guozhang Wang > Assignee: Nikolay Izhikov > Priority: Major > Labels: user-experience > > Currently Kafka Streams does not make a checkpoint of the persistent state > store upon committing, which would be expensive since it is "stopping the > world" and write on disks: for example, RocksDB would require you to copy the > file directory to make a copy naively. > However, for in-memory stores checkpointing maybe doable in an asynchronous > manner hence it can be done quickly. And the benefit of having intermediate > checkpoint is to avoid restoring from scratch if standby tasks are not > present. -- This message was sent by Atlassian Jira (v8.3.4#803005)