Guozhang Wang created KAFKA-3184:
------------------------------------

             Summary: Add Checkpoint for In-memory State Store
                 Key: KAFKA-3184
                 URL: https://issues.apache.org/jira/browse/KAFKA-3184
             Project: Kafka
          Issue Type: Sub-task
            Reporter: Guozhang Wang


Currently Kafka Streams does not make a checkpoint of the persistent state 
store upon committing, which would be expensive since it is "stopping the 
world" and write on disks: for example, RocksDB would require you to copy the 
file directory to make a copy naively. 

However, for in-memory stores checkpointing maybe doable in an asynchronous 
manner hence it can be done quickly. And the benefit of having intermediate 
checkpoint is to avoid restoring from scratch if standby tasks are not present.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to