[ 
https://issues.apache.org/jira/browse/SPARK-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15050906#comment-15050906
 ] 

Sean Owen commented on SPARK-12260:
-----------------------------------

Isn't this what updateStateByKey and similar methods already accomplish for you?

> Graceful Shutdown with In-Memory State
> --------------------------------------
>
>                 Key: SPARK-12260
>                 URL: https://issues.apache.org/jira/browse/SPARK-12260
>             Project: Spark
>          Issue Type: New Feature
>          Components: Streaming
>            Reporter: Mao, Wei
>              Labels: streaming
>
> Users often stop and restart their streaming jobs for tasks such as 
> maintenance, software upgrades or even application logic updates. When a job 
> re-starts it should pick up where it left off i.e. any state information that 
> existed when the job stopped should be used as the initial state when the job 
> restarts.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to