[ https://issues.apache.org/jira/browse/SPARK-4028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183908#comment-14183908 ]
Apache Spark commented on SPARK-4028: ------------------------------------- User 'tdas' has created a pull request for this issue: https://github.com/apache/spark/pull/2940 > ReceivedBlockHandler interface to abstract the functionality of storage of > received data > ---------------------------------------------------------------------------------------- > > Key: SPARK-4028 > URL: https://issues.apache.org/jira/browse/SPARK-4028 > Project: Spark > Issue Type: Sub-task > Components: Streaming > Reporter: Tathagata Das > Assignee: Tathagata Das > Priority: Critical > > As part of the initiative to prevent data loss on streaming driver failure, > this JIRA tracks the subtask of implementing a ReceivedBlockHandler, that > abstracts the functionality of storage of received data blocks. The default > implementation will maintain the current behavior of storing the data into > BlockManager. The optional implementation will store the data to both > BlockManager as well as a write ahead log. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org