[
https://issues.apache.org/jira/browse/FLINK-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031087#comment-16031087
]
ASF GitHub Bot commented on FLINK-6766:
---------------------------------------
Github user alpinegizmo commented on a diff in the pull request:
https://github.com/apache/flink/pull/4011#discussion_r119344251
--- Diff: docs/monitoring/large_state_tuning.md ---
@@ -138,6 +138,22 @@ Unfortunately, RocksDB's performance can vary with
configuration, and there is l
RocksDB properly. For example, the default configuration is tailored
towards SSDs and performs suboptimal
on spinning disks.
+**Incremental Checkpoints**
+
+Incremental checkpoints can dramatically reduce the checkpointing time in
comparison to full checkpoints, at the cost of a (potentially) longer
+recovery time. The core idea is that incremental checkpoints only record
all changes to the previous completed checkpoint, instead of
+producing a full, self-contained backups of the backend. Like this,
incremental checkpoints build upon previous checkpoints. Flink leverages
--- End diff --
a full, self-contained backup of the state backend
> Update documentation with async backends and incremental checkpoints
> --------------------------------------------------------------------
>
> Key: FLINK-6766
> URL: https://issues.apache.org/jira/browse/FLINK-6766
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
> Reporter: Stefan Richter
> Assignee: Stefan Richter
> Fix For: 1.4.0
>
>
> This PR introduces some documentation about async heap backends and
> incremental snapshots with RocksDB.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)