Repository: flink Updated Branches: refs/heads/release-0.9 d147c71a4 -> 2359b49f5
[FLINK-2221] [docs] Docs for not using local filesystem on the cluster as state backup This is just a clear documentation of the problem for the 0.9 release. Closes #839 Project: http://git-wip-us.apache.org/repos/asf/flink/repo Commit: http://git-wip-us.apache.org/repos/asf/flink/commit/ccaa0b07 Tree: http://git-wip-us.apache.org/repos/asf/flink/tree/ccaa0b07 Diff: http://git-wip-us.apache.org/repos/asf/flink/diff/ccaa0b07 Branch: refs/heads/release-0.9 Commit: ccaa0b07de4d633760e5ffff2d79e10ec6b2e003 Parents: d147c71 Author: mbalassi <mbala...@apache.org> Authored: Mon Jun 15 18:53:08 2015 +0200 Committer: mbalassi <mbala...@apache.org> Committed: Tue Jun 16 13:07:19 2015 +0200 ---------------------------------------------------------------------- docs/apis/streaming_guide.md | 4 ++-- flink-dist/src/main/resources/flink-conf.yaml | 2 ++ 2 files changed, 4 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/flink/blob/ccaa0b07/docs/apis/streaming_guide.md ---------------------------------------------------------------------- diff --git a/docs/apis/streaming_guide.md b/docs/apis/streaming_guide.md index 0a7a486..9c32903 100644 --- a/docs/apis/streaming_guide.md +++ b/docs/apis/streaming_guide.md @@ -1194,7 +1194,7 @@ For example when implementing a rolling count over the stream Flink gives you th Checkpointing can be enabled from the `StreamExecutionEnvironment` using the `enableCheckpointing(â¦)` where additional parameters can be passed to modify the default 5 second checkpoint interval. -By default state checkpoints will be stored in-memory at the JobManager. Flink also supports storing the checkpoints on any flink-supported file system (such as HDFS or Tachyon) which can be set in the flink-conf.yaml. +By default state checkpoints will be stored in-memory at the JobManager. Flink also supports storing the checkpoints on any flink-supported file system (such as HDFS or Tachyon) which can be set in the flink-conf.yaml. Note that the state backend must be accessible from the JobManager, use `file://` only for local setups. For example let us write a reduce function that besides summing the data it also counts have many elements it has seen. @@ -1210,7 +1210,7 @@ public class CounterSum implements ReduceFunction<Long>, CheckpointedAsynchronou return value1 + value2; } - // regurarly persists state during normal operation + // regularly persists state during normal operation @Override public Serializable snapshotState(long checkpointId, long checkpointTimestamp) throws Exception { return new Long(counter); http://git-wip-us.apache.org/repos/asf/flink/blob/ccaa0b07/flink-dist/src/main/resources/flink-conf.yaml ---------------------------------------------------------------------- diff --git a/flink-dist/src/main/resources/flink-conf.yaml b/flink-dist/src/main/resources/flink-conf.yaml index f0c0d56..a258815 100644 --- a/flink-dist/src/main/resources/flink-conf.yaml +++ b/flink-dist/src/main/resources/flink-conf.yaml @@ -59,6 +59,8 @@ webclient.port: 8080 state.backend: jobmanager # Directory for storing checkpoints in a flink supported filesystem +# Note: State backend must be accessible from the JobManager, use file:// +# only for local setups. # # state.backend.fs.checkpointdir: hdfs://checkpoints
