Hi LakeShen You could refer to [1] and [2] to know the temporary directory in YARN, the related log could be "Setting directories for temporary files to: " or "Overriding Fink's temporary file directories with those specified in the Flink config: "
[1] https://github.com/apache/flink/blob/0dda6fe9dff4f667b110cda39bfe9738ba615b24/flink-yarn/src/main/java/org/apache/flink/yarn/YarnTaskExecutorRunner.java#L103 [2] https://github.com/apache/flink/blob/0dda6fe9dff4f667b110cda39bfe9738ba615b24/flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/BootstrapTools.java#L478-L489 Best Yun Tang ________________________________ From: Till Rohrmann <trohrm...@apache.org> Sent: Wednesday, May 6, 2020 17:35 To: LakeShen <shenleifight...@gmail.com> Cc: dev <d...@flink.apache.org>; user <u...@flink.apache.org>; user-zh <user-zh@flink.apache.org> Subject: Re: What is the RocksDB local directory in flink checkpointing? Hi LakeShen, `state.backend.rocksdb.localdir` defines the directory in which RocksDB will store its local files. Local files are RocksDB's SST and metadata files for example. This directory does not need to be persisted. If the config option is not configured, then it will use the nodes temporary file directory. Cheers, Till On Wed, May 6, 2020 at 6:07 AM LakeShen <shenleifight...@gmail.com> wrote: > Hi community, > > Now I have a question about flink checkpoint local directory , our flink > version is 1.6, job mode is > > flink on yarn per job . I saw the flink source code , and I find the flink > checkpoint local directory is > > /tmp when you didn't config the "state.backend.rocksdb.localdir". But I go > into the /tmp dir ,I > > couldn't find the flink checkpoint state local directory. > > What is the RocksDB local directory in flink checkpointing? I am looking > forward to your reply. > > Best, > LakeShen >
