Re: RocksDB checkpointing dir per TM

This is a very good point Elias. We actually forgot to add these options to the configuration documentation after a refactoring. I will fix it. Cheers, Till On Fri, Oct 26, 2018 at 8:27 PM Elias Levy wrote: > There is also state.backend.rocksdb.localdir. Oddly, I can find the > documentation f

Re: RocksDB checkpointing dir per TM

There is also state.backend.rocksdb.localdir. Oddly, I can find the documentation for it in the 1.5 docs , but not in the 1.6 docs

Re: RocksDB checkpointing dir per TM

Thanks! On Fri 26 Oct, 2018, 3:31 PM Andrey Zagrebin, wrote: > Hi Taher, > > TMs keep state locally while running, in this case RocksDB files already > belong to TM. > You can point it to the same NVME disk location on each node, relevant > Flink options here are: > - io.tmp.dirs > - taskmanager

Re: RocksDB checkpointing dir per TM

Hi Taher, TMs keep state locally while running, in this case RocksDB files already belong to TM. You can point it to the same NVME disk location on each node, relevant Flink options here are: - io.tmp.dirs - taskmanager.state.local.root-dirs This data is transient and has temporary nature. It do

RocksDB checkpointing dir per TM

Hi All, Our current cluster configuration uses one HDD which is mainly for root and an other NVME disk per node, [1]we want make sure all TMs write their own RocksDB files to the NVME disk only, how do we do that? [2] Is it also possible to specify multiple directories per TMs so that we