Re: Storage options for RocksDBStateBackend

2017-05-12 Thread Ayush Goyal
also suffer from its drawbacks (e.g. that list >> operations are more costly). But these are not specific to Flink. >> >> A URL like file:// usually indicates a local file. Thus, if your Flink >> cluster is not running on a single machine, then this won’t work. >> >> [

Storage options for RocksDBStateBackend

2017-05-11 Thread Ayush Goyal
Hello, I had a few questions regarding checkpoint storage options using RocksDBStateBackend. In the flink 1.2 documentation, it is the recommended state backend due to it's ability to store large states and asynchronous snapshotting. For high availabilty it seems HDFS is the recommended store for