Re: RocksDB KeyValue store

2019-07-29 Thread taher koitawala
I believe Flink serialization is really fast and GC is much better from Flink 1.6 release, along side the state depends on what you do with it. each task manager has its own instance of rocks DB and is responsible for snapshot for his own instance upon checkpointing. Further more if you used a key

RocksDB KeyValue store

2019-07-29 Thread Navneeth Krishnan
Hi All, I looked at the RocksDB KV store implementation and I found that deserialization has to happen for each key lookup. Given a scenario where the key lookup has to happen for every single message would it still be a good idea to store it in rocksdb store or would in-memory store/cache be more