Hi Leo,
At linkedin when we switched to using RocksDB for Samza last year, we did
some tests to see how well RocksDB performs. We used the rocksdb
microbenchmark(
https://github.com/facebook/rocksdb/blob/master/java/benchmark/src/main/java/org/rocksdb/benchmark/DbBenchmark.java)
to conduct serval
Samza 0.10 introduces the feature of Yarn host affinity for this exact
reason. For jobs that need to bootstrap lots of state, downtime during
bootstrapping is not acceptable. In our production usecases, we've observed
bootstrap times from 25 mins to about 30 seconds.
Please refer
https://samza.apa
We are starting to use the key-value store with rocksdb. We are trying to
offically add Samza to our stack and functionally everything is great. But,
I am seeing minutes to hours restore time. Does anyone have any benchmarks
on data size versus restore time? My big question is how will this sca
