Hello,
I would like to know if we have any latency requirements for choosing
appropriate state backend?
For example, if an HCFS implementation is used as Flink state backend (instead
of stock HDFS), are there any implications that one needs to know with respect
to the performance?
- Frequency of read/write operations, random vs sequential reads- Load/Usage
pattern (Frequent small updates vs bulk operation)- RocksDB->HCFS (Is this kind
of recommended option to mitigate some of the challenges outlined above)- S3 Vs
HDFS any performance numbers?
Appreciate any inputs on this.
RegardsVijay
