Hi, As for lots of companies, we have different architectures for near-time/off-line analytics platform (fink vs hadoop), so we may not want flink cluster to depend on a shared HDFS as an additional dependency to operate especially we may deploy the streaming stack all on k8s including kafka/flink without hdfs.
Is it possible to implement a way to sync metadata across different HA job managers instead of depending on a shared file system for high-availability.zookeeper.storageDir. -- Hao