Well, I have a fully functioning HDFS HA setup via a helm chart. My
question is more about how to specify the hdfs nodename in such a way so
that if a name node fails it communicates with the new active name node
automatically. Swapnil mentioned configuring nameservice for hdfs namenode
and I was l
Hi Steve,
I think your question is specific to HDFS HA setup.
Flink HA addresses failover issues only for job manager and job meta state.
The storage layer for savepoints/checkpoints and its failover are
responsibility of HDFS deployment.
Flink uses HDFS as external system, available over locatio
First off, I am new to using HDFS to store things, so expect stupid
questions.
I am working on hardening our Flink cluster for production usage. This
includes setting up an HA flink cluster, saving checkpoint and savepoints
to a central location etc. I have a functioning HDFS setup inside an HA
Ku
