Hi Boris, ZooKeeper is also used by the JobManager to store metadata about the running job. The JM writes information like the JobGraph, JAR file, checkpoint metadata to a persistent storage (like HDFS, S3, ...) and a pointer to this information to ZooKeeper. In case of a recovery, the new JM looks up the pointer from ZooKeeper and fetches the job metadata from the persistent storage.
Best, Fabian Am Sa., 6. Apr. 2019 um 01:28 Uhr schrieb Boris Lublinsky < boris.lublin...@lightbend.com>: > For HA implementation, is zookeeper is used only for leader selection, or > it also stores some data relevant for switching to backup server > Boris Lublinsky > FDP Architect > boris.lublin...@lightbend.com > https://www.lightbend.com/ > >
