Re: Question about ZooKeeper HA new structure [FLINK-22636]

2021-09-03 Thread Juha Mynttinen
Thanks, This clarifies the situation. Regards, Juha On Fri, Sep 3, 2021 at 11:53 AM Till Rohrmann wrote: > For patch versions the Flink community is very careful not to introduce > breaking changes. Hence, for patch releases it should be possible to > upgrade via failover. However, I don't

Re: Question about ZooKeeper HA new structure [FLINK-22636]

2021-09-03 Thread Till Rohrmann
For patch versions the Flink community is very careful not to introduce breaking changes. Hence, for patch releases it should be possible to upgrade via failover. However, I don't think that this is properly guarded by tests at the moment and also no official guarantee we are giving. Cheers, Till

Re: Question about ZooKeeper HA new structure [FLINK-22636]

2021-09-03 Thread Juha Mynttinen
OK, thanks, I see, this savepointing and creating a new cluster is the documented [1] way of upgrading Flink version. However, I think at least for some version upgrades it has been fine to just switch the code to the new version. I might be wrong. What about patch versions like 1.13.X? The doc

Re: Question about ZooKeeper HA new structure [FLINK-22636]

2021-09-03 Thread Till Rohrmann
Hi Juha, Flink does not give backwards compatibility wrt to its internal data structures. The recommended way is to stop the jobs with a savepoint and then resume these jobs on the new Flink cluster. Failing over the processes with a new version is not guaranteed to work atm. I hope this answers