Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-06-09 Thread Konstantin Knauf
fer to just point out this in documentation to say explicitly > > Flink > > > > does not guarantee such kind of backwards compatibility. > > > > > > > > Best > > > > Yun Tang > > > > > > > > From:

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-06-06 Thread Steven Wu
t; > I prefer to just point out this in documentation to say explicitly > Flink > > > does not guarantee such kind of backwards compatibility. > > > > > > Best > > > Yun Tang > > > > > > From: Ufuk Celebi &g

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-06-05 Thread Congxian Qiu
explicitly Flink > > does not guarantee such kind of backwards compatibility. > > > > Best > > Yun Tang > > > > From: Ufuk Celebi > > Sent: Wednesday, May 27, 2020 16:42 > > To: dev@flink.apache.org > > Subject: Re

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-06-02 Thread Steven Wu
plicitly Flink > does not guarantee such kind of backwards compatibility. > > Best > Yun Tang > > From: Ufuk Celebi > Sent: Wednesday, May 27, 2020 16:42 > To: dev@flink.apache.org > Subject: Re: [DISCUSS] (Document) Backwards Compatibili

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-06-02 Thread Yun Tang
documentation to say explicitly Flink does not guarantee such kind of backwards compatibility. Best Yun Tang From: Ufuk Celebi Sent: Wednesday, May 27, 2020 16:42 To: dev@flink.apache.org Subject: Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints I

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-05-27 Thread Ufuk Celebi
I agree with Konstantin and Steven that it makes sense to point this out explicitly. I think that the following would be helpful: 1/ Mention breaking compatibility in release notes 2/ Update the linked table to reflect compatibilities while pointing out what the community commits to maintain goi

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-05-26 Thread Steven Wu
> A use case for this might be when you want to rollback a framework upgrade (after some time) due to e.g. a performance or stability issue. Downgrade (that Konstantin called out) is an important and realistic scenario. It will be great to support backward compatibility for savepoint or at least d

Re: [DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-05-26 Thread Piotr Nowojski
Hi, It might have been implicit choice, but so far we were not supporting the scenario that you are asking for. It has never been tested and we have lot’s of state migration code sprinkled among our code base (for example upgrading state fields of the operators like [1]), that only supports upg

[DISCUSS] (Document) Backwards Compatibility of Savepoints

2020-05-26 Thread Konstantin Knauf
Hi everyone, I recently stumbled across the fact that Savepoints created with Flink 1.11 can not be read by Flink 1.10. A use case for this might be when you want to rollback a framework upgrade (after some time) due to e.g. a performance or stability issue. >From the documentation [1] it seems a