Re: [DISCUSS] Drop Scala 2.11

2020-09-13 Thread Chesnay Schepler
Are we then also dropping the scala-shell, since it still doesn't work on 2.12? On 9/11/2020 2:12 PM, Timo Walther wrote: Big +1 to drop Scala 2.11 This would mean that we can finally use Java 8 language features that are integrated with Scala. Regards, Timo On 11.09.20 13:15, Igal Shilman

Re: [DISCUSS] Drop Scala 2.11

2020-09-13 Thread Jeff Zhang
I would hope we can make scala shell with scala 2.12 before dropping 2.11, many users are still using scala shell to try out new features of flink, especially for new users. Chesnay Schepler 于2020年9月13日周日 下午7:59写道: > Are we then also dropping the scala-shell, since it still doesn't work > on 2.

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-13 Thread Steven Wu
Aljoscha, thanks a lot for the detailed response. Now I have a better understanding of the initial scope. To me, there are possibly three different committer behaviors. For the lack of better names, let's call them * No/NoopCommitter * Committer / LocalCommitter (file sink?) * GlobalCommitter (Ice

Re: [DISCUSS] Deprecate and remove UnionList OperatorState

2020-09-13 Thread Steven Wu
Right now, we use UnionState to store the `nextCheckpointId` in the Iceberg sink use case, because we can't retrieve the checkpointId from the FunctionInitializationContext during the restore case. But we can move away from it if the restore context provides the checkpointId. On Sat, Sep 12, 2020