Re: What does flink session mean ?

2019-06-04 Thread Till Rohrmann
Yes, interactive programming solves the problem by storing the meta information on the client whereas in the past we thought whether to keep the information on the JM. But this would then not allow to share results between different clusters. Thus, the interactive programming approach is a bit

Re: What does flink session mean ?

2019-06-04 Thread Jeff Zhang
Thanks for the reply, @Till Rohrmann . Regarding reuse computed results. I think JM keep all the metadata of intermediate data, and interactive programming is also trying to reuse computed results. It looks like it may not be necessary to introduce the session concept as long as we can achieve

Re: What does flink session mean ?

2019-06-04 Thread Till Rohrmann
Hi Jeff, the session functionality which you find in Flink's client are the remnants of an uncompleted feature which was abandoned. The idea was that one could submit multiple parts of a job to the same cluster where these parts are added to the same ExecutionGraph. That way we wanted to allow to

What does flink session mean ?

2019-06-02 Thread Jeff Zhang
Hi Folks, When I read the flink client api code, the concept of session is a little vague and unclear to me. It looks like the session concept is only applied in batch mode (I only see it in ExecutionEnvironment but not in StreamExecutionEnvironment). But for local mode