Re: Re: Re: Re: how to run streaming process after batch process is completed?

2021-12-08 Thread Yun Gao
Hi Joern, Very thanks for sharing the detailed scenarios! It inspires a lot. If I understand right, could it might be summaried as follows? 1. There is a batch job to first intialize the state, the state is used in the stream mode, and the stream pipeline is different from the the batch job. 2.

Re: Re: Re: how to run streaming process after batch process is completed?

2021-12-07 Thread Joern Kottmann
Hello, One of the applications Spire [1] is using Flink for is to process AIS [2] data collected by our satellites and from other sources. AIS is transmitting a ships' static and dynamic information, such as names, callsigns or positions. One of the challenges processing AIS data is that there are

Re: Re: Re: how to run streaming process after batch process is completed?

2021-12-06 Thread Yun Gao
Hi Joern, Very thanks for sharing the cases! Could you also share a bit more on the detailed scenarios~? Best, Yun --Original Mail -- Sender:Joern Kottmann Send Date:Fri Dec 3 16:43:38 2021 Recipients:Yun Gao CC:vtygoss , Alexander Preuß , user@flink.apache