Re: Flink stream processing issue

2021-06-04 Thread yidan zhao
Yes, if you use KeyedCoProcess, flink will ensure that. Qihua Yang 于2021年6月4日周五 上午12:32写道: > > Sorry for the confusion Yes, I mean multiple parallelism. Really thanks > for your help. > > Thanks, > Qihua > > On Thu, Jun 3, 2021 at 12:03 AM JING ZHANG wrote: >> >> Hi Qihua, >> >> I’m sorry

Re: Flink stream processing issue

2021-06-03 Thread Qihua Yang
Sorry for the confusion Yes, I mean multiple parallelism. Really thanks for your help. Thanks, Qihua On Thu, Jun 3, 2021 at 12:03 AM JING ZHANG wrote: > Hi Qihua, > > I’m sorry I didn’t understand what you mean by ‘replica’. Would you please > explain a little more? > If you means you job

Re: Flink stream processing issue

2021-06-03 Thread JING ZHANG
Hi Qihua, I’m sorry I didn’t understand what you mean by ‘replica’. Would you please explain a little more? If you means you job has multiple parallelism, and whether same data from different two inputs would be send to the same downstream subtask after `keyedCoProcessFunction`. Yes, Flink could

Flink stream processing issue

2021-06-02 Thread Qihua Yang
Hi, I have a question. We have two data streams that may contain duplicate data. We are using keyedCoProcessFunction to process stream data. I defined the same keySelector for both streams. Our flink application has multiple replicas. We want the same data to be processed by the same replica. Can