Re: WaterMark & Eventwindow not fired correctly

2017-08-04 Thread Aljoscha Krettek
Hi, Could you please provide a snipped of code or some minimal example that would help us reproducing your problem? Best, Aljoscha > On 3. Aug 2017, at 17:41, aitozi wrote: > > > Hi, > > i have encounted a problem, i apply generate and assign watermark at the > datastream, and then keyBy, a

Re: WaterMark & Eventwindow not fired correctly

2017-08-07 Thread aitozi
Hi, my flink version is 1.2 i am work on this problem these days. Below is my found. when i use "assignTimestampsAndWatermark" with same parallelism as 240 as the before operator, the before operator has two input(it is a "connected" Co-FlatMap operator with parallelism 240), it runs into that

Re: WaterMark & Eventwindow not fired correctly

2017-08-08 Thread Aljoscha Krettek
Hi, So I understood that you have roughly this pipeline: Input 1 --\ |- CoFlatMap - TimestampAndWatermarkAssigner - KeyBy - Window Input 2 --/ If the timestamp assigner is after the CoFlatMap the processInput() method of the extractor should still be called. Not by the StreamInpu

Re: WaterMark & Eventwindow not fired correctly

2017-08-09 Thread aitozi
Hi, Bellow is my code splitStream.select(duringTime + "") .map(new KeyMapFunc()) .assignTimestampsAndWatermarks(new DelaySaltWatermarks()) .setParallelism(300) .keyBy(_SQL, _KEY, _SALT) .window(TumblingEventTimeWindo

Re: WaterMark & Eventwindow not fired correctly

2017-08-09 Thread Aljoscha Krettek
Hi, So when the parallelism of the timestamp assigner is different from the parallelism of the map(KeyMapFunc()) or the window then it works? But when the parallelism is the same it does not work? If this is true, then I would assume, that some parallel instances of the timestamp assigner don'