Thanks Jan!
I have a question based on this on Global Window and allowed lateness, with
default trigger for the following
scenarios:
Case 1-
TextIO.Read.
|. Bounded source
|. Global Window
|. -infinity watermark
apply
WithTimeStamps (Based on a timestamp attribute in file)
|. timestamped elements (watermark starts from -infinity and follows
the timestamp from timestamp attribute)
|. Global Window
|. (Will I never need to do allowedLateness in this case with default
trigger? Will there be any benefit since the window is global and watermark
will pass the end of window when everything is processed ? )
Case 2 -
KinesisIO.read
| .Unbounded Source
|. Default Global Window
|. watermark based on arrival time
apply
WithTimeStamps (Based on a timestamp attribute from the stream)
|. timestamped elements ( watermark follows the timestamp from
timestamp attribute)
|. Global Window
|. Watermark based on event timestamp.
| Same question here will there be any benefit of using allowedLateness
since window is global ?
In the code example below allowedLateness is used for global window ?
https://github.com/apache/beam/blob/828b897a2439437d483b1bd7f2a04871f077bde0/examples/java/src/main/java/org/apache/beam/examples/complete/game/LeaderBoard.java#L307
Regards,
Amit
On Tue, Mar 31, 2020 at 2:34 AM Jan Lukavský <je...@seznam.cz> wrote:
> Hi Amit,
>
> the window function applied by default is
> WindowingStrategy.globalDefault(), [1] - global window with zero allowed
> lateness.
>
> Cheers,
>
> Jan
>
> [1]
>
> https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/values/WindowingStrategy.java#L105
>
> On 3/31/20 10:22 AM, amit kumar wrote:
> > Hi All,
> >
> > Is there a default WindowFn that gets applied to elements of an
> > unbounded source.
> >
> > For example, if I have a Kinesis input source ,for which all elements
> > are timestamped with ArrivalTime, what will be the default windowing
> > applied to the output of read transform ?
> >
> > Is this runner dependent ?
> >
> > Regards,
> > Amit
>
