[
https://issues.apache.org/jira/browse/FLINK-12855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143688#comment-17143688
]
Aljoscha Krettek commented on FLINK-12855:
------------------------------------------
I see that the motivation for this change was different from the Kinesis
stagger windows: 1) here the motivation was to combat the thundering herd
effect of all windows firing at the same time, 2) for Kinesis it's a new type
of windows that aims at producing better results because it takes the
timestamps in the data into account better.
I'm open to adding a new type of windows for this, though. We're still within
the 1.12 release phase so we could also change the API that was already added.
> Stagger TumblingProcessingTimeWindow processing to distribute workload
> ----------------------------------------------------------------------
>
> Key: FLINK-12855
> URL: https://issues.apache.org/jira/browse/FLINK-12855
> Project: Flink
> Issue Type: New Feature
> Components: API / DataStream
> Reporter: Teng Hu
> Assignee: Teng Hu
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.12.0
>
> Attachments: stagger_window.png, stagger_window_delay.png,
> stagger_window_throughput.png
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Flink natively triggers all panes belonging to same window at the same time.
> In other words, all panes are aligned and their triggers all fire
> simultaneously, causing the thundering herd effect.
> This new feature provides the option that panes could be staggered across
> partitioned streams, so that their workloads are distributed.
> Attachment: proof of concept working
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
