[
https://issues.apache.org/jira/browse/STORM-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15282971#comment-15282971
]
Satish Duggana commented on STORM-1757:
---------------------------------------
Great idea to have a single API for both core and trident but that may not be
along the lines of Beam API. I feel Beam API is too verbose and it is very
specific to their model. Agree with [~sriharsha] [~revans2] for pursuing on
this.
We should find out the gaps with respect to Beam and implement them with
respective priority.
Our current windowing supports a single active window and it internally
supports a single trigger/eviction policy but it is currently not exposed. I
raised [STORM-1763](https://issues.apache.org/jira/browse/STORM-1763) to
enhance core windowing for supporting multiple active windows with multiple
triggers and custom eviction policies. I plan to implement that on core, which
can be used in trident later. I have gone through Beam windowing to get the
basic understanding but I need to explore more.
Initial set of features to be implemented w.r.t windowing to reduce the gap
with Beam
- multiple active windows based on watermarks
- multiple custom triggers support for a window
- custom eviction policy (with accumulation/discarding builtin policies)
- sessioned windows (this can be implemented by merging active windows with in
a session gap)
I will be adding more details in STORM-1763.
> Apache Beam Runner for Storm
> ----------------------------
>
> Key: STORM-1757
> URL: https://issues.apache.org/jira/browse/STORM-1757
> Project: Apache Storm
> Issue Type: Brainstorming
> Reporter: P. Taylor Goetz
> Priority: Minor
>
> This is a call for interested parties to collaborate on an Apache Beam [1]
> runner for Storm, and express their thoughts and opinions.
> Given the addition of the Windowing API to Apache Storm, we should be able to
> map naturally to the Beam API. If not, it may be indicative of shortcomings
> of the Storm API that should be addressed.
> [1] http://beam.incubator.apache.org
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
