[
https://issues.apache.org/jira/browse/STORM-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284808#comment-15284808
]
P. Taylor Goetz commented on STORM-1757:
----------------------------------------
Storm was designed from the start to support multiple APIs/DSLs, that's why we
have the Thrift interface. That's what Storm's Spout/Bolt API is built on, and
Trident in turn builds on that. There are Clojure, Python, and F# APIs all
built on top of the Thrift interface as well.
While I think some sort of "unified" API would be nice, I don't see the Core or
Trident APIs going away without causing serious pain to existing users -- while
the Core API is arguably more popular, there are a lot of people that use
Trident. A good example of how hard it can be to deprecate an API is
transactional topologies, which were deprecated in favor of Trident. The
problem was that users still wanted and used them, eliminating that API would
just force users to reimplement that functionality themselves.
The Java 8 Streams API probably doesn't really apply completely or map
one-to-one with what's possible with Storm, so we wouldn't actually be
implementing those interfaces, but rather provide an API that very closely
resembles/approximates the Streams API -- which the Trident does, somewhat,
today (e.g. map/flatMap).
Anyway, this is tangential to the discussion around implementing a Beam runner
and may warrant a separate JIRA or email thread if we want to continue the
discussion.
> Apache Beam Runner for Storm
> ----------------------------
>
> Key: STORM-1757
> URL: https://issues.apache.org/jira/browse/STORM-1757
> Project: Apache Storm
> Issue Type: Brainstorming
> Reporter: P. Taylor Goetz
> Priority: Minor
>
> This is a call for interested parties to collaborate on an Apache Beam [1]
> runner for Storm, and express their thoughts and opinions.
> Given the addition of the Windowing API to Apache Storm, we should be able to
> map naturally to the Beam API. If not, it may be indicative of shortcomings
> of the Storm API that should be addressed.
> [1] http://beam.incubator.apache.org
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
