[
https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13813080#comment-13813080
]
Dmitriy V. Ryaboy commented on PIG-3453:
----------------------------------------
Mridul:
In our experience at Twitter, Trident introduces pretty high overhead; in
Summingbird, we relax the data delivery guarantees to get better throughput,
and use Storm directly. Perhaps you want to try putting pig on top of
Summingbird? If you did that, we might even be able to help :). In any case,
interested in seeing how all of this will turn out.
Cheolsoo:
No real objections to svn branch. In the past I've found it far easier to
cooperate on significant branches on github, rather than maintain an svn branch
(you can easily have multiple branches, reviews are easier, etc). That's how
Bill Graham and I did the HBaseStorage rewrite a few years back. But really
that's up to developers doing the work.
> Implement a Storm backend to Pig
> --------------------------------
>
> Key: PIG-3453
> URL: https://issues.apache.org/jira/browse/PIG-3453
> Project: Pig
> Issue Type: New Feature
> Affects Versions: 0.13.0
> Reporter: Pradeep Gollakota
> Assignee: Jacob Perkins
> Labels: storm
> Fix For: 0.13.0
>
> Attachments: storm-integration.patch
>
>
> There is a lot of interest around implementing a Storm backend to Pig for
> streaming processing. The proposal and initial discussions can be found at
> https://cwiki.apache.org/confluence/display/PIG/Pig+on+Storm+Proposal
--
This message was sent by Atlassian JIRA
(v6.1#6144)
