[ 
https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777052#comment-13777052
 ] 

Brian ONeill commented on PIG-3453:
-----------------------------------

I've been looking at SummingBird as well, and have had success connecting Druid 
w/ Storm.  In our specific case, we have data scientists running Pig scripts 
off-line/in batch that I would love to straight-up deploy into our real-time 
data ingestion system (on top of Storm).

I'm going to continue w/ the PoC to see if I can convert one of those Pig 
scripts into a Storm topology.  I have the Pig script running on a yarn 
cluster.  I'm going to try out storm-yarn, then deploy the corresponding 
topology and do an unofficial "race" between hdfs+pig vs. kafka+storm.  I'll 
let you know how I fare.
                
> Implement a Storm backend to Pig
> --------------------------------
>
>                 Key: PIG-3453
>                 URL: https://issues.apache.org/jira/browse/PIG-3453
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Pradeep Gollakota
>              Labels: storm
>
> There is a lot of interest around implementing a Storm backend to Pig for 
> streaming processing. The proposal and initial discussions can be found at 
> https://cwiki.apache.org/confluence/display/PIG/Pig+on+Storm+Proposal

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to