[ 
https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777421#comment-13777421
 ] 

Brian ONeill commented on PIG-3453:
-----------------------------------

[~thedatachef] Good points/suggestions.  I'll have a look at bot LRU and SQF.

RE: Cassandra
Sorry, I didn't mean to imply we would create a hard dependency.  I meant we 
could leverage the Trident State abstraction.  (My team happens to own the 
storm-cassandra Trident State implementation 
(https://github.com/hmsonline/storm-cassandra))  We would query the State to 
see if the tuple was processed.  You could just as easily plug in any 
persistence mechanism.  (e.g. https://github.com/nathanmarz/trident-memcached)  
                
> Implement a Storm backend to Pig
> --------------------------------
>
>                 Key: PIG-3453
>                 URL: https://issues.apache.org/jira/browse/PIG-3453
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Pradeep Gollakota
>              Labels: storm
>
> There is a lot of interest around implementing a Storm backend to Pig for 
> streaming processing. The proposal and initial discussions can be found at 
> https://cwiki.apache.org/confluence/display/PIG/Pig+on+Storm+Proposal

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to