[ https://issues.apache.org/jira/browse/PIG-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777421#comment-13777421 ]
Brian ONeill commented on PIG-3453: ----------------------------------- [~thedatachef] Good points/suggestions. I'll have a look at bot LRU and SQF. RE: Cassandra Sorry, I didn't mean to imply we would create a hard dependency. I meant we could leverage the Trident State abstraction. (My team happens to own the storm-cassandra Trident State implementation (https://github.com/hmsonline/storm-cassandra)) We would query the State to see if the tuple was processed. You could just as easily plug in any persistence mechanism. (e.g. https://github.com/nathanmarz/trident-memcached) > Implement a Storm backend to Pig > -------------------------------- > > Key: PIG-3453 > URL: https://issues.apache.org/jira/browse/PIG-3453 > Project: Pig > Issue Type: New Feature > Reporter: Pradeep Gollakota > Labels: storm > > There is a lot of interest around implementing a Storm backend to Pig for > streaming processing. The proposal and initial discussions can be found at > https://cwiki.apache.org/confluence/display/PIG/Pig+on+Storm+Proposal -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira