[ 
https://issues.apache.org/jira/browse/STORM-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991162#comment-14991162
 ] 

ASF GitHub Bot commented on STORM-1167:
---------------------------------------

Github user arunmahadevan commented on the pull request:

    https://github.com/apache/storm/pull/855#issuecomment-153961998
  
    @harshach  Right now the behavior is such that in case of failures the 
events will get replayed and the results will be recomputed and there will be 
potentially many duplicates. I assume you mean providing apis to save the 
partial results of computation in some persistent storage and support for 
retrieving the state. Along with this we also need to checkpoint the evaluated 
state of the window in the background and use this info to avoid re-evaluating 
window when events get replayed. This will help in reducing the duplicates. 
Since its more involved work, I will raise separate jiras to track this and 
will add it incrementally. 


> Add sliding & tumbling window support for core storm
> ----------------------------------------------------
>
>                 Key: STORM-1167
>                 URL: https://issues.apache.org/jira/browse/STORM-1167
>             Project: Apache Storm
>          Issue Type: Improvement
>            Reporter: Arun Mahadevan
>            Assignee: Arun Mahadevan
>
> Currently, topologies that needs windowing support requires writing custom 
> logic inside bolts making it tedious to handle the windowing and acking logic 
> with custom logic.
> We can add framework level support to core storm bolts to process tuples in a 
> time or a count based window. Sliding and tumbling windows can be supported.
> Later this can be extended to trident apis as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to