[
https://issues.apache.org/jira/browse/FLINK-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14604369#comment-14604369
]
Gyula Fora commented on FLINK-2283:
-----------------------------------
These are rolling aggregations which are purely streaming transformations. I
dont see any reasons why we should force the window abstractions on them, I
think it just hurts in this case. Also the implementation will be much less
efficient if you add windowing because it has no purpose at all.
By your logic we can model almost any stream transformation as a window
transformation with trigger after every element. This is really a chicken/egg
question but here I think the streams were first :)
> Make grouped reduce/fold/aggregations stateful using Partitioned state
> ----------------------------------------------------------------------
>
> Key: FLINK-2283
> URL: https://issues.apache.org/jira/browse/FLINK-2283
> Project: Flink
> Issue Type: Improvement
> Components: Streaming
> Affects Versions: 0.10
> Reporter: Gyula Fora
> Priority: Minor
>
> Currently the inner state of the grouped aggregations are not persisted as an
> operator state.
> These operators should be reimplemented to use the newly introduced
> partitioned state abstractions which will make them fault tolerant and
> scalable for the future.
> A suggested implementation would be to use a stateful mapper to implement the
> desired behaviour.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
