Manu Zhang created GEARPUMP-342:
-----------------------------------

             Summary: Don't run DataSourceTask with WindowRunner unless 
necessary
                 Key: GEARPUMP-342
                 URL: https://issues.apache.org/jira/browse/GEARPUMP-342
             Project: Apache Gearpump
          Issue Type: Improvement
    Affects Versions: 0.8.4
            Reporter: Manu Zhang
             Fix For: 0.8.5


Currently, a windowed wordcount pipeline like 
{{source.flatMap.window.groupBy.count}} will actually be executed as 
{{source.globalWindow.flatMap.groupBy.window.count}} and 
{{globalWindow.flatMap}} run by a {{WindowRunner}}. 

The {{globalWindow}} is unnecessary unless {{source}} is followed by an 
aggregation. Further, the {{globalWindow}} requires {{Watermark.MAX}} to 
trigger emits which is not obvious for users. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to