Sam Whittle created BEAM-11143:
----------------------------------

             Summary: AfterWatermark can leak state for the late trigger when 
merging windows
                 Key: BEAM-11143
                 URL: https://issues.apache.org/jira/browse/BEAM-11143
             Project: Beam
          Issue Type: Bug
          Components: runner-core
            Reporter: Sam Whittle
            Assignee: Sam Whittle


AfterWatermarkStateMachine attempts to clear the late trigger state when 
merging and the early trigger is not closed in some windows.  However it 
appears to clear the state corresponding to the new window, not all of the 
states for the input windows.  This leaks the state which can lead to unbounded 
pipeline state buildup.

https://github.com/apache/beam/blob/68d6c8e6243b1d8f392840273f886276e2a8baff/runners/core-java/src/main/java/org/apache/beam/runners/core/triggers/AfterWatermarkStateMachine.java#L133



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to