Xiao Cai created FLINK-20573:
--------------------------------

             Summary: Set the function of abnormal event time filter
                 Key: FLINK-20573
                 URL: https://issues.apache.org/jira/browse/FLINK-20573
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / API
    Affects Versions: 1.11.2
            Reporter: Xiao Cai


Currently, after defining the event time and watermark in flink sql, if 
abnormal data is received, such as test data, and it happens that the event 
time of that test data is very large, it will cause the watermark of the whole 
stream to become large, so that any normal data coming in afterwards will not 
be processed by the stream.
Is it possible to set a configuration item in 'with' to identify what kind of 
data is abnormal data that can be automatically filtered, such as event time 
more than half an hour or more than 2 hours from the current time, will be 
automatically filtered by the stream; or the event time of an event with a 
certain value range in the event stream id will not affect the stream's 
watermark generation.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to