Timo Walther created FLINK-39255:
------------------------------------

             Summary: Support late data in PTFs
                 Key: FLINK-39255
                 URL: https://issues.apache.org/jira/browse/FLINK-39255
             Project: Flink
          Issue Type: Sub-task
          Components: Table SQL / Runtime
            Reporter: Timo Walther
            Assignee: Timo Walther


Silently dropping records contradicts standard SQL semantics, which are 
typically agnostic to event-time lateness. Furthermore, relying on strict 
watermarking is often impractical, as watermark strategies are frequently 
dictated by upstream teams or are too complex for end-users to manage.

Therefore, the PTF implementer should have the autonomy to decide how to handle 
late data. Some might drop, some handle it as a special case, or reroute to a 
late data side output. In most of the cases, however, users most likely don’t 
care about the data being late as they don’t consider event-time semantics in 
their implementation.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to