Re:Handling late events with Table API / SQL

[Xuyang]

Hi, for out of order events,  watermark can handle them. However, for late 
events, Flink Table & SQL are not 
supported to output them to a side channel like DataStream API. There have been 
some JIRAs related this.[1][2]
If you really need this feature, you may consider initiating related 
discussions in the dev mail again.
  
[1] https://issues.apache.org/jira/browse/FLINK-10031
[2] https://issues.apache.org/jira/browse/FLINK-20527




--

    Best！
    Xuyang




At 2024-03-06 01:55:03, "Sunny S" <sunny8...@outlook.in> wrote:

Hi,


I am using Flink SQL to create a table something like this :


CREATE TABLE some-table ( 
      ...,
      ...,
      ...,
      ...,
      event_timestamp as TO_TIMESTAMP_LTZ(event_time*1000, 3),
      WATERMARK FOR event_timestamp AS event_timestamp - INTERVAL '30' SECOND
) WITH (
      'connector' = 'kafka',
      'topic' = 'some-topic', +
      'properties.bootstrap.servers' = 'localhost:9092',
      'properties.group.id' = 'testGroup',
      'value.format' = 'csv'
)


I want to understand how can I deal with late events / out of order events when 
using Flink SQL / Table API? How can I collect the late / out of order events 
to a side output with Table API / SQL?


Thanks