We can get a stream from a DataStream api by SideOutput. But it's hard to do
the same thing with Flink SQL.
I have an idea about how to get the late records while using Flink SQL.
Assuming we have a source table for the late records, then we can query late
records on it. Obviously, it's not a rea
Hi,
your explanation makes sense but I'm wondering how the implementation
would look like. This would mean bigger changes in a Flink fork, right?
Late data handling in SQL is a frequently asked question. Currently, we
don't have a good way of supporting it. Usually, we recommend to use
DataS
Thanks Timo.
The whole idea is also based on the side output and output tag. Let me
explain it in detail:
1. Introduce a VirtualTableScan(or SideOutputTableScan), which can be
optimized as Physical RelNode. Then we can create a source catalog table
which will be converted to a VirtualTableScan, a