[ 
https://issues.apache.org/jira/browse/FLINK-31212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lyn Zhang updated FLINK-31212:
------------------------------
    Summary: Data lost on interval left join with window group  (was: Data lost 
if window group after interval left join)

> Data lost on interval left join with window group
> -------------------------------------------------
>
>                 Key: FLINK-31212
>                 URL: https://issues.apache.org/jira/browse/FLINK-31212
>             Project: Flink
>          Issue Type: Bug
>          Components: Table SQL / Runtime
>    Affects Versions: 1.16.1
>            Reporter: Lyn Zhang
>            Priority: Major
>              Labels: pull-request-available
>         Attachments: image-2023-02-24-17-58-44-461.png, 
> image-2023-02-24-17-58-57-238.png, image-2023-02-24-17-59-25-179.png, 
> image-2023-02-24-18-00-52-891.png, test.sql
>
>
>  
> I have a case in [^test.sql] that records in table_1 left join fail will be 
> discard by group window.
> I check the interval join operator implements. If one record in left table 
> join right table fail, the record will not be emitted realtime but emitted 
> waiting for half join bound time. In the test.sql, table_1 left join table_2 
> in 5 minute bound,  and the output will delay 2.5 minute this will cause 
> window discard the records.
> h2. testing
> h4. input:
> !image-2023-02-24-17-58-44-461.png!
> {"n":"n1","ts":"2023-02-24 14:00:00"}\{"n":"n2","ts":"2023-02-24 
> 14:00:00"}{"n":"n1","ts":"2023-02-24 14:06:01"}
> !image-2023-02-24-17-58-57-238.png!
> {"n":"n1","ts":"2023-02-24 14:00:00","v":111}\{"n":"n1","ts":"2023-02-24 
> 14:06:01","v":111}
> h4. output:
> expect:
> !image-2023-02-24-18-00-52-891.png!
> real:
> !image-2023-02-24-17-59-25-179.png!
> I remove this logic in [https://github.com/apache/flink/pull/22014]  Please 
> help to review this PR.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to