Re: IntervalJoin invisibly becomes a regular Join - why?

2023-03-16 Thread mark
Is there anything that an author can do to prevent a well-formed Interval Join from being 'optimised' into a regular, non-interval join by later queries? Does the Flink runtime make any guarantees that when it alters an interval join into a regular join, that the safety of the original interval

Re: IntervalJoin invisibly becomes a regular Join - why?

2023-03-15 Thread Leonard Xu
> > CREATE TEMPORARY VIEW filteredResults AS > SELECT * from suspiciousOrders WHERE small_ts > large_ts; Looks like after added the condition, the final expanded query should not match the condition[1] of an interval join that leads to the planner recognize it as an interval join. It’s not

IntervalJoin invisibly becomes a regular Join - why?

2023-03-15 Thread mark
Hello, I'm seeing some strange behaviour in Flink SQL where adding a new SELECT statement causes a previously created Interval Join to be changed into a regular Join. I'm concerned because the Flink docs make clear that regular Joins are not safe because their memory usage can grow indefinitely.