Luka Zdravic created SPARK-61569:
------------------------------------
Summary: Keep the sort-merge ASOF JOIN cursor scan with a
left-only ON condition
Key: SPARK-61569
URL: https://issues.apache.org/jira/browse/SPARK-61569
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.4.0
Reporter: Luka Zdravic
In a LEFT ASOF JOIN, a left-only ON predicate, e.g. ON t.k = q.k AND t.qty >
100, stays in the join condition because the join keeps every left row. It
becomes a residual condition, which turns off the cursor scan. It can instead
be checked once per left row: a row that fails it gets NULL right columns.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]