Liang-Chi Hsieh created SPARK-28345:
---------------------------------------
Summary: PythonUDF predicate should be able to pushdown to join
Key: SPARK-28345
URL: https://issues.apache.org/jira/browse/SPARK-28345
Project: Spark
Issue Type: Improvement
Components: PySpark, SQL
Affects Versions: 3.0.0
Reporter: Liang-Chi Hsieh
A Filter predicate using PythonUDF can't be push down into join condition,
currently. A predicate like that should be able to push down to join condition.
For PythonUDFs that can't be evaluated in join condition,
{{PullOutPythonUDFInJoinCondition}} will pull them out later.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
