Liang-Chi Hsieh created SPARK-28345: ---------------------------------------
Summary: PythonUDF predicate should be able to pushdown to join Key: SPARK-28345 URL: https://issues.apache.org/jira/browse/SPARK-28345 Project: Spark Issue Type: Improvement Components: PySpark, SQL Affects Versions: 3.0.0 Reporter: Liang-Chi Hsieh A Filter predicate using PythonUDF can't be push down into join condition, currently. A predicate like that should be able to push down to join condition. For PythonUDFs that can't be evaluated in join condition, {{PullOutPythonUDFInJoinCondition}} will pull them out later. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org