[
https://issues.apache.org/jira/browse/SPARK-25690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644273#comment-16644273
]
Xiao Li commented on SPARK-25690:
---------------------------------
The changes made in https://issues.apache.org/jira/browse/SPARK-25044 broke the
rule HandleNullInputsForUDF. It is not idempotent any more.
Since AnalysisBarrier is removed in 2.4 release, this is not blocker based on
my evaluation. However, we should still fix it. cc [~cloud_fan] [~rxin]
> Analyzer rule "HandleNullInputsForUDF" does not stabilize and can be applied
> infinitely
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-25690
> URL: https://issues.apache.org/jira/browse/SPARK-25690
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core, SQL
> Affects Versions: 2.4.0
> Reporter: Maryann Xue
> Priority: Major
>
> This was fixed in SPARK-24891 and was then broken by SPARK-25044.
> The tests added in SPARK-24891 were not good enough and the expected failures
> were shadowed by SPARK-24865. For more details, please refer to SPARK-25650.
> Code changes and tests in
> [https://github.com/apache/spark/pull/22060/files#diff-f70523b948b7af21abddfa3ab7e1d7d6R72]
> can help reproduce the issue.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
