Roy Huang created SPARK-57200:
---------------------------------
Summary: JVM whole-stage codegen returns NULL for 3-arg form with
column nullReplacement
Key: SPARK-57200
URL: https://issues.apache.org/jira/browse/SPARK-57200
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 4.2.0
Reporter: Roy Huang
ArrayJoin.doGenCode silently returns NULL for every row when the third argument
(nullReplacement) is a non-foldable column, the plan is fused in Whole-Stage
Codegen (WSCG), and an upstream Filter with IsNotNull(array) has tightened the
array (and/or delimiter) nullability. Interpreted eval() and Photon both return
the correct joined string.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
