Dilip Biswal created SPARK-25519:
------------------------------------
Summary: ArrayRemove function may return incorrect result when
right expression is implicitly downcasted.
Key: SPARK-25519
URL: https://issues.apache.org/jira/browse/SPARK-25519
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.4.0
Reporter: Dilip Biswal
Assignee: Dilip Biswal
Fix For: 2.4.0
In ArrayPosition, we currently cast the right hand side expression to match the
element type of the left hand side Array. This may result in down casting and
may return wrong result or questionable result.
Example :
spark-sql> select array_position(array(1), 1.34);
1
spark-sql> select array_position(array(1), 'foo');
null
We should safely coerce both left and right hand side expressions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
