n0r0shi opened a new pull request, #3630:
URL: https://github.com/apache/datafusion-comet/pull/3630
- Replace the CASE WHEN wrapper around array_has with a direct call to
datafusion-spark's
SparkArrayContains, which handles Spark's three-valued NULL semantics
natively
- When an element is not found and the array contains NULL elements, the
result is now correctly NULL
instead of false
- Net reduction of ~25 lines by removing the manual NULL handling logic
Depends on
- apache/datafusion#20685 (adds SparkArrayContains to datafusion-spark
crate)
Test plan
- Existing CometArrayExpressionSuite tests pass
- Verify three-valued NULL semantics: array_contains(array(1, NULL, 3), 2)
returns NULL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
