GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/21704
[SPARK-24734][SQL] Fix containsNull of Concat for array type.
## What changes were proposed in this pull request?
Currently `Concat` for array type uses the data type of the first child as
its own data type, but the children might include an array containing nulls.
We should aware the nullabilities of all children.
## How was this patch tested?
Modified and added some tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ueshin/apache-spark
issues/SPARK-24734/concat_containsnull
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21704.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21704
----
commit d87a8c6c0d1a4db5c9444781160a65562f8ea738
Author: Takuya UESHIN <ueshin@...>
Date: 2018-07-03T11:21:06Z
Fix containsNull of Concat for array type.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
