[GitHub] spark pull request #20547: [SPARK-23316][SQL] AnalysisException after max it...

[bogdanrdc]

Github user bogdanrdc closed the pull request at:

https://github.com/apache/spark/pull/20547


---

-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20547: [SPARK-23316][SQL] AnalysisException after max it...

[bogdanrdc]

GitHub user bogdanrdc opened a pull request:

https://github.com/apache/spark/pull/20547

[SPARK-23316][SQL] AnalysisException after max iteration reached for IN 
query

## What changes were proposed in this pull request?
Added flag ignoreNullability to DataType.equalsStructurally.
The previous semantic is for ignoreNullability=false.
When ignoreNullability=true equalsStructurally ignores nullability of 
contained types (map key types, value types, array element types, structure 
field types).
In.checkInputTypes calls equalsStructurally to check if the children types 
match. They should match regardless of nullability (which is just a hint), so 
it is now called with ignoreNullability=true.

## How was this patch tested?
New test in SubquerySuite.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bogdanrdc/spark SPARK-23316

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/spark/pull/20547.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #20547


commit 03a4281751e02acd2b97ceff6cf8e1621e83eb93
Author: Bogdan Raducanu 
Date:   2017-04-20T10:59:49Z

fix + test

commit 72cf1d117890abe45aa30c6b91a7e2c527fc4969
Author: Bogdan Raducanu 
Date:   2017-04-20T11:01:40Z

reverted mistake commit

commit 2c96a8d65059db3b808e05241b870ccd17937095
Author: Bogdan Raducanu 
Date:   2017-05-12T15:24:57Z

erge remote-tracking branch 'upstream/master'

commit fa11b0b97b38bb98b599a8edf1d43e01b067a926
Author: Bogdan Raducanu 
Date:   2017-05-23T11:28:34Z

Merge remote-tracking branch 'upstream/master'

commit 21ad3aa4468b58aa4e552e2922e1bceda61097f7
Author: Bogdan Raducanu 
Date:   2017-05-23T11:28:57Z

Merge remote-tracking branch 'upstream/master'

commit 7f78cce9d6869371e2e28ce5d9fc4766d7dbc3de
Author: Bogdan Raducanu 
Date:   2017-06-06T11:19:35Z

Merge remote-tracking branch 'upstream/master'

commit eea2e5d466558aa3f2f6232024e8150dc246ba8a
Author: Bogdan Raducanu 
Date:   2017-06-07T10:35:37Z

Merge remote-tracking branch 'upstream/master'

commit b30788eac9df5e76863393826230481e23e52550
Author: Bogdan Raducanu 
Date:   2017-06-16T10:49:48Z

Merge remote-tracking branch 'upstream/master'

commit 38a0347e3079a3e56d70b77f5e25994497eabe41
Author: Bogdan Raducanu 
Date:   2017-06-27T10:33:10Z

Merge remote-tracking branch 'upstream/master'

commit 1057abe6262353093ccf9b75ed24ed54fdfc0095
Author: Bogdan Raducanu 
Date:   2017-06-28T12:35:12Z

Merge remote-tracking branch 'upstream/master'

commit 3f7bf43fab830c7cc6473b654ca290b23a9886be
Author: Bogdan Raducanu 
Date:   2017-07-07T11:08:05Z

Merge remote-tracking branch 'upstream/master'

commit 0a51b0f8640236da4054a25ca50bb8d19ba73b70
Author: Bogdan Raducanu 
Date:   2017-07-09T11:08:41Z

Merge remote-tracking branch 'upstream/master'

commit 3d11dca76380c7c53710141114aa768b1477b893
Author: Bogdan Raducanu 
Date:   2017-07-10T10:18:46Z

Merge remote-tracking branch 'upstream/master'

commit 015c84b6beb29c0b275b01f7774a2b7d8aa8d180
Author: Bogdan Raducanu 
Date:   2017-07-12T10:21:48Z

Merge remote-tracking branch 'upstream/master'

commit 597ddf2265149427f796eed1a43539b13e1516d9
Author: Bogdan Raducanu 
Date:   2017-08-03T12:45:36Z

Merge remote-tracking branch 'upstream/master'

commit 38549ba22681ba6622c4f1cd9c1b97592c5a34a5
Author: Bogdan Raducanu 
Date:   2017-08-04T09:17:09Z

Merge remote-tracking branch 'upstream/master'

commit 89b86c0d1e4616eae2902da79be308e0573ab5e3
Author: Bogdan Raducanu 
Date:   2017-09-10T19:23:22Z

Merge remote-tracking branch 'upstream/master'

commit edd1fbf107501bc9a0bdbf4f712577b9fe1fd3f6
Author: Bogdan Raducanu 
Date:   2017-10-30T14:18:09Z

Merge remote-tracking branch 'upstream/master'

commit 6ead465cb00fc36869d152693a4cd1318fa005b9
Author: Bogdan Raducanu 
Date:   2017-12-21T15:17:45Z

Merge remote-tracking branch 'upstream/master'

commit d83a3adfba5d790270214887f615ab95ba50a2f9
Author: Bogdan Raducanu 
Date:   2018-01-10T11:53:31Z

Merge remote-tracking branch 'upstream/master'

commit 4b79fd683102137401ed4e77ee351439c0d254b5
Author: Bogdan Raducanu 
Date:   2018-01-11T04:01:12Z

Merge remote-tracking branch 'upstream/master'

commit ffa5debdd3b6a7e0bd70d01e640f048883b23440
Author: Bogdan Raducanu 
Date:   2018-01-18T12:44:12Z

Merge remote-tracking branch 'upstream/master'

commit aec35c98a4ea0db2cee52785e51130243cdc0b61
Author: Bogdan Raducanu 
Date:   2018-01-24T17:23:37Z

Merge remote-tracking branch 'upstream/master'

commit