GitHub user viirya opened a pull request:
https://github.com/apache/spark/pull/21576
[SPARK-24548[SQL] Fix incorrect schema of Dataset with tuple encoders
## What changes were proposed in this pull request?
When creating tuple expression encoders, we should give the serializer
expressions of tuple items correct names, so we can have correct output schema
when we use such tuple encoders.
## How was this patch tested?
Added test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/viirya/spark-1 SPARK-24548
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21576.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21576
----
commit e349448c6f667d04074008e27501c6f32cdcd52b
Author: Liang-Chi Hsieh <viirya@...>
Date: 2018-06-15T08:13:08Z
Dataset with tuple encoders should have correct schema.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
