GitHub user koertkuipers opened a pull request:
https://github.com/apache/spark/pull/13512
[SPARK-15769][SQL] Add Encoder for input type to Aggregator
## What changes were proposed in this pull request?
Aggregator also has an Encoder for the input type
## How was this patch tested?
Add tests to DatasetAggregatorSuite to upcast aggregator input types and
apply Aggregator only to selected columns
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tresata/spark feat-aggregator-input-encoder
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13512.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13512
----
commit 6da0aef2885170ff4ecc6394463de6aedadbf867
Author: Koert Kuipers <ko...@tresata.com>
Date: 2016-06-03T04:13:14Z
add input encoder to aggregator
commit 31f7b68ef9db3261a378272f714086afbd0e3208
Author: Koert Kuipers <ko...@tresata.com>
Date: 2016-06-03T04:32:38Z
make inputDeserializer mandatory in TypedAggregateExpression
commit 76b8878a84b11b37e50b30c87822ac34546393f2
Author: Koert Kuipers <ko...@tresata.com>
Date: 2016-06-03T04:53:27Z
show aggregator can now be used in DataFrame without needing to handle row
objects directly
commit 077f782cbf1e64439b8d5bb738819faebbf5914b
Author: Koert Kuipers <ko...@tresata.com>
Date: 2016-06-03T05:31:44Z
allow aggregator to operate on subset of columns
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
