GitHub user hvanhovell opened a pull request:
https://github.com/apache/spark/pull/7715
[SPARK-8641][SPARK-8712][SQL] Native Spark Window Functions [WIP]
This replaces the Hive UDAFs with native Spark SQL UDAFs using the new UDAF
interface. See the JIRA ticket for more information.
This is currently a work in progress. I have created the PR in order to get
feedback. There are still a number of open issues:
* Remove the Hive Window Function and old Window Function code path. This
is completely replaced by the new interface.
* Improve the check analysis messages.
* A lot of testing: the Distinct aggregation path, Error messages.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hvanhovell/spark SPARK-8641
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7715.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7715
----
commit 73ad5cb4a70b07656431aeec0b8ec8cb938aba81
Author: Herman van Hovell <hvanhov...@questtec.nl>
Date: 2015-07-22T22:06:30Z
Added WindowFunctions.
commit 160987d3808ce6d44b46660bb641962d5732754d
Author: Herman van Hovell <hvanhov...@questtec.nl>
Date: 2015-07-26T04:33:47Z
Move to Native Spark UDAFs for window processing.
commit 55aed3cf827326388c90262c0fb81f5b5bd83f19
Author: Herman van Hovell <hvanhov...@questtec.nl>
Date: 2015-07-26T04:45:33Z
Rebase & make it compile again.
commit 52c6319b5acdf838b997154b744595676e317668
Author: Herman van Hovell <hvanhov...@questtec.nl>
Date: 2015-07-26T16:56:36Z
Bug fixes....
commit abba35fabb72fd0a93b8c86fc8a723b02cb6c9fb
Author: Herman van Hovell <hvanhov...@questtec.nl>
Date: 2015-07-27T19:30:47Z
Add NoOp to interpreted projections.
commit fedb164b97115a2481e9e74c94c1cf371a7246fe
Author: Herman van Hovell <hvanhov...@questtec.nl>
Date: 2015-07-28T03:52:33Z
Bugfixes... All tests work now.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
