[
https://issues.apache.org/jira/browse/SPARK-8641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hovell updated SPARK-8641:
-------------------------------------
Description:
The current Window implementation uses Hive UDAFs for all aggregation
operations. In this ticket we will move to this functionality to Native Spark
Expressions. The rationale for this is that although Hive UDAFs are very well
written, they remain opaque in processing and memory management; this makes
them hard to optimize.
This ticket and its PR will build on the work being done in SPARK-4366.
was:
The current Window implementation uses Hive UDAFs for all aggregation
operations. In this ticket we will move to this functionality to Native Spark
Expressions.
A PR will follow as soon as SPARK-8638 gets in.
> Native Spark Window Functions
> -----------------------------
>
> Key: SPARK-8641
> URL: https://issues.apache.org/jira/browse/SPARK-8641
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 1.5.0
> Reporter: Herman van Hovell
>
> The current Window implementation uses Hive UDAFs for all aggregation
> operations. In this ticket we will move to this functionality to Native Spark
> Expressions. The rationale for this is that although Hive UDAFs are very well
> written, they remain opaque in processing and memory management; this makes
> them hard to optimize.
> This ticket and its PR will build on the work being done in SPARK-4366.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
