[
https://issues.apache.org/jira/browse/SPARK-1412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14243077#comment-14243077
]
Reynold Xin commented on SPARK-1412:
------------------------------------
I think we should still do it - it's just that the current AppendOnlyMap isn't
really built for it. We will probably revisit this in the future.
> Disable partial aggregation automatically when reduction factor is low
> ----------------------------------------------------------------------
>
> Key: SPARK-1412
> URL: https://issues.apache.org/jira/browse/SPARK-1412
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.0.0
> Reporter: Reynold Xin
> Assignee: Michael Armbrust
> Priority: Minor
>
> Once we see enough number of rows in partial aggregation and don't observe
> any reduction, the aggregate operator should just turn off partial
> aggregation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
