[jira] [Commented] (SPARK-9240) Hybrid aggregate operator using unsafe row
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648621#comment-14648621 ] Apache Spark commented on SPARK-9240: - User 'yhuai' has created a pull request for this issue: https://github.com/apache/spark/pull/7813 > Hybrid aggregate operator using unsafe row > -- > > Key: SPARK-9240 > URL: https://issues.apache.org/jira/browse/SPARK-9240 > Project: Spark > Issue Type: Sub-task > Components: SQL >Reporter: Yin Huai >Priority: Blocker > > We need a hybrid aggregate operator, which first tries hash-based > aggregations and gracefully switch to sort-based aggregations if the hash > map's memory footprint exceeds a given threshold (how to track memory > footprint and how to set the threshold?). -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-9240) Hybrid aggregate operator using unsafe row
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649043#comment-14649043 ] Apache Spark commented on SPARK-9240: - User 'lianhuiwang' has created a pull request for this issue: https://github.com/apache/spark/pull/7827 > Hybrid aggregate operator using unsafe row > -- > > Key: SPARK-9240 > URL: https://issues.apache.org/jira/browse/SPARK-9240 > Project: Spark > Issue Type: Sub-task > Components: SQL >Reporter: Yin Huai >Priority: Blocker > > We need a hybrid aggregate operator, which first tries hash-based > aggregations and gracefully switch to sort-based aggregations if the hash > map's memory footprint exceeds a given threshold (how to track memory > footprint and how to set the threshold?). -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-9240) Hybrid aggregate operator using unsafe row
[ https://issues.apache.org/jira/browse/SPARK-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14654925#comment-14654925 ] Apache Spark commented on SPARK-9240: - User 'yhuai' has created a pull request for this issue: https://github.com/apache/spark/pull/7954 > Hybrid aggregate operator using unsafe row > -- > > Key: SPARK-9240 > URL: https://issues.apache.org/jira/browse/SPARK-9240 > Project: Spark > Issue Type: Sub-task > Components: SQL >Reporter: Yin Huai >Assignee: Yin Huai >Priority: Blocker > Fix For: 1.5.0 > > > We need a hybrid aggregate operator, which first tries hash-based > aggregations and gracefully switch to sort-based aggregations if the hash > map's memory footprint exceeds a given threshold (how to track memory > footprint and how to set the threshold?). -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
