[ https://issues.apache.org/jira/browse/IMPALA-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tim Armstrong resolved IMPALA-9530. ----------------------------------- Fix Version/s: Impala 4.0 Resolution: Fixed > Allow limiting memory consumed by preaggregation > ------------------------------------------------ > > Key: IMPALA-9530 > URL: https://issues.apache.org/jira/browse/IMPALA-9530 > Project: IMPALA > Issue Type: Improvement > Components: Backend > Reporter: Tim Armstrong > Assignee: Tim Armstrong > Priority: Major > Fix For: Impala 4.0 > > > In some cases pre-aggregations can balloon up and consume lots of memory, > forcing the merge aggregation to spill. This is often OK as long as the > preaggregation is reducing the input sufficiently, since it reduces the > amount of data shuffled over the network. > However in some cases it's preferable to be more conservative with memory and > just cap the size of the preaggregation to prevent it ballooning too much. > It would be useful to add a query option to directly limit the memory > consumption of the preaggregations. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org