[
https://issues.apache.org/jira/browse/PHOENIX-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabriel Reid resolved PHOENIX-631.
----------------------------------
Resolution: Fixed
Bulk resolve of closed issues imported from GitHub. This status was reached by
first re-opening all closed imported issues and then resolving them in bulk.
> Spool distinct GROUP BY map to disk if too big
> ----------------------------------------------
>
> Key: PHOENIX-631
> URL: https://issues.apache.org/jira/browse/PHOENIX-631
> Project: Phoenix
> Issue Type: Task
> Affects Versions: 3.0-Release
> Reporter: James Taylor
>
> When a GROUP BY is done over a very large set of distinct values, we'll end
> up throwing a InsufficientMemoryException if the in-memory map gets too
> large. Instead, we should spool the map to disk in a way that still makes
> searching it efficient.
> The relevant code is in
> com.salesforce.phoenix.coprocessor.GroupedAggregateRegionObserver, line 237:
> aggregateMap.put(key, rowAggregators);
> Note that this map is kept per regions worth of data, not across the entire
> data set, but a single region can have a lot of data too (10-100M rows).
--
This message was sent by Atlassian JIRA
(v6.2#6252)
