[
https://issues.apache.org/jira/browse/IMPALA-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vuk Ercegovac resolved IMPALA-7425.
-----------------------------------
Resolution: Fixed
Fix Version/s: Impala 3.1.0
> Add option to load incremental statistics from catalog
> ------------------------------------------------------
>
> Key: IMPALA-7425
> URL: https://issues.apache.org/jira/browse/IMPALA-7425
> Project: IMPALA
> Issue Type: Sub-task
> Components: Catalog
> Affects Versions: Impala 3.1.0
> Reporter: Vuk Ercegovac
> Assignee: Vuk Ercegovac
> Priority: Major
> Fix For: Impala 3.1.0
>
>
> Incremental statistics currently store all required data in catalogd and all
> impalad coordinators. However, this data is only required when computing
> incremental statistics. In cases where incremental statistics is used on many
> partition columns (due to tables with many columns, many partitions or both),
> this data can dominate the overall memory footprint. This can lead to OOM's,
> increased network usage, and instability.
> Add an option to avoid propagating incremental stats to all coordinators and
> instead, pull it on demand from the catalog only when needed by the compute
> incremental statistics statement.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
