Dimitris Tsirogiannis created IMPALA-6901: ---------------------------------------------
Summary: Investigate memory consumption of table metrics in the catalog Key: IMPALA-6901 URL: https://issues.apache.org/jira/browse/IMPALA-6901 Project: IMPALA Issue Type: Improvement Components: Catalog Affects Versions: Impala 3.0, Impala 2.12.0 Reporter: Dimitris Tsirogiannis IMPALA-4886 introduced the concept of per-table metrics. In some cases (catalog with 90K tables) it has been reported that the table metrics can consume almost 30% of catalog heap size. We should perform the following actions: # Measure the impact of table metrics on memory usage. # Tune/optimize table metrics to reduce their memory requirements. Some quick fixes/ideas may include: a) replace/tune histogram based metrics with simpler ones, b) eliminate metrics that are not considered particularly useful, c) store detailed metrics only for "interesting" tables (e.g. large tables that are heavily used). -- This message was sent by Atlassian JIRA (v7.6.3#76005)