Csaba Ringhofer created IMPALA-14739:
----------------------------------------

             Summary: Local catalog cache mem usage is hard do diagnise
                 Key: IMPALA-14739
                 URL: https://issues.apache.org/jira/browse/IMPALA-14739
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog, Frontend
            Reporter: Csaba Ringhofer


Huge objects like Iceberg tables with many files can dominate cache memory 
usage, but it is hard to decipher this information from metrics. There is also 
no trace of the very problematic case of truncating weight of >2GB objects:
https://github.com/apache/impala/blob/3be15fd3598071eaeddd9b4d29e0883b95fdd14a/fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java#L2353



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to