Yu-Wen Lai created IMPALA-11032:
-----------------------------------

             Summary: Automatic Refresh of Metadata for Local Catalog after 
Compaction
                 Key: IMPALA-11032
                 URL: https://issues.apache.org/jira/browse/IMPALA-11032
             Project: IMPALA
          Issue Type: Improvement
          Components: Catalog
            Reporter: Yu-Wen Lai
            Assignee: Yu-Wen Lai


After Hive compaction for tables created in the Hive warehouse, queries(HIVE 
ACID table) made in Impala possibly fail with a FileNotFoundException if a file 
removed by the Hive cleaner.

In IMPALA-10801, we check latest compaction id before serving metadata from 
Catalogd. However, coordinators don't take advantage of that. Coordinators have 
local cache so we will have do the same compaction check for coordinator as 
well.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to