[jira] [Created] (HIVE-21225) ACID: getAcidState() should cache a recursive dir listing locally

[Gopal V (JIRA)]

Gopal V created HIVE-21225:
------------------------------

             Summary: ACID: getAcidState() should cache a recursive dir listing 
locally
                 Key: HIVE-21225
                 URL: https://issues.apache.org/jira/browse/HIVE-21225
             Project: Hive
          Issue Type: Bug
          Components: Transactions
            Reporter: Gopal V


Currently getAcidState() makes 3 calls into the FS api which could be answered 
by making a single recursive listDir call and reusing the same data to check 
for isRawFormat() and isValidBase().

All delta operations for a single partition can go against a single listed 
directory snapshot instead of interacting with the NameNode or ObjectStore 
within the inner loop.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)