Soumyakanti Das created HIVE-24034:
--------------------------------------

             Summary: Add getTable to HS2 local cache
                 Key: HIVE-24034
                 URL: https://issues.apache.org/jira/browse/HIVE-24034
             Project: Hive
          Issue Type: New Feature
            Reporter: Soumyakanti Das


getTable is called from many other APIs. Although its latency is not that high 
(from tests with TPCDS in DWX), it'd be good to cache it to improve the query 
compilation latency even further.
However, it looks like this is not as straightforward as caching other APIs 
like listPartitionsByExpr or getAggrColStatsFor as these APIs include the 
tableID in its key but getTable cannot do this (without getting the table 
first). 
The problem arises when a table is dropped and recreated with the same name, 
because then they have same dbName, tblName, and writeIdList in the 
GetTableRequest object, which is used as the key in the cache. It'd be good to 
somehow utilize the id field of the request as well.
More investigation is required for this feature.



Related:
[HIVE-23949|https://issues.apache.org/jira/browse/HIVE-23949]

[HIVE-24025|https://issues.apache.org/jira/browse/HIVE-24025]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to