Rajesh Balamohan created HIVE-24838:
---------------------------------------
Summary: Reduce FS creation in Warehouse::getDnsPath for object
stores
Key: HIVE-24838
URL: https://issues.apache.org/jira/browse/HIVE-24838
Project: Hive
Issue Type: Improvement
Reporter: Rajesh Balamohan
Attachments: Screenshot 2021-03-02 at 11.09.01 AM.png
[https://github.com/apache/hive/blob/master/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/Warehouse.java#L143]
Warehouse::getDnsPath gets invoked from multiple places (e.g getDatabase()
etc). In certain cases like dynamic partition loads, lot of calls FS
instantiation calls can be avoided for object stores.
It would be good to check for BlobStorages and if so, it should be possible to
avoid FS creation.
[https://github.com/apache/hive/blob/master/common/src/java/org/apache/hadoop/hive/common/BlobStorageUtils.java#L33]
!Screenshot 2021-03-02 at 11.09.01 AM.png|width=372,height=296!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)