Szehon Ho created HIVE-24263:
--------------------------------
Summary: Create an HMS endpoint to list partition locations
Key: HIVE-24263
URL: https://issues.apache.org/jira/browse/HIVE-24263
Project: Hive
Issue Type: Improvement
Components: Standalone Metastore
Reporter: Szehon Ho
In our company, we have a use-case to get quickly a list of partition
locations. Currently it is done via listPartitions, which is a very heavy
operation in terms of memory and performance.
For example, we have an integration from output of a Hive pipeline to Spark
jobs that consume directly from HDFS. It needs to know the partition paths
that are available for consumation, and does repeated listPartitions() for this.
As there is already an internal method in the ObjectStore for this done for
dropPartitions, it is only a matter of exposing this API to HiveMetaStoreClient.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
