Micah Whitacre created HIVE-17956:
-------------------------------------
Summary: Retrieve "latest" partition from Hive Metastore
Key: HIVE-17956
URL: https://issues.apache.org/jira/browse/HIVE-17956
Project: Hive
Issue Type: New Feature
Components: Metastore
Reporter: Micah Whitacre
We are trying to utilize the Hive Metastore for our processing needs,
specifically focusing on consuming through the HCatalog APIs. One use case we
have is that we want to consume the "latest" partition. In researching there
are a number of posts[1][2] that talk about using queries through Hive Server2
to find that information. It would be more ideal if this was a first class API
offered from the Hive Metastore without requiring a query to be executed.
The other option would be to retrieve all of the partitions and sort client
side. There is a concern about the efficiency and memory requirements of this
especially without the "iterator" concept implemented from HIVE-7195.
[1] -
https://community.hortonworks.com/questions/85330/how-to-optimize-hive-access-to-the-latest-partitio.html
[2] -
https://stackoverflow.com/questions/36095790/how-to-find-the-most-recent-partition-in-hive-table
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
