Narayanan Venkateswaran created HIVE-24369:
----------------------------------------------
Summary: Implement projection spec for fetching only requested
fields from tables
Key: HIVE-24369
URL: https://issues.apache.org/jira/browse/HIVE-24369
Project: Hive
Issue Type: Improvement
Components: Hive
Reporter: Narayanan Venkateswaran
Assignee: Narayanan Venkateswaran
Currently HMS APIs that return Table objects return fully populated Table
objects. This object table is a bit heavy with all columns, their datatype
info, storage descriptor, list of properties set etc. So an API that can fetch
large amounts of tables, say 100k, they may not be able to retrieve all of them
in a single call due to memory constraints.
To improve performance of the API for callers, they can selectively turn on
what fields on the Table object to populate on the returned objects via a
projection spec.
Something similar has already been done for partitions in HIVE-20306.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
