mahesh kumar behera created HIVE-25205:
------------------------------------------
Summary: Reduce overhead of adding write notification log during
batch loading of partition.
Key: HIVE-25205
URL: https://issues.apache.org/jira/browse/HIVE-25205
Project: Hive
Issue Type: Sub-task
Components: Hive, HiveServer2
Reporter: mahesh kumar behera
Assignee: mahesh kumar behera
During batch loading of partition the write notification logs are added for
each partition added. This is causing delay in execution as the call to HMS is
done for each partition. This can be optimised by adding a new API in HMS to
send a batch of partition and then this batch can be added together to the
backend database. Once we have a batch of notification log, at HMS side, code
can be optimised to add the logs using single call to backend RDBMS.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
