Riza Suminto has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/22869 )
Change subject: IMPALA-14051: Use batch insert HMS API to fire insert events ...................................................................... IMPALA-14051: Use batch insert HMS API to fire insert events Firing insert statements from Impala can be improved by leveraging the batch insert HMS API addWriteNotificationLogInBatch() available (via HIVE-25205) starting from Hive 4. Right now, Impala is using a single call for each partition, so firing insert statements on a huge partitioned table can become a performance bottleneck. This patch addresses the above concern by leveraging addWriteNotificationLogInBatch() API to fire batch insert partition events. Note: This optimization is applicable only for transactional partitioned tables. The external partitioned table case is already handled. Change-Id: Iff4a2691631fe9e9e1dc07714c69580a4ace6a8b Reviewed-on: http://gerrit.cloudera.org:8080/22869 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Riza Suminto <[email protected]> --- M fe/src/compat-hive-3/java/org/apache/impala/compat/MetastoreShim.java M fe/src/main/java/org/apache/impala/util/MetaStoreUtil.java 2 files changed, 27 insertions(+), 18 deletions(-) Approvals: Impala Public Jenkins: Verified Riza Suminto: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/22869 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Iff4a2691631fe9e9e1dc07714c69580a4ace6a8b Gerrit-Change-Number: 22869 Gerrit-PatchSet: 4 Gerrit-Owner: Sai Hemanth Gantasala <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Riza Suminto <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]> Gerrit-Reviewer: Yida Wu <[email protected]>
