Sai Hemanth Gantasala has posted comments on this change. ( http://gerrit.cloudera.org:8080/22554 )
Change subject: IMPALA-13593: Enable event processor to consume ALTER_PARTITIONS events from metastore ...................................................................... Patch Set 11: (1 comment) http://gerrit.cloudera.org:8080/#/c/22554/11//COMMIT_MSG Commit Message: http://gerrit.cloudera.org:8080/#/c/22554/11//COMMIT_MSG@19 PS11, Line 19: . This can cause partitions to be refreshed even on : trivial changes to them. > This sounds like a potential perf regression to me. Couldn't HMS add the be Agree. But HIVE-27746 is controlled with a config, and it is not turned on by default. So we are not making things bad at this moment. The plus side of the patch is we don't have to batch partition events together in the event processor and reload them in one-go. I plan to make improvements in HMS (either adding before-partitions or marking which partitions really changed in the notification event). I also plan to do non-functional qe testing to understand the perf regression after merging this patch to understand the advantages of having fewer events for large partitioned tables. -- To view, visit http://gerrit.cloudera.org:8080/22554 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I009a87ef5e2c331272f9e2d7a6342cc860e64737 Gerrit-Change-Number: 22554 Gerrit-PatchSet: 11 Gerrit-Owner: Sai Hemanth Gantasala <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Daniel Becker <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Quanlong Huang <[email protected]> Gerrit-Reviewer: Sai Hemanth Gantasala <[email protected]> Gerrit-Comment-Date: Thu, 17 Jul 2025 00:11:53 +0000 Gerrit-HasComments: Yes
