Riza Suminto has posted comments on this change. ( http://gerrit.cloudera.org:8080/20612 )
Change subject: IMPALA-3825: Delegate runtime filter aggregation to some executors ...................................................................... Patch Set 17: (1 comment) http://gerrit.cloudera.org:8080/#/c/20612/10/be/src/runtime/runtime-filter-bank.cc File be/src/runtime/runtime-filter-bank.cc: http://gerrit.cloudera.org:8080/#/c/20612/10/be/src/runtime/runtime-filter-bank.cc@722 PS10, Line 722: > My assumption is A. I believe it is rare but not impossible. That is why I Runtime filter is most needed in big scan fragment, which most likely distributed across all executor nodes, including nodes selected as intermediate aggregator. If an executor still has running scan, then its RuntimeFilterBank will stay open. If an executor does not have any fragment instance running anymore, then its RuntimeFilterBank may be closing. If this is true for all executors, then pending runtime filter does not matter anymore since query is completing anyway. I can think a corner case where intermediate aggregator is also working on the big scan fragment, but only scheduled to handle fewer scan ranges than other nodes. Thus, it completes faster than other executor nodes. In any case, missing filter should not impact query correctness. Just its overall performance. -- To view, visit http://gerrit.cloudera.org:8080/20612 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I11d38ed0f223d6e5b32a19ebe725af7738ee4ab0 Gerrit-Change-Number: 20612 Gerrit-PatchSet: 17 Gerrit-Owner: Riza Suminto <riza.sumi...@cloudera.com> Gerrit-Reviewer: Abhishek Rawat <ara...@cloudera.com> Gerrit-Reviewer: Csaba Ringhofer <csringho...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Kurt Deschler <kdesc...@cloudera.com> Gerrit-Reviewer: Michael Smith <michael.sm...@cloudera.com> Gerrit-Reviewer: Riza Suminto <riza.sumi...@cloudera.com> Gerrit-Comment-Date: Mon, 18 Dec 2023 19:22:42 +0000 Gerrit-HasComments: Yes
