Qifan Chen has posted comments on this change. ( http://gerrit.cloudera.org:8080/18929 )
Change subject: IMPALA-11539: Mitigate intra-node skew of file scans with MT_DOP ...................................................................... Patch Set 7: Seems like a very good optimization and maybe we could also consider some other de-skewing opportunities. 1. Allow the fragments to process scan ranges residing on different disks at the same time; 2. For scan ranges from the scan disks, apply the size-based approach outlined in this patch, or a modification of it that can pick the most CPU extensive scan first. This basically asks for a CPU cost for a scan range. Not sure if such info is available these days. -- To view, visit http://gerrit.cloudera.org:8080/18929 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: Ib7dc1f1665565da6c0e155c1e585f7089b18a180 Gerrit-Change-Number: 18929 Gerrit-PatchSet: 7 Gerrit-Owner: Zoltan Borok-Nagy <borokna...@cloudera.com> Gerrit-Reviewer: Csaba Ringhofer <csringho...@cloudera.com> Gerrit-Reviewer: Gergely Fürnstáhl <gfurnst...@cloudera.com> Gerrit-Reviewer: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Gerrit-Reviewer: Joe McDonnell <joemcdonn...@cloudera.com> Gerrit-Reviewer: Qifan Chen <qc...@cloudera.com> Gerrit-Reviewer: Zoltan Borok-Nagy <borokna...@cloudera.com> Gerrit-Comment-Date: Tue, 06 Sep 2022 20:22:26 +0000 Gerrit-HasComments: No
