Tim Armstrong has uploaded a new patch set (#4). ( 
http://gerrit.cloudera.org:8080/16272 )

Change subject: IMPALA-10036: schedule unpartitioned fragments on random 
executor
......................................................................

IMPALA-10036: schedule unpartitioned fragments on random executor

Some plans have unpartitioned fragments that are not the coordinator
fragment. It would be best to avoid scheduling these on a coordinator,
both to reduce coordinator load and to allow using the coordinator
mem estimates for these queries.

Testing:
Extended the dedicated coordinator admission control test with
a query with an unpartitioned fragment. The test failed on master
with dedicated coordinator estimates.

Manually ran the repro with TPC-DS Q23, which is a more complex
query with unpartitioned fragments, and confirmed that could
run with low coordinator mem limits.

Change-Id: I1eee78f24b048968f2fdf91f0da95b78552f8d33
---
M be/src/scheduling/schedule-state.cc
M be/src/scheduling/schedule-state.h
M be/src/scheduling/scheduler-test-util.cc
M be/src/scheduling/scheduler.cc
M be/src/scheduling/scheduler.h
M tests/custom_cluster/test_admission_controller.py
6 files changed, 104 insertions(+), 45 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/16272/4
--
To view, visit http://gerrit.cloudera.org:8080/16272
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I1eee78f24b048968f2fdf91f0da95b78552f8d33
Gerrit-Change-Number: 16272
Gerrit-PatchSet: 4
Gerrit-Owner: Tim Armstrong <tarmstr...@cloudera.com>
Gerrit-Reviewer: Bikramjeet Vig <bikramjeet....@cloudera.com>

Reply via email to