Andrew Sherman has uploaded this change for review. ( http://gerrit.cloudera.org:8080/16613
Change subject: IMPALA-10244: Make non-scalable failures to dequeue observable. ...................................................................... IMPALA-10244: Make non-scalable failures to dequeue observable. One of the important ways to observe Impala throughput is by looking at when queries are queued. This can be an indication that more resources should be added to the cluster by adding more executor groups. This is only a good strategy if adding more resources will help with the current workload. In some situations the head of the query queue cannot be executed because of resource constraints on the coordinator. In these cases the coordinator is the bottleneck so adding more executor groups will not help. This change is to make these cases observable by adding a new counter which is incremented when a dequeue fails because of resource constraints that would not be resolved by adding more executor groups. The two cases that cause the counter to be incremented are: - when there are not enough admission control slots on the coordinator - when there is not enough memory on the coordinator but it is possible that other conditions may be added in future. TESTING: Added new unit tests. Ran all end-to-end tests. Change-Id: I3456396ac139c562ad9cd3ac1a624d8f35487518 --- M be/src/scheduling/admission-controller-test.cc M be/src/scheduling/admission-controller.cc M be/src/scheduling/admission-controller.h M common/thrift/metrics.json M tests/custom_cluster/test_admission_controller.py 5 files changed, 157 insertions(+), 53 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/13/16613/1 -- To view, visit http://gerrit.cloudera.org:8080/16613 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I3456396ac139c562ad9cd3ac1a624d8f35487518 Gerrit-Change-Number: 16613 Gerrit-PatchSet: 1 Gerrit-Owner: Andrew Sherman <asher...@cloudera.com>
