Meng Zhu created MESOS-9806:
-------------------------------
Summary: Address allocator performance regression due to the
removal of quota role sorter.
Key: MESOS-9806
URL: https://issues.apache.org/jira/browse/MESOS-9806
Project: Mesos
Issue Type: Improvement
Components: allocation
Reporter: Meng Zhu
Assignee: Meng Zhu
In MESOS-9802, we removed the quota role sorter which is tech debt.
However, this slows down the allocator. The problem is that in the first stage,
even though a cluster might have no active roles with non-default quota, the
allocator will now have to sort and go through each and every role in the
cluster. Benchmark result shows that for 1k roles with 2k frameworks, the
allocator could experience ~50% performance degradation.
There are a couple of ways to address this issue. For example, we could make
the sorter aware of quota. And add a method, say `sortQuotaRoles`, to return
all the roles with non-default quota. Alternatively, an even better approach
would be to deprecate the sorter concept and just have two standalone functions
e.g. sortRoles() and sortQuotaRoles() that takes in the role tree structure
(not yet exist in the allocator) and return the sorted roles.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
