Bill Farner created AURORA-117:
----------------------------------
Summary: Scheduler performance issues with very large jobs
Key: AURORA-117
URL: https://issues.apache.org/jira/browse/AURORA-117
Project: Aurora
Issue Type: Task
Components: Scheduler
Reporter: Bill Farner
The scheduler tends to have performance issues when scheduling very large jobs.
We've observed this with jobs exceeding 2000 instances. The {{TaskScheduler}}
thread tends to consume a large amount of CPU (100%, limited by the global
storage lock). Current hypothesis is that the majority of the time is spent
satisfying diversity constraints (rack, machine), which require expensive
queries.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
