Balagopal Nair created SPARK-10644:
--------------------------------------
Summary: Applications wait even if free executors are available
Key: SPARK-10644
URL: https://issues.apache.org/jira/browse/SPARK-10644
Project: Spark
Issue Type: Bug
Components: Scheduler
Affects Versions: 1.5.0
Environment: RHEL 6.5 64 bit
Reporter: Balagopal Nair
Number of workers: 21
Number of executors: 63
Steps to reproduce:
1. Run 4 jobs each with max cores set to 10
2. The first 3 jobs run with 10 each. (30 executors consumed so far)
3. The 4 th job waits even though there are 33 idle executors.
The reason is that a job will not get executors unless
the total number of EXECUTORS in use < the number of WORKERS
If there are executors available, resources should be allocated to the pending
job.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
