"Scheduling Delay" is the time required to assign a task to an available resource.
if you're seeing large scheduler delays, this likely means that other jobs/tasks are using up all of the resources. here's some more info on how to setup Fair Scheduling versus the default FIFO Scheduler: https://spark.apache.org/docs/latest/job-scheduling.html of course, increasing the cluster size would help assuming resources are being allocated fairly. also, delays can vary depending on the cluster resource manager that you're using (spark standalone, yarn, mesos). -chris On Tue, Jul 8, 2014 at 4:14 AM, haopu <hw...@qilinsoft.com> wrote: > What's the meaning of a Task's "Scheduler Delay" in the web ui? > And what could cause that delay? Thanks! > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Task-s-Scheduler-Delay-in-web-ui-tp9019.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
