my
> tasks take really long times to complete because the Scheduler Delay Time.
> I
> submit the apps through spark-submit in a YARN cluster. I was wondering if
> this Delay time takes also into account the period between an app being
> accepted by the YARN client and submitting the first
Hello:
I'm doing some instrumentation in Spark and I've realised that some of my
tasks take really long times to complete because the Scheduler Delay Time. I
submit the apps through spark-submit in a YARN cluster. I was wondering if
this Delay time takes also into account the period between
You'd need to provide information such as executor configuration (#cores,
memory size). You might have less scheduler delay with smaller, but more
numerous executors, than the contrary.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/scheduler-delay-time
