Hi,

I am using Spark 1.6.1 on EMR running a streaming app on YARN. From the
Spark UI I see that for each batch, the *Output Op Duration* is larger
than *Job
Duration *(screenshot attached). What's the difference between these two,
is the *Job Duration* only counts the executor time of each time, but *Output
Op Duration* includes scheduler delay and other stuffs?


​
Thanks!

Renxia

Reply via email to