Hi, I am using Spark 1.6.1 on EMR running a streaming app on YARN. From the Spark UI I see that for each batch, the *Output Op Duration* is larger than *Job Duration *(screenshot attached). What's the difference between these two, is the *Job Duration* only counts the executor time of each time, but *Output Op Duration* includes scheduler delay and other stuffs?
Thanks! Renxia