Hi everyone, I’m a Spark newbie and have one question: What is the difference between the duration measures in my log/ console output?
17/08/14 12:48:58 INFO DAGScheduler: ResultStage 232 (reduce at VertexRDDImpl.scala:90) finished in 0.026 s 17/08/14 12:48:58 INFO DAGScheduler: Job 13 finished: reduce at VertexRDDImpl.scala:90, took 0.035546 s I need the total runtime of the job in ms. Or seconds with decimal Thanks! Best Marc