ResultStage cost time is your job's last stage cost time. Job 13 finished: reduce at VertexRDDImpl.scala:90, took 0.035546 s is the time your job cost
2017-08-14 18:58 GMT+08:00 Kaepke, Marc <marc.kae...@haw-hamburg.de>: > Hi everyone, > > I’m a Spark newbie and have one question: > What is the difference between the duration measures in my log/ console > output? > > 17/08/14 12:48:58 INFO DAGScheduler: ResultStage 232 (reduce at > VertexRDDImpl.scala:90) finished in 0.026 s > 17/08/14 12:48:58 INFO DAGScheduler: Job 13 finished: reduce at > VertexRDDImpl.scala:90, took 0.035546 s > > I need the total runtime of the job in ms. Or seconds with decimal > > Thanks! > > Best > Marc > > >
