Re: DAGScheduler - two runtimes

2017-08-15 Thread 周康
ResultStage cost time is your job's last stage cost time. Job 13 finished: reduce at VertexRDDImpl.scala:90, took 0.035546 s is the time your job cost 2017-08-14 18:58 GMT+08:00 Kaepke, Marc : > Hi everyone, > > I’m a Spark newbie and have one question: > What is the

DAGScheduler - two runtimes

2017-08-14 Thread Kaepke, Marc
Hi everyone, I’m a Spark newbie and have one question: What is the difference between the duration measures in my log/ console output? 17/08/14 12:48:58 INFO DAGScheduler: ResultStage 232 (reduce at VertexRDDImpl.scala:90) finished in 0.026 s 17/08/14 12:48:58 INFO DAGScheduler: Job 13