Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/23088#discussion_r236228862 --- Diff: core/src/main/scala/org/apache/spark/status/AppStatusStore.scala --- @@ -150,8 +150,9 @@ private[spark] class AppStatusStore( Utils.tryWithResource( store.view(classOf[TaskDataWrapper]) .parent(stageKey) - .index(TaskIndexNames.EXEC_RUN_TIME) - .first(0L) + .index(TaskIndexNames.STATUS) + .first("SUCCESS") + .last("SUCCESS") --- End diff -- Doesn't this count all tasks between the first and last successful one, rather than count just successful ones?
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org