[
https://issues.apache.org/jira/browse/SPARK-21872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21872.
-------------------------------
Resolution: Not A Problem
(Questions belong on the mailing list to start.)
Yes, because in general an app is frequently waiting on resources throughout
its execution, like for example waiting for executor slots to free up. This
should be counted as part of its execution time.
> Is job duration value of Spark Jobs page on Web UI correct?
> ------------------------------------------------------------
>
> Key: SPARK-21872
> URL: https://issues.apache.org/jira/browse/SPARK-21872
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.3.0
> Reporter: iamhumanbeing
> Priority: Minor
>
> I have submitted 2 spark jobs at the same time. but only one get running, the
> other is waiting for resources. but the Web UI display that both of the jobs
> is running. the job waiting for resources have the duration values increase.
> So, Job 7 only runing 14s, but duration value is 29s.
> Active Jobs (2)
> Job Id â–¾Description Submitted
> Duration Stages: Succeeded/Total Tasks (for all stages): Succeeded/Total
> 7 (kill)count at <console>:30 2017/08/30 11:33:46 7 s 0/1
> 0/100
> 6 (kill)count at <console>:30 2017/08/30 11:33:46 8 s 0/2
> 15/127 (2 running)
> after job finished
> 7 count at <console>:30 2017/08/30 11:33:46 29 s 1/1 100/100
> 6 count at <console>:30 2017/08/30 11:33:46 16 s 1/1 (1 skipped)
> 27/27 (100 skipped)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
