[jira] [Updated] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks
[ https://issues.apache.org/jira/browse/SPARK-29585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29585: -- Component/s: (was: Spark Core) > Duration in stagePage does not match Duration in Summary Metrics for > Completed Tasks > > > Key: SPARK-29585 > URL: https://issues.apache.org/jira/browse/SPARK-29585 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 3.0.0 >Reporter: teeyog >Priority: Major > > Summary Metrics for Completed Tasks uses executorRunTime, and Duration in > Task details uses executorRunTime, but Duration in Completed Stages uses > {code:java} > stageData.completionTime - stageData.firstTaskLaunchedTime{code} > , which results in different results. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks
[ https://issues.apache.org/jira/browse/SPARK-29585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29585: -- Affects Version/s: (was: 2.4.4) (was: 2.3.4) 3.0.0 > Duration in stagePage does not match Duration in Summary Metrics for > Completed Tasks > > > Key: SPARK-29585 > URL: https://issues.apache.org/jira/browse/SPARK-29585 > Project: Spark > Issue Type: Improvement > Components: Spark Core, Web UI >Affects Versions: 3.0.0 >Reporter: teeyog >Priority: Major > > Summary Metrics for Completed Tasks uses executorRunTime, and Duration in > Task details uses executorRunTime, but Duration in Completed Stages uses > {code:java} > stageData.completionTime - stageData.firstTaskLaunchedTime{code} > , which results in different results. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks
[ https://issues.apache.org/jira/browse/SPARK-29585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] teeyog updated SPARK-29585: --- Description: Summary Metrics for Completed Tasks uses executorRunTime, and Duration in Task details uses executorRunTime, but Duration in Completed Stages uses {code:java} stageData.completionTime - stageData.firstTaskLaunchedTime{code} , which results in different results. was:Summary Metrics for Completed Tasks uses executorRunTime, and Duration in Task details uses executorRunTime, but Duration in Completed Stages uses stageData.completionTime - stageData.firstTaskLaunchedTime, which results in different results. > Duration in stagePage does not match Duration in Summary Metrics for > Completed Tasks > > > Key: SPARK-29585 > URL: https://issues.apache.org/jira/browse/SPARK-29585 > Project: Spark > Issue Type: Improvement > Components: Spark Core, Web UI >Affects Versions: 2.3.4, 2.4.4 >Reporter: teeyog >Priority: Major > > Summary Metrics for Completed Tasks uses executorRunTime, and Duration in > Task details uses executorRunTime, but Duration in Completed Stages uses > {code:java} > stageData.completionTime - stageData.firstTaskLaunchedTime{code} > , which results in different results. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks
[ https://issues.apache.org/jira/browse/SPARK-29585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] teeyog updated SPARK-29585: --- Description: Summary Metrics for Completed Tasks uses executorRunTime, and Duration in Task details uses executorRunTime, but Duration in Completed Stages uses stageData.completionTime - stageData.firstTaskLaunchedTime, which results in different results. (was: Summary Metrics for Completed Tasks uses ```executorRunTime```, and Duration in Task details uses ```executorRunTime```, but Duration in Completed Stages uses ```stageData.completionTime - stageData.firstTaskLaunchedTime```, which results in different results.) > Duration in stagePage does not match Duration in Summary Metrics for > Completed Tasks > > > Key: SPARK-29585 > URL: https://issues.apache.org/jira/browse/SPARK-29585 > Project: Spark > Issue Type: Improvement > Components: Spark Core, Web UI >Affects Versions: 2.3.4, 2.4.4 >Reporter: teeyog >Priority: Major > > Summary Metrics for Completed Tasks uses executorRunTime, and Duration in > Task details uses executorRunTime, but Duration in Completed Stages uses > stageData.completionTime - stageData.firstTaskLaunchedTime, which results in > different results. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org