[jira] [Updated] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks
[
https://issues.apache.org/jira/browse/SPARK-29585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
teeyog updated SPARK-29585:
---
Description:
Summary Metrics for Completed Tasks uses executorRunTime, and Duration in Task
details uses executorRunTime, but Duration in Completed Stages uses
{code:java}
stageData.completionTime - stageData.firstTaskLaunchedTime{code}
, which results in different results.
was:Summary Metrics for Completed Tasks uses executorRunTime, and Duration
in Task details uses executorRunTime, but Duration in Completed Stages uses
stageData.completionTime - stageData.firstTaskLaunchedTime, which results in
different results.
> Duration in stagePage does not match Duration in Summary Metrics for
> Completed Tasks
>
>
> Key: SPARK-29585
> URL: https://issues.apache.org/jira/browse/SPARK-29585
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, Web UI
>Affects Versions: 2.3.4, 2.4.4
>Reporter: teeyog
>Priority: Major
>
> Summary Metrics for Completed Tasks uses executorRunTime, and Duration in
> Task details uses executorRunTime, but Duration in Completed Stages uses
> {code:java}
> stageData.completionTime - stageData.firstTaskLaunchedTime{code}
> , which results in different results.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks
[ https://issues.apache.org/jira/browse/SPARK-29585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] teeyog updated SPARK-29585: --- Description: Summary Metrics for Completed Tasks uses executorRunTime, and Duration in Task details uses executorRunTime, but Duration in Completed Stages uses stageData.completionTime - stageData.firstTaskLaunchedTime, which results in different results. (was: Summary Metrics for Completed Tasks uses ```executorRunTime```, and Duration in Task details uses ```executorRunTime```, but Duration in Completed Stages uses ```stageData.completionTime - stageData.firstTaskLaunchedTime```, which results in different results.) > Duration in stagePage does not match Duration in Summary Metrics for > Completed Tasks > > > Key: SPARK-29585 > URL: https://issues.apache.org/jira/browse/SPARK-29585 > Project: Spark > Issue Type: Improvement > Components: Spark Core, Web UI >Affects Versions: 2.3.4, 2.4.4 >Reporter: teeyog >Priority: Major > > Summary Metrics for Completed Tasks uses executorRunTime, and Duration in > Task details uses executorRunTime, but Duration in Completed Stages uses > stageData.completionTime - stageData.firstTaskLaunchedTime, which results in > different results. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-29585) Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks
teeyog created SPARK-29585: -- Summary: Duration in stagePage does not match Duration in Summary Metrics for Completed Tasks Key: SPARK-29585 URL: https://issues.apache.org/jira/browse/SPARK-29585 Project: Spark Issue Type: Improvement Components: Spark Core, Web UI Affects Versions: 2.4.4, 2.3.4 Reporter: teeyog Summary Metrics for Completed Tasks uses ```executorRunTime```, and Duration in Task details uses ```executorRunTime```, but Duration in Completed Stages uses ```stageData.completionTime - stageData.firstTaskLaunchedTime```, which results in different results. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-28552) The URL prefix lowercase of MySQL is not necessary, but it is necessary in spark
teeyog created SPARK-28552: -- Summary: The URL prefix lowercase of MySQL is not necessary, but it is necessary in spark Key: SPARK-28552 URL: https://issues.apache.org/jira/browse/SPARK-28552 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.4.3 Reporter: teeyog The URL prefix lowercase of MySQL is not necessary, but it is necessary in spark，So we should not sensitive in spark's JDBC dialect. -- This message was sent by Atlassian JIRA (v7.6.14#76016) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
