[jira] [Commented] (SPARK-30300) Update correct string in UI for metrics when driver updates same metrics id as tasks.
[ https://issues.apache.org/jira/browse/SPARK-30300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999666#comment-16999666 ] Niranjan Artal commented on SPARK-30300: Submitted PR: [https://github.com/apache/spark/pull/26941] > Update correct string in UI for metrics when driver updates same metrics id > as tasks. > - > > Key: SPARK-30300 > URL: https://issues.apache.org/jira/browse/SPARK-30300 > Project: Spark > Issue Type: Bug > Components: SQL, Web UI >Affects Versions: 3.0.0 >Reporter: Niranjan Artal >Priority: Major > > There is a bug in displaying of additional max metrics (stageID > (attemptID):task Id). > If driver is updating the same metric which was updated by tasks and if the > drivers value exceeds max, then it is not captured. Need to capture this case > and update the UI accordingly. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-30300) Update correct string in UI for metrics when driver updates same metrics id as tasks.
[ https://issues.apache.org/jira/browse/SPARK-30300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999641#comment-16999641 ] Niranjan Artal edited comment on SPARK-30300 at 12/19/19 1:56 AM: -- [~Ankitraj], Sorry I should have updated here right after filing the bug. If you haven't already started would it be okay if i fix this. I have some basic fix and currently running unit tests on it. was (Author: nartal1): [~Ankitraj], Sorry should have updated here. If you haven't already started would it be okay if i fix this. I have some basic fix and currently running unit tests on it. > Update correct string in UI for metrics when driver updates same metrics id > as tasks. > - > > Key: SPARK-30300 > URL: https://issues.apache.org/jira/browse/SPARK-30300 > Project: Spark > Issue Type: Bug > Components: SQL, Web UI >Affects Versions: 3.0.0 >Reporter: Niranjan Artal >Priority: Major > > There is a bug in displaying of additional max metrics (stageID > (attemptID):task Id). > If driver is updating the same metric which was updated by tasks and if the > drivers value exceeds max, then it is not captured. Need to capture this case > and update the UI accordingly. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Comment Edited] (SPARK-30300) Update correct string in UI for metrics when driver updates same metrics id as tasks.
[ https://issues.apache.org/jira/browse/SPARK-30300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999641#comment-16999641 ] Niranjan Artal edited comment on SPARK-30300 at 12/19/19 1:15 AM: -- [~Ankitraj], Sorry should have updated here. If you haven't already started would it be okay if i fix this. I have some basic fix and currently running unit tests on it. was (Author: nartal1): [~Ankitraj], Sorry should have updated here. If you haven't already started would it be okay if i work on this. I have some basic fix and currently running unit tests on it. > Update correct string in UI for metrics when driver updates same metrics id > as tasks. > - > > Key: SPARK-30300 > URL: https://issues.apache.org/jira/browse/SPARK-30300 > Project: Spark > Issue Type: Bug > Components: SQL, Web UI >Affects Versions: 3.0.0 >Reporter: Niranjan Artal >Priority: Major > > There is a bug in displaying of additional max metrics (stageID > (attemptID):task Id). > If driver is updating the same metric which was updated by tasks and if the > drivers value exceeds max, then it is not captured. Need to capture this case > and update the UI accordingly. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-30300) Update correct string in UI for metrics when driver updates same metrics id as tasks.
[ https://issues.apache.org/jira/browse/SPARK-30300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999641#comment-16999641 ] Niranjan Artal commented on SPARK-30300: [~Ankitraj], Sorry should have updated here. If you haven't already started would it be okay if i work on this. I have some basic fix and currently running unit tests on it. > Update correct string in UI for metrics when driver updates same metrics id > as tasks. > - > > Key: SPARK-30300 > URL: https://issues.apache.org/jira/browse/SPARK-30300 > Project: Spark > Issue Type: Bug > Components: SQL, Web UI >Affects Versions: 3.0.0 >Reporter: Niranjan Artal >Priority: Major > > There is a bug in displaying of additional max metrics (stageID > (attemptID):task Id). > If driver is updating the same metric which was updated by tasks and if the > drivers value exceeds max, then it is not captured. Need to capture this case > and update the UI accordingly. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-30300) Update correct string in UI for metrics when driver updates same metrics id as tasks.
Niranjan Artal created SPARK-30300: -- Summary: Update correct string in UI for metrics when driver updates same metrics id as tasks. Key: SPARK-30300 URL: https://issues.apache.org/jira/browse/SPARK-30300 Project: Spark Issue Type: Bug Components: SQL, Web UI Affects Versions: 3.0.0 Reporter: Niranjan Artal There is a bug in displaying of additional max metrics (stageID (attemptID):task Id). If driver is updating the same metric which was updated by tasks and if the drivers value exceeds max, then it is not captured. Need to capture this case and update the UI accordingly. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-30209) Display stageId, attemptId, taskId with SQL max metric in UI
[ https://issues.apache.org/jira/browse/SPARK-30209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993008#comment-16993008 ] Niranjan Artal commented on SPARK-30209: I am working on it. > Display stageId, attemptId, taskId with SQL max metric in UI > > > Key: SPARK-30209 > URL: https://issues.apache.org/jira/browse/SPARK-30209 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI >Affects Versions: 3.0.0 >Reporter: Niranjan Artal >Priority: Major > > It would be helpful if we could add stageId, stage attemptId and taskId for > in SQL UI for each of the max metrics values. These additional metrics help > in debugging the jobs quicker. For a given operator, it will be easy to > identify the task which is taking maximum time to complete from the Spark UI. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-30209) Display stageId, attemptId, taskId with SQL max metric in UI
[ https://issues.apache.org/jira/browse/SPARK-30209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Artal updated SPARK-30209: --- Description: It would be helpful if we could add stageId, stage attemptId and taskId for in SQL UI for each of the max metrics values. These additional metrics help in debugging the jobs quicker. For a given operator, it will be easy to identify the task which is taking maximum time to complete from the Spark UI. (was: It would be helpful if we could add stageId, stage attemptId and taskId in SQL UI. These additional metrics help in debugging the jobs quicker. For a given operator, it will be easy to identify the task which is taking maximum time to complete from the Spark UI.) > Display stageId, attemptId, taskId with SQL max metric in UI > > > Key: SPARK-30209 > URL: https://issues.apache.org/jira/browse/SPARK-30209 > Project: Spark > Issue Type: Improvement > Components: SQL, Web UI >Affects Versions: 3.0.0 >Reporter: Niranjan Artal >Priority: Major > > It would be helpful if we could add stageId, stage attemptId and taskId for > in SQL UI for each of the max metrics values. These additional metrics help > in debugging the jobs quicker. For a given operator, it will be easy to > identify the task which is taking maximum time to complete from the Spark UI. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-30209) Display stageId, attemptId, taskId with SQL max metric in UI
Niranjan Artal created SPARK-30209: -- Summary: Display stageId, attemptId, taskId with SQL max metric in UI Key: SPARK-30209 URL: https://issues.apache.org/jira/browse/SPARK-30209 Project: Spark Issue Type: Improvement Components: SQL, Web UI Affects Versions: 3.0.0 Reporter: Niranjan Artal It would be helpful if we could add stageId, stage attemptId and taskId in SQL UI. These additional metrics help in debugging the jobs quicker. For a given operator, it will be easy to identify the task which is taking maximum time to complete from the Spark UI. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
