[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size
[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29689: -- Affects Version/s: (was: 3.0.0) 3.1.0 > [WEB-UI] When task failed during reading shuffle data or other failure, > enable show total shuffle read size > --- > > Key: SPARK-29689 > URL: https://issues.apache.org/jira/browse/SPARK-29689 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 3.1.0 >Reporter: feiwang >Priority: Minor > Attachments: screenshot-1.png > > > As shown in the attachment, if task failed during reading shuffle data or > because of executor loss, its shuffle read size would be shown as 0. > But this size is important for user, it can help detect data skew. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size
[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Description: As shown in the attachment, if task failed during reading shuffle data or because of executor loss, its shuffle read size would be shown as 0. But this size is important for user, it can help detect data skew. was: If task failed during reading shuffle data or because of executor loss, its shuffle read size would be shown as 0. But this size is important for user, it can help detect data skew. !screenshot-1.png! > [WEB-UI] When task failed during reading shuffle data or other failure, > enable show total shuffle read size > --- > > Key: SPARK-29689 > URL: https://issues.apache.org/jira/browse/SPARK-29689 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 2.4.4 >Reporter: feiwang >Priority: Minor > Attachments: screenshot-1.png > > > As shown in the attachment, if task failed during reading shuffle data or > because of executor loss, its shuffle read size would be shown as 0. > But this size is important for user, it can help detect data skew. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size
[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Description: If task failed during reading shuffle data or because of executor loss, its shuffle read size would be shown as 0. But this size is important for user, it can help detect data skew. !screenshot-1.png! > [WEB-UI] When task failed during reading shuffle data or other failure, > enable show total shuffle read size > --- > > Key: SPARK-29689 > URL: https://issues.apache.org/jira/browse/SPARK-29689 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 2.4.4 >Reporter: feiwang >Priority: Minor > Attachments: screenshot-1.png > > > If task failed during reading shuffle data or because of executor loss, its > shuffle read size would be shown as 0. > But this size is important for user, it can help detect data skew. > !screenshot-1.png! -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size
[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Attachment: screenshot-1.png > [WEB-UI] When task failed during reading shuffle data or other failure, > enable show total shuffle read size > --- > > Key: SPARK-29689 > URL: https://issues.apache.org/jira/browse/SPARK-29689 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 2.4.4 >Reporter: feiwang >Priority: Minor > Attachments: screenshot-1.png > > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-29689) [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size
[ https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang updated SPARK-29689: Summary: [WEB-UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size (was: [UI] When task failed during reading shuffle data or other failure, enable show total shuffle read size) > [WEB-UI] When task failed during reading shuffle data or other failure, > enable show total shuffle read size > --- > > Key: SPARK-29689 > URL: https://issues.apache.org/jira/browse/SPARK-29689 > Project: Spark > Issue Type: Improvement > Components: Web UI >Affects Versions: 2.4.4 >Reporter: feiwang >Priority: Minor > -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org