[
https://issues.apache.org/jira/browse/SPARK-29689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
feiwang updated SPARK-29689:
----------------------------
Description:
As shown in the attachment, if task failed during reading shuffle data or
because of executor loss, its shuffle read size would be shown as 0.
But this size is important for user, it can help detect data skew.
was:
If task failed during reading shuffle data or because of executor loss, its
shuffle read size would be shown as 0.
But this size is important for user, it can help detect data skew.
!screenshot-1.png!
> [WEB-UI] When task failed during reading shuffle data or other failure,
> enable show total shuffle read size
> -----------------------------------------------------------------------------------------------------------
>
> Key: SPARK-29689
> URL: https://issues.apache.org/jira/browse/SPARK-29689
> Project: Spark
> Issue Type: Improvement
> Components: Web UI
> Affects Versions: 2.4.4
> Reporter: feiwang
> Priority: Minor
> Attachments: screenshot-1.png
>
>
> As shown in the attachment, if task failed during reading shuffle data or
> because of executor loss, its shuffle read size would be shown as 0.
> But this size is important for user, it can help detect data skew.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
