echohlne created SPARK-33132:
--------------------------------
Summary: The 'Shuffle Read Size / Records' field in Stage Summary
metrics was shown as 'NaN Undefind'
Key: SPARK-33132
URL: https://issues.apache.org/jira/browse/SPARK-33132
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 3.0.1
Reporter: echohlne
Fix For: 3.0.2
Spark Version: 3.0.1
Description: The 'Shuffle Read Size / Records' field in Stage Summary metrics
was shown as '*NaN Undefind*' when the *readBytes* value is negative, as the
attachment shows.
*curl
http:/hadoop001:18081/api/v1/applications/application_1601774913550_0225/stages/2/0/taskSummary*
{
"quantiles" : [ 0.05, 0.25, 0.5, 0.75, 0.95 ],
"executorDeserializeTime" : [ 7.0, 357.0, 390.0, 484.0, 492.0 ],
...
"shuffleReadMetrics" :
{ "*readBytes*" : [ *-2.0*, 1775984.0, 1779759.0, 1781727.0, 1788426.0 ],
"readRecords" : [ 2001.0, 2002.0, 2002.0, 2002.0, 2002.0 ], ... }
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
