Eric Yang created SPARK-54533:
---------------------------------
Summary: Metric executorSource.METRIC_RESULT_SIZE is updated with
uninitialized value
Key: SPARK-54533
URL: https://issues.apache.org/jira/browse/SPARK-54533
Project: Spark
Issue Type: Bug
Components: UI
Affects Versions: 4.0.0, 4.2.0
Reporter: Eric Yang
In TaskRunner.run, the metric `executorSource.METRIC_RESULT_SIZE` is updated
with the value of `task.metrics.resultSize`, which hasn't been updated itself.
{code:java}
executorSource.METRIC_RESULT_SIZE.inc(task.metrics.resultSize) {code}
This makes this metric has zero value all the time.
It should be set to the `resultSize` which is populated later:
{code:java}
val resultSize = serializedDirectResult.size {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
