[
https://issues.apache.org/jira/browse/SPARK-52323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhixingheyi-tian updated SPARK-52323:
-------------------------------------
Description:
WholeStageCodegen metric is inaccurate, often leading to misjudgments during
performance troubleshooting.
Refer to image.png, In the Stage 111877,
WholeStageCodegen (41) duration: 21652.29 h.
But, refer to image_139h.png. Total Time Across All Tasks in Stage 11877:
139.0 h.
So, WholeStageCodegen duration metric is completely wrong.
was:
WholeStageCodegen metric is inaccurate, often leading to misjudgments during
performance troubleshooting.
Refer to image.png, In the Stage 111877,
WholeStageCodegen (41) duration: 21652.29 h
> WholeStageCodeGen duration metric is not accurate
> -------------------------------------------------
>
> Key: SPARK-52323
> URL: https://issues.apache.org/jira/browse/SPARK-52323
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.5.1
> Reporter: zhixingheyi-tian
> Priority: Major
> Attachments: image.png, image_139h.png
>
>
> WholeStageCodegen metric is inaccurate, often leading to misjudgments during
> performance troubleshooting.
>
> Refer to image.png, In the Stage 111877,
> WholeStageCodegen (41) duration: 21652.29 h.
> But, refer to image_139h.png. Total Time Across All Tasks in Stage 11877:
> 139.0 h.
> So, WholeStageCodegen duration metric is completely wrong.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
