[
https://issues.apache.org/jira/browse/SPARK-52323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17954235#comment-17954235
]
zhixingheyi-tian commented on SPARK-52323:
------------------------------------------
cc [@cloud-fan|https://github.com/cloud-fan]
[@MaxGekk|https://github.com/MaxGekk]
[@dongjoon-hyun|https://github.com/dongjoon-hyun]
Thanks.
> WholeStageCodeGen duration metric is not accurate
> -------------------------------------------------
>
> Key: SPARK-52323
> URL: https://issues.apache.org/jira/browse/SPARK-52323
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.5.1
> Reporter: zhixingheyi-tian
> Priority: Major
> Attachments: image.png, image_139h.png
>
>
> WholeStageCodegen metric is inaccurate, often leading to misjudgments during
> performance troubleshooting.
>
> Refer to image.png, In the Stage 111877,
> WholeStageCodegen (41) duration: 21652.29 h.
> But, refer to image_139h.png. Total Time Across All Tasks in Stage 11877:
> 139.0 h.
> So, WholeStageCodegen duration metric is completely wrong.
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
