[ https://issues.apache.org/jira/browse/SPARK-46428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17797994#comment-17797994 ]
Tongwei commented on SPARK-46428: --------------------------------- cc [~yumwang] > The stage that retries due to FetchFailed will cause the downstream skewJoin > AQE become ineffective > --------------------------------------------------------------------------------------------------- > > Key: SPARK-46428 > URL: https://issues.apache.org/jira/browse/SPARK-46428 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.5.0 > Reporter: Tongwei > Priority: Major > Attachments: Stage 46.0 skewjoin apply failed.png, Stage 46.0 > skewjoin apply success.png > > > In our production environment, a SQL statement containing a Union all was > executed. Due to a FetchFailed issue in Stage 24.0 of the first Union > subquery, after rerunning some stages, Stage 46.0, which was supposed to > follow the Skew Join rule, is now unable to take effect. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org