[
https://issues.apache.org/jira/browse/SPARK-46428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tongwei updated SPARK-46428:
----------------------------
Description: In our production environment, a SQL statement containing a
Union all was executed. Due to a FetchFailed issue in Stage 24.0 of the first
Union subquery, after rerunning some stages, Stage 46.0, which was supposed to
follow the Skew Join rule, is now unable to take effect.
> The stage that retries due to FetchFailed will cause the downstream skewJoin
> AQE become ineffective
> ---------------------------------------------------------------------------------------------------
>
> Key: SPARK-46428
> URL: https://issues.apache.org/jira/browse/SPARK-46428
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.5.0
> Reporter: Tongwei
> Priority: Major
> Attachments: Stage 46.0 skewjoin apply failed.png, Stage 46.0
> skewjoin apply success.png
>
>
> In our production environment, a SQL statement containing a Union all was
> executed. Due to a FetchFailed issue in Stage 24.0 of the first Union
> subquery, after rerunning some stages, Stage 46.0, which was supposed to
> follow the Skew Join rule, is now unable to take effect.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
