[
https://issues.apache.org/jira/browse/SPARK-42101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
XiDuo You updated SPARK-42101:
------------------------------
Description:
The first access to the cached plan which is enable AQE is tricky. Currently,
we can not preverse it's output partitioning and ordering.
The whole query plan also missed lots of optimization in AQE framework. Wrap
InMemoryTableScanExec to query stage can resolve all these issues.
was:
The first access to the cached plan which is enable AQE is tricky. Currently,
we can not preverse it's output partitioning and ordering.
The whole query plan also missed lots of optimization in AQE framework. Wrap
InMemoryTableScanExec + AQE to query stage can resolve all these issues.
> Wrap InMemoryTableScanExec with QueryStage
> ------------------------------------------
>
> Key: SPARK-42101
> URL: https://issues.apache.org/jira/browse/SPARK-42101
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: XiDuo You
> Priority: Major
>
> The first access to the cached plan which is enable AQE is tricky. Currently,
> we can not preverse it's output partitioning and ordering.
> The whole query plan also missed lots of optimization in AQE framework. Wrap
> InMemoryTableScanExec to query stage can resolve all these issues.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
