[ https://issues.apache.org/jira/browse/SPARK-30186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuming Wang updated SPARK-30186: -------------------------------- Parent: SPARK-33828 Issue Type: Sub-task (was: Improvement) > support Dynamic Partition Pruning in Adaptive Execution > ------------------------------------------------------- > > Key: SPARK-30186 > URL: https://issues.apache.org/jira/browse/SPARK-30186 > Project: Spark > Issue Type: Sub-task > Components: SQL > Affects Versions: 3.1.0 > Reporter: Xiaoju Wu > Priority: Major > > Currently Adaptive Execution cannot work if Dynamic Partition Pruning is > applied. > private def supportAdaptive(plan: SparkPlan): Boolean = { > // TODO migrate dynamic-partition-pruning onto adaptive execution. > sanityCheck(plan) && > !plan.logicalLink.exists(_.isStreaming) && > > *!plan.expressions.exists(_.find(_.isInstanceOf[DynamicPruningSubquery]).isDefined)* > && > plan.children.forall(supportAdaptive) > } > It means we cannot benefit the performance from both AE and DPP. > This ticket is target to make DPP + AE works together. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org