[jira] [Assigned] (SPARK-24802) Optimization Rule Exclusion
[ https://issues.apache.org/jira/browse/SPARK-24802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24802: Assignee: (was: Apache Spark) > Optimization Rule Exclusion > --- > > Key: SPARK-24802 > URL: https://issues.apache.org/jira/browse/SPARK-24802 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.3.0 >Reporter: Maryann Xue >Priority: Major > > Since Spark has provided fairly clear interfaces for adding user-defined > optimization rules, it would be nice to have an easy-to-use interface for > excluding an optimization rule from the Spark query optimizer as well. > This would make customizing Spark optimizer easier and sometimes could > debugging issues too. > # Add a new config {{spark.sql.optimizer.excludedRules}}, with the value > being a list of rule names separated by comma. > # Modify the current {{batches}} method to remove the excluded rules from > the default batches. Log the rules that have been excluded. > # Split the existing default batches into "post-analysis batches" and > "optimization batches" so that only rules in the "optimization batches" can > be excluded. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-24802) Optimization Rule Exclusion
[ https://issues.apache.org/jira/browse/SPARK-24802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24802: Assignee: Apache Spark > Optimization Rule Exclusion > --- > > Key: SPARK-24802 > URL: https://issues.apache.org/jira/browse/SPARK-24802 > Project: Spark > Issue Type: New Feature > Components: SQL >Affects Versions: 2.3.0 >Reporter: Maryann Xue >Assignee: Apache Spark >Priority: Major > > Since Spark has provided fairly clear interfaces for adding user-defined > optimization rules, it would be nice to have an easy-to-use interface for > excluding an optimization rule from the Spark query optimizer as well. > This would make customizing Spark optimizer easier and sometimes could > debugging issues too. > # Add a new config {{spark.sql.optimizer.excludedRules}}, with the value > being a list of rule names separated by comma. > # Modify the current {{batches}} method to remove the excluded rules from > the default batches. Log the rules that have been excluded. > # Split the existing default batches into "post-analysis batches" and > "optimization batches" so that only rules in the "optimization batches" can > be excluded. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org