[jira] [Updated] (HIVE-10175) DynamicPartitionPruning lacks a fast-path exit for large IN() queries
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Summary: DynamicPartitionPruning lacks a fast-path exit for large IN() queries (was: PartitionPruning lacks a fast-path exit for large IN() queries) > DynamicPartitionPruning lacks a fast-path exit for large IN() queries > - > > Key: HIVE-10175 > URL: https://issues.apache.org/jira/browse/HIVE-10175 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer, Tez >Affects Versions: 1.2.0 >Reporter: Gopal V >Assignee: Gopal V >Priority: Minor > Attachments: HIVE-10175.profile.html > > > TezCompiler::runDynamicPartitionPruning() & ppr.PartitionPruner() calls the > graph walker even if all tables provided to the optimizer are unpartitioned > (or temporary) tables. > This makes it extremely slow as it will walk & inspect a large/complex > FilterOperator later in the pipeline. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10175) DynamicPartitionPruning lacks a fast-path exit for large IN() queries
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Attachment: HIVE-10175.1.patch > DynamicPartitionPruning lacks a fast-path exit for large IN() queries > - > > Key: HIVE-10175 > URL: https://issues.apache.org/jira/browse/HIVE-10175 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer, Tez >Affects Versions: 1.2.0 >Reporter: Gopal V >Assignee: Gopal V >Priority: Minor > Attachments: HIVE-10175.1.patch, HIVE-10175.profile.html > > > TezCompiler::runDynamicPartitionPruning() & ppr.PartitionPruner() calls the > graph walker even if all tables provided to the optimizer are unpartitioned > (or temporary) tables. > This makes it extremely slow as it will walk & inspect a large/complex > FilterOperator later in the pipeline. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-10175) DynamicPartitionPruning lacks a fast-path exit for large IN() queries
[ https://issues.apache.org/jira/browse/HIVE-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gopal V updated HIVE-10175: --- Fix Version/s: (was: 2.0.0) (was: 1.3.0) > DynamicPartitionPruning lacks a fast-path exit for large IN() queries > - > > Key: HIVE-10175 > URL: https://issues.apache.org/jira/browse/HIVE-10175 > Project: Hive > Issue Type: Bug > Components: Physical Optimizer, Tez >Affects Versions: 1.2.0 >Reporter: Gopal V >Assignee: Gopal V >Priority: Minor > Attachments: HIVE-10175.1.patch, HIVE-10175.profile.html > > > TezCompiler::runDynamicPartitionPruning() & ppr.PartitionPruner() calls the > graph walker even if all tables provided to the optimizer are unpartitioned > (or temporary) tables. > This makes it extremely slow as it will walk & inspect a large/complex > FilterOperator later in the pipeline. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
