[
https://issues.apache.org/jira/browse/HIVE-22074?focusedWorklogId=290072&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-290072
]
ASF GitHub Bot logged work on HIVE-22074:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 06/Aug/19 23:54
Start Date: 06/Aug/19 23:54
Worklog Time Spent: 10m
Work Description: jcamachor commented on pull request #746: HIVE-22074:
Slow compilation due to IN to OR transformation
URL: https://github.com/apache/hive/pull/746#discussion_r311318637
##########
File path:
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/RexNodeConverter.java
##########
@@ -151,13 +153,15 @@ public RexNodeConverter(RelOptCluster cluster) {
//subqueries will need outer query's row resolver
public RexNodeConverter(RelOptCluster cluster, RelDataType inpDataType,
ImmutableMap<String, Integer> outerNameToPosMap,
- ImmutableMap<String, Integer> nameToPosMap, RowResolver hiveRR,
RowResolver outerRR, int offset, boolean flattenExpr, int correlatedId) {
+ ImmutableMap<String, Integer> nameToPosMap, RowResolver hiveRR,
RowResolver outerRR,
+ HiveConf conf, int offset, boolean flattenExpr, int correlatedId) {
Review comment:
Can we pass the int value instead of the full config object?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 290072)
Time Spent: 20m (was: 10m)
> Slow compilation due to IN to OR transformation
> -----------------------------------------------
>
> Key: HIVE-22074
> URL: https://issues.apache.org/jira/browse/HIVE-22074
> Project: Hive
> Issue Type: Improvement
> Components: Logical Optimizer
> Reporter: Vineet Garg
> Assignee: Vineet Garg
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22074.1.patch, HIVE-22074.2.patch,
> HIVE-22074.3.patch, HIVE-22074.4.patch
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Currently Hive transform IN expressions to OR to apply various CBO rules.
> This incur significant performance hit if IN consist of large number of
> expressions.
> It is better to not transform IN expressions to OR in such cases because
> overall benefit of various optimizations/transformations is unrealized due to
> the compilation overhead
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
