pulkitsQubole opened a new pull request #841: Hive 22312
URL: https://github.com/apache/hive/pull/841
 
 
   [HIVE-22312](https://issues.apache.org/jira/browse/HIVE-22312)
   In [HIVE-1792](https://issues.apache.org/jira/browse/HIVE-1792), 
MapJoinCounterHook hook was added to track joins that get converted to map 
join. This hook gets List of Tasks from hookContext and check Tag associated 
with each task. For mr, we create Conditional tasks in case of joins and add 
tags for respective join conversions. This does not work in case of tez as we 
only create TezTask(no Conditional Task is created) which can handle multiple 
joins in contrast to one Conditional Task per join in mr.
   The current approach will fail even if we add tag to TezTask as it can have 
multiple joins of the same type which will require counter.
   Here we parse query-plan after query completion which we get from 
hookContext to get workGraph. Using workGraph, we can walk through Operator 
Tree to find join conversions.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to