[
https://issues.apache.org/jira/browse/HIVE-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vikram Dixit K updated HIVE-3996:
---------------------------------
Attachment: HIVE-3996_3.patch
Added a test case that demonstrates the issue when combining map-joins. This is
an almost exact replica of the join32.q test with the size altered but, current
code would generate the same plan as join32.q when the sum of the sizes of the
tables would exceed the size configured by noConditionalTask.size.
> Correctly enforce the memory limit on the multi-table map-join
> --------------------------------------------------------------
>
> Key: HIVE-3996
> URL: https://issues.apache.org/jira/browse/HIVE-3996
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor
> Affects Versions: 0.11.0
> Reporter: Vikram Dixit K
> Assignee: Vikram Dixit K
> Attachments: HIVE-3996_2.patch, HIVE-3996_3.patch, HIVE-3996.patch
>
>
> Currently with HIVE-3784, the joins are converted to map-joins based on
> checks of the table size against the config variable:
> hive.auto.convert.join.noconditionaltask.size.
> However, the current implementation will also merge multiple mapjoin
> operators into a single task regardless of whether the sum of the table sizes
> will exceed the configured value.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
