Szehon Ho created HIVE-8943:
-------------------------------
Summary: Fix memory limit check for combine nested mapjoins
Key: HIVE-8943
URL: https://issues.apache.org/jira/browse/HIVE-8943
Project: Hive
Issue Type: Bug
Components: Spark
Affects Versions: spark-branch
Reporter: Szehon Ho
Its the opposite problem of what we thought in HIVE-8701.
SparkMapJoinOptimizer actually does combine nested mapjoins into one work due
to removal of RS for big-table. So we actually need to enhance the check to
calculate if all the MapJoins in that work (spark-stage) will fit into the
memory, otherwise it might overwhelm memory for that particular spark executor.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
