Chao Sun created SPARK-51559:
--------------------------------
Summary: Make max broadcast table size configurable
Key: SPARK-51559
URL: https://issues.apache.org/jira/browse/SPARK-51559
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.5.5
Reporter: Chao Sun
Assignee: Chao Sun
Currently the \{{MAX_BROADCAST_TABLE_BYTES}} in {{BroadcastExchangeExec}} is
hardcoded to 8G. In certain scenarios we may want to tune/increase this so jobs
that otherwise are too expensive to shuffle can still benefit from broadcast
hash join
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
