Maxim Gekk created SPARK-24757:
----------------------------------

             Summary: Improve error message for broadcast timeouts
                 Key: SPARK-24757
                 URL: https://issues.apache.org/jira/browse/SPARK-24757
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.3.1
            Reporter: Maxim Gekk


Currently, the TimeoutException that is thrown on broadcast joins doesn't give 
any clues to user how to resolve the issue. Need to provide such help to users 
by pointing out two config parameters: *spark.sql.broadcastTimeout* and 
*spark.sql.autoBroadcastJoinThreshold*.

The ticket aims to handle the TimeoutException there: 
https://github.com/apache/spark/blob/b7a036b75b8a1d287ac014b85e90d555753064c9/sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/BroadcastExchangeExec.scala#L143



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to