Kent Yao created SPARK-33842:
--------------------------------
Summary: Add spark.shuffle.io.sessionTimeout to check a
established connnection for being idled or dead
Key: SPARK-33842
URL: https://issues.apache.org/jira/browse/SPARK-33842
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: Kent Yao
We have spark.shuffle.io.connectionTimeout for timeout checking when shuffle
clients establish connections with shuffle servers. We also use it to check the
established connection is idled or dead too. If we want a connection that can
keep alive for a long time, we may increase the blocking time to create a
shuffle client if the server is busy at that time.
In practice, we always use connection timeout and session timeout to control
these two different phases.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
