[
https://issues.apache.org/jira/browse/SPARK-31233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Huang updated SPARK-31233:
-----------------------------
Description:
Application log:
{code:java}
Failed to process batch org.apache.spark.rpc.RpcTimeoutException: Futures timed
out after [800 seconds]. This timeout is controlled by spark.network.timeout:
org.apache.spark.rpc.RpcTimeout.org
$apache$spark$rpc$RpcTimeout$$createRpcTimeoutException(RpcTimeout.scala:47)
{code}
Driver log:
{code:java}
[block-manager-ask-thread-pool-149] WARN
org.apache.spark.storage.BlockManagerMaster - Failed to remove RDD 25344 -
Cannot receive any reply from null in 800 seconds. This timeout is controlled
by spark.network.timeout org.apache.spark.rpc.RpcTimeoutException: Cannot
receive any reply from null in 800 seconds. This timeout is controlled by
spark.network.timeout{code}
The log message does not provide RpcAddress of the destination RpcEndpoint. It
is due to
{noformat}
* The `rpcAddress` may be null, in which case the endpoint is registered via a
client-only
* connection and can only be reached via the client that sent the endpoint
reference.{noformat}
Solution:
Check if 'remoteReceAddr' is null.
was:
Application log:
{code:java}
Failed to process batch org.apache.spark.rpc.RpcTimeoutException: Futures timed
out after [800 seconds]. This timeout is controlled by spark.network.timeout:
org.apache.spark.rpc.RpcTimeout.org
$apache$spark$rpc$RpcTimeout$$createRpcTimeoutException(RpcTimeout.scala:47)
{code}
Driver log:
{code:java}
[block-manager-ask-thread-pool-149] WARN
org.apache.spark.storage.BlockManagerMaster - Failed to remove RDD 25344 -
Cannot receive any reply from null in 800 seconds. This timeout is controlled
by spark.network.timeout org.apache.spark.rpc.RpcTimeoutException: Cannot
receive any reply from null in 800 seconds. This timeout is controlled by
spark.network.timeout{code}
The log message does not provide RpcAddress of the destination RpcEndpoint. It
is due to
{noformat}
* The `rpcAddress` may be null, in which case the endpoint is registered via a
client-only
* connection and can only be reached via the client that sent the endpoint
reference.{noformat}
> TimeoutException contains null remoteAddr
> -----------------------------------------
>
> Key: SPARK-31233
> URL: https://issues.apache.org/jira/browse/SPARK-31233
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.3.4
> Reporter: Yi Huang
> Priority: Minor
>
> Application log:
> {code:java}
> Failed to process batch org.apache.spark.rpc.RpcTimeoutException: Futures
> timed out after [800 seconds]. This timeout is controlled by
> spark.network.timeout:
> org.apache.spark.rpc.RpcTimeout.org
> $apache$spark$rpc$RpcTimeout$$createRpcTimeoutException(RpcTimeout.scala:47)
> {code}
> Driver log:
> {code:java}
> [block-manager-ask-thread-pool-149] WARN
> org.apache.spark.storage.BlockManagerMaster - Failed to remove RDD 25344 -
> Cannot receive any reply from null in 800 seconds. This timeout is controlled
> by spark.network.timeout org.apache.spark.rpc.RpcTimeoutException: Cannot
> receive any reply from null in 800 seconds. This timeout is controlled by
> spark.network.timeout{code}
> The log message does not provide RpcAddress of the destination RpcEndpoint.
> It is due to
> {noformat}
> * The `rpcAddress` may be null, in which case the endpoint is registered via
> a client-only
> * connection and can only be reached via the client that sent the endpoint
> reference.{noformat}
> Solution:
> Check if 'remoteReceAddr' is null.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
