Hi, Alexey, I'm getting the same error on startup with Spark 1.1.0. Everything works fine fortunately.
The error is mentioned in the logs in https://issues.apache.org/jira/browse/SPARK-4498, so maybe it will also be fixed in Spark 1.2.0 and 1.1.2. I have no insight into it unfortunately. On Tue, Dec 2, 2014 at 1:38 PM, Alexey Romanchuk <alexey.romanc...@gmail.com > wrote: > Any ideas? Anyone got the same error? > > On Mon, Dec 1, 2014 at 2:37 PM, Alexey Romanchuk < > alexey.romanc...@gmail.com> wrote: > >> Hello spark users! >> >> I found lots of strange messages in driver log. Here it is: >> >> 2014-12-01 11:54:23,849 [sparkDriver-akka.actor.default-dispatcher-25] >> ERROR >> akka.remote.EndpointWriter[akka://sparkDriver/system/endpointManager/reliableEndpointWriter-akka.tcp%3A%2F%2FsparkExecutor%40data1.hadoop%3A17372-5/endpointWriter] >> - AssociationError [akka.tcp://sparkDriver@10.54.87.173:55034] <- >> [akka.tcp://sparkExecutor@data1.hadoop:17372]: Error [Shut down address: >> akka.tcp://sparkExecutor@data1.hadoop:17372] [ >> akka.remote.ShutDownAssociation: Shut down address: >> akka.tcp://sparkExecutor@data1.hadoop:17372 >> Caused by: akka.remote.transport.Transport$InvalidAssociationException: >> The remote system terminated the association because it is shutting down. >> ] >> >> I got this message for every worker twice. First - for driverPropsFetcher >> and next for sparkExecutor. Looks like spark shutdown remote akka system >> incorrectly or there is some race condition in this process and driver sent >> some data to worker, but worker's actor system already in shutdown state. >> >> Except for this message everything works fine. But this is ERROR level >> message and I found it in my "ERROR only" log. >> >> Do you have any idea is it configuration issue, bug in spark or akka or >> something else? >> >> Thanks! >> >> >
