Same feedback with spark 1.4.0 and hadoop 2.5.2.
Workload is completing tho.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/akka-remote-transport-Transport-InvalidAssociationException-The-remote-system-terminated-the-associan-tp20071p23713.html
Sent from t
utor@SparkV4:46630
Caused by: akka.remote.transport.Transport$InvalidAssociationException: The
remote system terminated the association because it is shutting down.
]
More about the setup: each VM has only 4GB RAM, running Ubuntu, using
spark-1.2.0, built for Hadoop 2.6.0 or 2.4.0. "
Executor@data1.hadoop:17372
>> Caused by: akka.remote.transport.Transport$InvalidAssociationException:
>> The remote system terminated the association because it is shutting down.
>> ]
>>
>> I got this message for every worker twice. First - for driverPropsFetcher
>>
[Shut down address:
> akka.tcp://sparkExecutor@data1.hadoop:17372] [
> akka.remote.ShutDownAssociation: Shut down address:
> akka.tcp://sparkExecutor@data1.hadoop:17372
> Caused by: akka.remote.transport.Transport$InvalidAssociationException:
> The remote system terminated the association be
oop:17372
Caused by: akka.remote.transport.Transport$InvalidAssociationException: The
remote system terminated the association because it is shutting down.
]
I got this message for every worker twice. First - for driverPropsFetcher
and next for sparkExecutor. Looks like spark shutdown remote a
