Hi Eric, Have you checked the executor logs? It is possible they died because of some exception, and the message you see is just a side effect.
Andrew 2014-07-23 8:27 GMT-07:00 Eric Friedman <eric.d.fried...@gmail.com>: > I'm using spark 1.0.1 on a quite large cluster, with gobs of memory, etc. > Cluster resources are available to me via Yarn and I am seeing these > errors quite often. > > ERROR YarnClientClusterScheduler: Lost executor 63 on <host>: remote Akka > client disassociated > > > This is in an interactive shell session. I don't know a lot about Yarn > plumbing and am wondering if there's some constraint in play -- executors > can't be idle for too long or they get cleared out. > > > Any insights here? >
