Please take a look at the executor logs (on both sides of the IOException) to see if there are other exceptions (e.g., OOM) which precede this one. Generally, the connections should not fail spontaneously.
On Sun, Jan 25, 2015 at 10:35 PM, octavian.ganea <octavian.ga...@inf.ethz.ch > wrote: > Hi, > > I am running a program that executes map-reduce jobs in a loop. The first > time the loop runs, everything is ok. After that, it starts giving the > following error, first it gives it for one task, then for more tasks and > eventually the entire program fails: > > 15/01/26 01:41:25 WARN TaskSetManager: Lost task 10.0 in stage 15.0 (TID > 1063, hostnameXX): java.io.IOException: Connection from > hostnameXX/172.31.109.50:50808 closed > at > > org.apache.spark.network.client.TransportResponseHandler.channelUnregistered(TransportResponseHandler.java:98) > at > > org.apache.spark.network.server.TransportChannelHandler.channelUnregistered(TransportChannelHandler.java:81) > at > > io.netty.channel.AbstractChannelHandlerContext.invokeChannelUnregistered(AbstractChannelHandlerContext.java:183) > at > > io.netty.channel.AbstractChannelHandlerContext.fireChannelUnregistered(AbstractChannelHandlerContext.java:169) > at > > io.netty.channel.ChannelInboundHandlerAdapter.channelUnregistered(ChannelInboundHandlerAdapter.java:53) > at > > io.netty.channel.AbstractChannelHandlerContext.invokeChannelUnregistered(AbstractChannelHandlerContext.java:183) > at > > io.netty.channel.AbstractChannelHandlerContext.fireChannelUnregistered(AbstractChannelHandlerContext.java:169) > at > > io.netty.channel.ChannelInboundHandlerAdapter.channelUnregistered(ChannelInboundHandlerAdapter.java:53) > at > > io.netty.channel.AbstractChannelHandlerContext.invokeChannelUnregistered(AbstractChannelHandlerContext.java:183) > at > > io.netty.channel.AbstractChannelHandlerContext.fireChannelUnregistered(AbstractChannelHandlerContext.java:169) > at > > io.netty.channel.DefaultChannelPipeline.fireChannelUnregistered(DefaultChannelPipeline.java:738) > at > > io.netty.channel.AbstractChannel$AbstractUnsafe$6.run(AbstractChannel.java:606) > at > > io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:380) > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) > at > > io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:116) > at java.lang.Thread.run(Thread.java:745) > > Can someone help me with debugging this ? > > Thank you! > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Lost-task-connection-closed-tp21361.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
