Re: Failed to process selector key error
Hello! I have seen this problem under heavy workloads and my recommendation will be to increase socketWriteTimeout: Regards, -- Ilya Kasnacheev ср, 17 окт. 2018 г. в 11:52, the_palakkaran : > > Hi, > > While loading data using streamer, I have the below exception. Why do i get > this error? > > From another thread, there was a hint that it causes due to network lags. > Even if this error occurs, data loading gets complete without any problem. > > [grid-nio-worker-tcp-comm-0-#25][TcpCommunicationSpi] Failed to process > selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker > [super=AbstractNioClientWorker [idx=0, bytesRcvd=276409905, > bytesSent=480474228, bytesRcvd0=13319971, bytesSent0=12535268, select=true, > super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=null, > finished=false, hashCode=510309409, interrupted=false, > runner=grid-nio-worker-tcp-comm-0-#25]]], > writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], > readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], > inRecovery=GridNioRecoveryDescriptor [acked=442016, resendCnt=0, > rcvCnt=502951, sentCnt=442032, reserved=true, lastAck=502944, > nodeLeft=false, node=TcpDiscoveryNode > [id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo, > 127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, > /127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500], > discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477, > loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false], > connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2, > pairedConnections=false], outRecovery=GridNioRecoveryDescriptor > [acked=442016, resendCnt=0, rcvCnt=502951, sentCnt=442032, reserved=true, > lastAck=502944, nodeLeft=false, node=TcpDiscoveryNode > [id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo, > 127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, > /127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500], > discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477, > loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false], > connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2, > pairedConnections=false], super=GridNioSessionImpl > [locAddr=/192.168.11.130:36356, > rmtAddr=sbstjvmlx222.suntecsbs.com/192.168.11.134:47100, > createTime=1539762655890, closeTime=0, bytesSent=478235463, > bytesRcvd=264250879, bytesSent0=12535268, bytesRcvd0=13319971, > sndSchedTime=1539762655890, lastSndTime=1539762724840, > lastRcvTime=1539762724840, readsPaused=false, > filterChain=FilterChain[filters=[GridNioCodecFilter > [parser=o.a.i.i.util.nio.GridDirectParser@b36d8a, directMode=true], > GridConnectionBytesVerifyFilter], accepted=false]]] > java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcherImpl.write0(Native Method) > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) > at sun.nio.ch.IOUtil.write(IOUtil.java:51) > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) > at > > org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite0(GridNioServer.java:1649) > at > > org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite(GridNioServer.java:1306) > at > > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2342) > at > > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2110) > at > > org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764) > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > at java.lang.Thread.run(Thread.java:748) > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >
Re: Failed to process selector key error
Hi, Your client was disconnected from the server. It could be because of different reasons: 1. Network problems on your client. 2. Very long GC pause on the server side. I guess that you face first because you note that possible you had the network problems. In this case, the server will not able to get metrics from the client node for some time and close the connection. Data streamer operation will fail in this case because the connection was closed. However, you can try to set up failure detection as it described here is related section: https://www.gridgain.com/sdk/pe/latest/javadoc/org/apache/ignite/spi/discovery/tcp/TcpDiscoverySpi.html BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Failed to process selector key error
Hi, While loading data using streamer, I have the below exception. Why do i get this error? >From another thread, there was a hint that it causes due to network lags. Even if this error occurs, data loading gets complete without any problem. [grid-nio-worker-tcp-comm-0-#25][TcpCommunicationSpi] Failed to process selector key [ses=GridSelectorNioSessionImpl [worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0, bytesRcvd=276409905, bytesSent=480474228, bytesRcvd0=13319971, bytesSent0=12535268, select=true, super=GridWorker [name=grid-nio-worker-tcp-comm-0, igniteInstanceName=null, finished=false, hashCode=510309409, interrupted=false, runner=grid-nio-worker-tcp-comm-0-#25]]], writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768], inRecovery=GridNioRecoveryDescriptor [acked=442016, resendCnt=0, rcvCnt=502951, sentCnt=442032, reserved=true, lastAck=502944, nodeLeft=false, node=TcpDiscoveryNode [id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500], discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477, loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2, pairedConnections=false], outRecovery=GridNioRecoveryDescriptor [acked=442016, resendCnt=0, rcvCnt=502951, sentCnt=442032, reserved=true, lastAck=502944, nodeLeft=false, node=TcpDiscoveryNode [id=e7651c3d-52cb-42d5-a112-7c7e346a25d0, addrs=[0:0:0:0:0:0:0:1%lo, 127.0.0.1, 192.168.11.134], sockAddrs=[/0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, sbstjvmlx222.suntecsbs.com/192.168.11.134:47500], discPort=47500, order=2, intOrder=2, lastExchangeTime=1539762572477, loc=false, ver=2.6.0#20180710-sha1:669feacc, isClient=false], connected=false, connectCnt=1, queueLimit=4096, reserveCnt=2, pairedConnections=false], super=GridNioSessionImpl [locAddr=/192.168.11.130:36356, rmtAddr=sbstjvmlx222.suntecsbs.com/192.168.11.134:47100, createTime=1539762655890, closeTime=0, bytesSent=478235463, bytesRcvd=264250879, bytesSent0=12535268, bytesRcvd0=13319971, sndSchedTime=1539762655890, lastSndTime=1539762724840, lastRcvTime=1539762724840, readsPaused=false, filterChain=FilterChain[filters=[GridNioCodecFilter [parser=o.a.i.i.util.nio.GridDirectParser@b36d8a, directMode=true], GridConnectionBytesVerifyFilter], accepted=false]]] java.io.IOException: Connection reset by peer at sun.nio.ch.FileDispatcherImpl.write0(Native Method) at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) at sun.nio.ch.IOUtil.write(IOUtil.java:51) at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:471) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite0(GridNioServer.java:1649) at org.apache.ignite.internal.util.nio.GridNioServer$DirectNioClientWorker.processWrite(GridNioServer.java:1306) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2342) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2110) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) at java.lang.Thread.run(Thread.java:748) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
