We are seeing multiple issues with 1.6.0 with dataStreamer and when server nodes are killed, the grid becomes unstable and unresponsive. So at this point we cannot really use 1.6
here is the thread dump for the thread you asked for and the ones I thought were relevant. I will try to get all thread dumps for you. We can try disabling shmem, but we need to be able to understand what changed suddenly. Name: shmem-communication-acceptor-#72%DataGridServer-Production% State: WAITING on java.lang.Object@7377b101 Total blocked: 1 Total waited: 5 Stack trace: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:503) org.apache.ignite.internal.util.worker.GridWorker.join(GridWorker.java:233) org.apache.ignite.internal.util.IgniteUtils.join(IgniteUtils.java:7295) org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint.close(IpcSharedMemoryServerEndpoint.java:467) org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$ShmemAcceptWorker.body(TcpCommunicationSpi.java:2905) org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) java.lang.Thread.run(Unknown Source) Name: ipc-shmem-gc-#66%DataGridServer-Production% State: RUNNABLE Total blocked: 0 Total waited: 1 Stack trace: sun.nio.ch.FileDispatcherImpl.lock0(Native Method) sun.nio.ch.FileDispatcherImpl.lock(Unknown Source) sun.nio.ch.FileChannelImpl.lock(Unknown Source) java.nio.channels.FileChannel.lock(Unknown Source) org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint$GcWorker.cleanupResources(IpcSharedMemoryServerEndpoint.java:608) org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint$GcWorker.body(IpcSharedMemoryServerEndpoint.java:563) org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) java.lang.Thread.run(Unknown Source) Name: Thread-11 State: BLOCKED on org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance@7a95f8da owned by: node-stop-thread Total blocked: 1 Total waited: 0 Stack trace: org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2178) org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2170) org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:322) org.apache.ignite.Ignition.stop(Ignition.java:224) org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$8.run(GridDiscoveryManager.java:1794) java.lang.Thread.run(Unknown Source) Name: node-stop-thread State: WAITING on java.lang.Object@7377b101 Total blocked: 19 Total waited: 22 Stack trace: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:503) org.apache.ignite.internal.util.worker.GridWorker.join(GridWorker.java:233) org.apache.ignite.internal.util.IgniteUtils.join(IgniteUtils.java:7295) org.apache.ignite.internal.util.ipc.shmem.IpcSharedMemoryServerEndpoint.close(IpcSharedMemoryServerEndpoint.java:467) org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$ShmemAcceptWorker.cancel(TcpCommunicationSpi.java:2913) org.apache.ignite.internal.util.IgniteUtils.cancel(IgniteUtils.java:4446) org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi.spiStop(TcpCommunicationSpi.java:1775) org.apache.ignite.internal.managers.GridManagerAdapter.stopSpi(GridManagerAdapter.java:279) org.apache.ignite.internal.managers.communication.GridIoManager.stop(GridIoManager.java:546) org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:1928) org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:1794) org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2207) - locked org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance@7a95f8da org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2170) org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:322) org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker$1.run(ServerImpl.java:2174) java.lang.Thread.run(Unknown Source) Name: main State: WAITING on java.lang.Object@4b38e7df Total blocked: 2 Total waited: 2,524 Stack trace: java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:503) com.tudor.datagridI.server.ServerCommon.waitForever(ServerCommon.java:24) com.tudor.datagridI.server.DataGridServerJoiner.main(DataGridServerJoiner.java:38) -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/System-exit-not-exiting-cleanly-locked-on-IgnitionEx-IgniteNamedInstance-tp5814p5893.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.
