Hi userx,

How do you start you client? You use a term IgniteClient, but it looks
like that you are using Ignite instance running in client mode. By
IgniteClient so-called "thin client" is assumed (java interface for
thin client has name "IgniteClient").

>From the thread dump I can see that DataStreamerImpl.closeEx waits for
a write lock while read lock is held by
DataStreamerImpl.acquireRemapSemaphore which is waiting for a permit
from "remap semaphore". Actually, looks like a bug. Could you provide
a reproducer?

As a workaround I can suggest configuring IgniteDataStreamer.timeout.
Another option is interrupting a thread which supplies data to a
streamer.

пн, 24 дек. 2018 г. в 18:09, userx <gagan...@gmail.com>:
>
> Hi,
>
> I am trying to write some data to IgniteCache (PersistentMode) from a
> Igniteclient to an IgniteServer. My IgniteClient is a simple java program
> which is serving some requests. As a matter of fact, the IgniteClient is
> instantiated lazily from a java program ( a server serving requests),
> connects to the cluster and stays there.
> It starts a DataStreamer and for an argument sake i have given a timeout of
> 5 minutes to stream the data. If the Streamer is not able to do so (in case
> of huge data), I purposely call ignite.close which should kill all the
> threads initiated by IgniteClient and make the DataStreamer entries Garbage
> so that GC can take care of the same and clean my java program heap. But to
> my surprise, Ignite.close is in a TIMED_WAITING stage  and the Ignite
> related threads started by IgniteClient do not get killed. Here is the
> snapshot of thread dump.
>
> "TCP Worker Pool-thread-1" #190 prio=5 os_prio=0 tid=0x00007f4d70001000
> nid=0x40d3 waiting on condition [0x00007f4d9dda3000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.GridSpinReadWriteLock.writeLock(GridSpinReadWriteLock.java:206)
>         at
> org.apache.ignite.internal.util.GridSpinBusyLock.block(GridSpinBusyLock.java:76)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1222)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1207)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.onKernalStop(DataStreamProcessor.java:155)
>         at 
> org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2101)
>         at 
> org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2049)
>         at
> org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2588)
>         - locked <0x00000004c3992740> (a
> org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance)
>         at
> org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2551)
>         at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:372)
>         at org.apache.ignite.Ignition.stop(Ignition.java:229)
>         at 
> org.apache.ignite.internal.IgniteKernal.close(IgniteKernal.java:3370)
>         at
> com.XXX.datagrid.DataGridClient.stopIgniteClient(DataGridClient.java:114)
>         at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:208)
>         at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:215)
>         at 
> com.XXX.datagrid.DataGridClient.writeToGrid(DataGridClient.java:146)
>         at
> com.XXX.calculator.components.PropertyMeasures.performIgnitePersistence(PropertyMeasures.java:1198)
>         at
> com.XXX.calculator.components.PropertyMeasures.execute(PropertyMeasures.java:251)
>         at
> com.XXX.indexfactory.pipeline.BusinessPipeline.execute(BusinessPipeline.java:225)
>         at
> com.XXX.indexfactory.pipeline.AlcyoneThread.runCalculation(AlcyoneThread.java:406)
>         at
> com.XXX.indexfactory.pipeline.AlcyoneThread.process(AlcyoneThread.java:160)
>         at
> com.XXX.calculator.XXXCalculator.executeWithResponseData(XXXCalculator.java:101)
>         at
> com.XXX.calculator.XXXCalculator.executeWithResponse(XXXCalculator.java:66)
>         at
> com.XXX.calculator.soa.server.CalculationRequestHandler.processCalculationRequest(CalculationRequestHandler.java:171)
>         at
> com.XXX.calculator.soa.server.CalculationRequestHandler.processRequest(CalculationRequestHandler.java:89)
>         at 
> com.XXX.alcyone.tcp.TCPSocketDispatcher.run(TCPSocketDispatcher.java:62)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
>
> Is there a way I can force kill the IgniteClient without killing my Java
> Program from which the IgniteClient was initiated. Complete details of
> thread dump.
>
>
>
> 2018-12-23 06:07:17
> Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.172-b11 mixed mode):
>
> "RMI TCP Connection(idle)" #138899 daemon prio=5 os_prio=0
> tid=0x00007f4db0008800 nid=0x60dc waiting on condition [0x00007f4cfddde000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c0763450> (a
> java.util.concurrent.SynchronousQueue$TransferStack)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>         at 
> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "RMI TCP Connection(idle)" #138898 daemon prio=5 os_prio=0
> tid=0x00007f4db0001000 nid=0x60db waiting on condition [0x00007f4e0c434000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c0763450> (a
> java.util.concurrent.SynchronousQueue$TransferStack)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>         at 
> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "RMI TCP Connection(idle)" #138897 daemon prio=5 os_prio=0
> tid=0x00007f4db0002000 nid=0x60da waiting on condition [0x00007f4cfebec000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c0763450> (a
> java.util.concurrent.SynchronousQueue$TransferStack)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>         at 
> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "RMI TCP Connection(idle)" #138896 daemon prio=5 os_prio=0
> tid=0x00007f4db0007800 nid=0x60d9 waiting on condition [0x00007f4d9c796000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c0763450> (a
> java.util.concurrent.SynchronousQueue$TransferStack)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
>         at
> java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
>         at 
> java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "Attach Listener" #138891 daemon prio=9 os_prio=0 tid=0x00007f4dfc001000
> nid=0x6042 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "pool-55917-thread-1" #136431 prio=5 os_prio=0 tid=0x00007f4d6c239000
> nid=0x273e waiting on condition [0x00007f4d9c695000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c4fdaf28> (a
> java.util.concurrent.Semaphore$NonfairSync)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
>         at java.util.concurrent.Semaphore.acquire(Semaphore.java:467)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.acquireRemapSemaphore(DataStreamerImpl.java:700)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.load0(DataStreamerImpl.java:741)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.addDataInternal(DataStreamerImpl.java:641)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.addData(DataStreamerImpl.java:677)
>         at
> com.XXX.datagrid.DataGridClient$Writer.lambda$call$0(DataGridClient.java:332)
>         at
> com.XXX.datagrid.DataGridClient$Writer$$Lambda$95/39445546.accept(Unknown
> Source)
>         at
> java.util.concurrent.ConcurrentHashMap.forEach(ConcurrentHashMap.java:1597)
>         at 
> com.XXX.datagrid.DataGridClient$Writer.call(DataGridClient.java:332)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-#337%0f279436-b4c0-466e-936c-98bc8e057c4d%" #136408 daemon prio=5
> os_prio=0 tid=0x00007f4c7c001000 nid=0x83a waiting on condition
> [0x00007f4cff7f6000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:177)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:140)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.load0(DataStreamerImpl.java:771)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.access$1200(DataStreamerImpl.java:127)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5$1.run(DataStreamerImpl.java:894)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5$2.call(DataStreamerImpl.java:921)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5$2.call(DataStreamerImpl.java:909)
>         at
> org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6695)
>         at
> org.apache.ignite.internal.processors.closure.GridClosureProcessor$2.body(GridClosureProcessor.java:967)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "pool-55916-thread-1" #136396 prio=5 os_prio=0 tid=0x00007f4d6c23e800
> nid=0x5f86 waiting on condition [0x00007f4d9d09f000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004ecb41748> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "session-timeout-worker-#94%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69176
> daemon prio=5 os_prio=0 tid=0x00007f4d3877b800 nid=0x3af2 waiting on
> condition [0x00007f4d4cbd6000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.rest.GridRestProcessor$4.body(GridRestProcessor.java:476)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "exchange-worker-#97%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69185 daemon
> prio=5 os_prio=0 tid=0x00007f4d3875e000 nid=0x3aef waiting on condition
> [0x00007f4d4d2d9000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:338)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:217)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:159)
>         at
> org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:151)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2433)
>         at
> org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2299)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "ignite-update-notifier-timer" #69184 daemon prio=5 os_prio=0
> tid=0x00007f4d3875c000 nid=0x3aee in Object.wait() [0x00007f4d4d3da000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000004c38aec60> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "upd-ver-checker" #69183 daemon prio=5 os_prio=0 tid=0x00007f4d3875b000
> nid=0x3aed waiting on condition [0x00007f4d4d4db000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.processors.cluster.GridUpdateNotifier$1.run(GridUpdateNotifier.java:115)
>         at java.lang.Thread.run(Thread.java:748)
>
> "disco-event-worker-#96%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69182 daemon
> prio=5 os_prio=0 tid=0x00007f4d38752000 nid=0x3aec waiting on condition
> [0x00007f4d4d5dc000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c382f618> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body0(GridDiscoveryManager.java:2758)
>         at
> org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body(GridDiscoveryManager.java:2732)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "tcp-client-disco-msg-worker-#4%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69181 daemon prio=5 os_prio=0 tid=0x00007f4d38750800 nid=0x3aea waiting on
> condition [0x00007f4d4d6dd000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c389cbc8> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
>         at
> java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
>         at
> org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1564)
>         at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
> "tcp-client-disco-sock-reader-#3%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69180 daemon prio=5 os_prio=0 tid=0x00007f4d38749800 nid=0x3ae9 in
> Object.wait() [0x00007f4d4d7de000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at
> org.apache.ignite.spi.discovery.tcp.ClientImpl$SocketReader.body(ClientImpl.java:1006)
>         - locked <0x00000004c41bc608> (a java.lang.Object)
>         at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
> "tcp-client-disco-sock-writer-#2%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69179 daemon prio=5 os_prio=0 tid=0x00007f4d38748000 nid=0x3ae8 in
> Object.wait() [0x00007f4d4d8df000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at
> org.apache.ignite.spi.discovery.tcp.ClientImpl$SocketWriter.body(ClientImpl.java:1245)
>         - locked <0x00000004c3813c10> (a java.lang.Object)
>         at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
> "TcpDiscoverySpi.timer" #69178 daemon prio=5 os_prio=0
> tid=0x00007f4d38744000 nid=0x3ae7 in Object.wait() [0x00007f4d4d9e0000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000004c382f570> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "grid-nio-worker-client-listener-3-#93%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69175 prio=5 os_prio=0 tid=0x00007f4d38714800 nid=0x3ae5 runnable
> [0x00007f4d4dde2000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c384f220> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3813c28> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38645d8> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-client-listener-2-#92%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69174 prio=5 os_prio=0 tid=0x00007f4d38713000 nid=0x3ae4 runnable
> [0x00007f4d4dee3000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386a8f8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c383af70> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38658b0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-client-listener-1-#91%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69173 prio=5 os_prio=0 tid=0x00007f4d38711000 nid=0x3ae3 runnable
> [0x00007f4d4dfe4000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386c0f8> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3826110> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3866d58> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-client-listener-0-#90%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69172 prio=5 os_prio=0 tid=0x00007f4d38691800 nid=0x3ae2 runnable
> [0x00007f4d4e0e5000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c381fc90> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c382f5a0> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38685d0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "nio-acceptor-#89%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69171 daemon
> prio=5 os_prio=0 tid=0x00007f4d38690000 nid=0x3ae1 runnable
> [0x00007f4d4e1e6000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c385bd90> (a sun.nio.ch.Util$3)
>         - locked <0x00000004c385bd78> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c387f688> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "tcp-comm-worker-#1%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69170 daemon
> prio=5 os_prio=0 tid=0x00007f4d38497800 nid=0x3adc waiting on condition
> [0x00007f4d4e6e7000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c3813c40> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
>         at
> org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.body(TcpCommunicationSpi.java:4207)
>         at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)
>
> "grid-nio-worker-tcp-comm-15-#88%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69165 prio=5 os_prio=0 tid=0x00007f4d38495800 nid=0x3adb runnable
> [0x00007f4d4e7e8000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c381fcb0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c382f5b8> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3868660> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-14-#87%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69164 prio=5 os_prio=0 tid=0x00007f4d38493800 nid=0x3ada runnable
> [0x00007f4d4e8e9000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c384f240> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3813b98> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3864668> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-13-#86%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69163 prio=5 os_prio=0 tid=0x00007f4d38491800 nid=0x3ad9 runnable
> [0x00007f4d4e9ea000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386a918> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c383af28> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3865940> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-12-#85%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69162 prio=5 os_prio=0 tid=0x00007f4d3848f800 nid=0x3ad8 runnable
> [0x00007f4d4eaeb000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386a938> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c383af40> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38659d0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-11-#84%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69161 prio=5 os_prio=0 tid=0x00007f4d3848e000 nid=0x3ad7 runnable
> [0x00007f4d4ebec000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386c118> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3826128> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3866de8> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-10-#83%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69160 prio=5 os_prio=0 tid=0x00007f4d382df800 nid=0x3ad6 runnable
> [0x00007f4d4eced000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386a958> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c383aef8> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3865a60> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-9-#82%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69159 prio=5 os_prio=0 tid=0x00007f4d382dd800 nid=0x3ad5 runnable
> [0x00007f4d4edee000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386a978> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c383af10> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3865af0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-8-#81%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69158 prio=5 os_prio=0 tid=0x00007f4d382db800 nid=0x3ad4 runnable
> [0x00007f4d4eeef000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c386c138> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3826140> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3866e78> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-7-#80%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69157 prio=5 os_prio=0 tid=0x00007f4d382d9800 nid=0x3ad3 runnable
> [0x00007f4d4eff0000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c384f260> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3813bb0> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38646f8> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-6-#79%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69156 prio=5 os_prio=0 tid=0x00007f4d382d7800 nid=0x3ad2 runnable
> [0x00007f4d4f0f1000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c384f280> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3813bc8> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3864788> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-5-#78%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69155 prio=5 os_prio=0 tid=0x00007f4d382d6000 nid=0x3ad1 runnable
> [0x00007f4d4f1f2000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c381fc30> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c382f510> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38686f0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-4-#77%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69154 prio=5 os_prio=0 tid=0x00007f4d382d4000 nid=0x3ad0 runnable
> [0x00007f4d4f2f3000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c381fc50> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c382f528> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3868780> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-3-#76%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69153 prio=5 os_prio=0 tid=0x00007f4d382d2800 nid=0x3acf runnable
> [0x00007f4d4f3f4000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c384f2a0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3813af0> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3864818> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-2-#75%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69152 prio=5 os_prio=0 tid=0x00007f4d382d1800 nid=0x3ace runnable
> [0x00007f4d4f5f6000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c381fc70> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c382f540> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3868810> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-1-#74%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69151 prio=5 os_prio=0 tid=0x00007f4d382cc000 nid=0x3acd runnable
> [0x00007f4d4f4f5000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c384f2c0> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c3813b08> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38648a8> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-nio-worker-tcp-comm-0-#73%0f279436-b4c0-466e-936c-98bc8e057c4d%"
> #69150 prio=5 os_prio=0 tid=0x00007f4d382cb800 nid=0x3acc runnable
> [0x00007f4d4f7f8000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c3826b58> (a
> org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
>         - locked <0x00000004c382f558> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c38688a0> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "nio-acceptor-#72%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69149 daemon
> prio=5 os_prio=0 tid=0x00007f4d382ce000 nid=0x3acb runnable
> [0x00007f4d4f6f7000]
>    java.lang.Thread.State: RUNNABLE
>         at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
>         at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
>         at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
>         at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
>         - locked <0x00000004c382f4c8> (a sun.nio.ch.Util$3)
>         - locked <0x00000004c382f4b0> (a 
> java.util.Collections$UnmodifiableSet)
>         - locked <0x00000004c3868930> (a sun.nio.ch.EPollSelectorImpl)
>         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
>         at
> org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "grid-timeout-worker-#71%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69148
> daemon prio=5 os_prio=0 tid=0x00007f4d382af800 nid=0x3abd in Object.wait()
> [0x00007f4d4f8f9000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at
> org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:203)
>         - locked <0x00000004c3813b20> (a java.lang.Object)
>         at
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
>         at java.lang.Thread.run(Thread.java:748)
>
> "ignite-clock" #69147 daemon prio=10 os_prio=0 tid=0x00007f4d382a4800
> nid=0x3abc waiting on condition [0x00007f4d4f9fa000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.IgniteUtils$22.run(IgniteUtils.java:3308)
>         at java.lang.Thread.run(Thread.java:748)
>
> "jvm-pause-detector-worker" #69140 daemon prio=5 os_prio=0
> tid=0x00007f4d381d5000 nid=0x3ab5 waiting on condition [0x00007f4d544c5000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.LongJVMPauseDetector$1.run(LongJVMPauseDetector.java:90)
>
> "data-streamer-stripe-31-#64%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69139
> daemon prio=5 os_prio=0 tid=0x00007f4d38193000 nid=0x3ab4 waiting on
> condition [0x00007f4d545c6000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-30-#63%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69138
> daemon prio=5 os_prio=0 tid=0x00007f4d38191800 nid=0x3ab3 waiting on
> condition [0x00007f4d546c7000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-29-#62%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69137
> daemon prio=5 os_prio=0 tid=0x00007f4d3818f800 nid=0x3ab2 waiting on
> condition [0x00007f4d547c8000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-28-#61%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69136
> daemon prio=5 os_prio=0 tid=0x00007f4d3818d800 nid=0x3ab1 waiting on
> condition [0x00007f4d548c9000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-27-#60%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69135
> daemon prio=5 os_prio=0 tid=0x00007f4d3818b800 nid=0x3ab0 waiting on
> condition [0x00007f4d549ca000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-26-#59%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69134
> daemon prio=5 os_prio=0 tid=0x00007f4d38189800 nid=0x3aaf waiting on
> condition [0x00007f4d54acb000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-25-#58%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69133
> daemon prio=5 os_prio=0 tid=0x00007f4d38187800 nid=0x3aae waiting on
> condition [0x00007f4d54bcc000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-24-#57%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69132
> daemon prio=5 os_prio=0 tid=0x00007f4d38185800 nid=0x3aad waiting on
> condition [0x00007f4d54ccd000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-23-#56%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69131
> daemon prio=5 os_prio=0 tid=0x00007f4d38183800 nid=0x3aac waiting on
> condition [0x00007f4d54dce000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-22-#55%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69130
> daemon prio=5 os_prio=0 tid=0x00007f4d38181800 nid=0x3aab waiting on
> condition [0x00007f4d54ecf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-21-#54%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69129
> daemon prio=5 os_prio=0 tid=0x00007f4d3817f800 nid=0x3aaa waiting on
> condition [0x00007f4d54fd0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-20-#53%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69128
> daemon prio=5 os_prio=0 tid=0x00007f4d3817d800 nid=0x3aa9 waiting on
> condition [0x00007f4d550d1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-19-#52%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69127
> daemon prio=5 os_prio=0 tid=0x00007f4d3817b000 nid=0x3aa8 waiting on
> condition [0x00007f4d551d2000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-18-#51%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69126
> daemon prio=5 os_prio=0 tid=0x00007f4d38179000 nid=0x3aa7 waiting on
> condition [0x00007f4d552d3000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-17-#50%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69125
> daemon prio=5 os_prio=0 tid=0x00007f4d38177000 nid=0x3aa6 waiting on
> condition [0x00007f4d553d4000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-16-#49%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69124
> daemon prio=5 os_prio=0 tid=0x00007f4d38175000 nid=0x3aa5 waiting on
> condition [0x00007f4d554d5000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-15-#48%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69123
> daemon prio=5 os_prio=0 tid=0x00007f4d38173000 nid=0x3aa4 waiting on
> condition [0x00007f4d555d6000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-14-#47%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69122
> daemon prio=5 os_prio=0 tid=0x00007f4d38171000 nid=0x3aa3 waiting on
> condition [0x00007f4d556d7000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-13-#46%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69121
> daemon prio=5 os_prio=0 tid=0x00007f4d3816f000 nid=0x3aa2 waiting on
> condition [0x00007f4d557d8000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-12-#45%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69120
> daemon prio=5 os_prio=0 tid=0x00007f4d3816d000 nid=0x3aa1 waiting on
> condition [0x00007f4d558d9000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-11-#44%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69119
> daemon prio=5 os_prio=0 tid=0x00007f4d3816b000 nid=0x3aa0 waiting on
> condition [0x00007f4d559da000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-10-#43%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69118
> daemon prio=5 os_prio=0 tid=0x00007f4d38169000 nid=0x3a9f waiting on
> condition [0x00007f4d55adb000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-9-#42%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69117
> daemon prio=5 os_prio=0 tid=0x00007f4d38167000 nid=0x3a9e waiting on
> condition [0x00007f4d55bdc000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-8-#41%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69116
> daemon prio=5 os_prio=0 tid=0x00007f4d38165000 nid=0x3a9d waiting on
> condition [0x00007f4d55cdd000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-7-#40%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69115
> daemon prio=5 os_prio=0 tid=0x00007f4d38163800 nid=0x3a9c waiting on
> condition [0x00007f4d55dde000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-6-#39%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69114
> daemon prio=5 os_prio=0 tid=0x00007f4d38161800 nid=0x3a9b waiting on
> condition [0x00007f4d55edf000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-5-#38%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69113
> daemon prio=5 os_prio=0 tid=0x00007f4d3815f800 nid=0x3a9a waiting on
> condition [0x00007f4d55fe0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-4-#37%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69112
> daemon prio=5 os_prio=0 tid=0x00007f4d3815d800 nid=0x3a99 waiting on
> condition [0x00007f4d560e1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-3-#36%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69111
> daemon prio=5 os_prio=0 tid=0x00007f4d3815b800 nid=0x3a98 waiting on
> condition [0x00007f4d561e2000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-2-#35%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69110
> daemon prio=5 os_prio=0 tid=0x00007f4d38159800 nid=0x3a97 waiting on
> condition [0x00007f4d562e3000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-1-#34%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69109
> daemon prio=5 os_prio=0 tid=0x00007f4d38157800 nid=0x3a96 waiting on
> condition [0x00007f4d563e4000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "data-streamer-stripe-0-#33%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69108
> daemon prio=5 os_prio=0 tid=0x00007f4d38156000 nid=0x3a95 waiting on
> condition [0x00007f4d564e5000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-31-#32%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69107 daemon
> prio=5 os_prio=0 tid=0x00007f4d38153800 nid=0x3a94 waiting on condition
> [0x00007f4d565e6000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-30-#31%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69106 daemon
> prio=5 os_prio=0 tid=0x00007f4d38151800 nid=0x3a93 waiting on condition
> [0x00007f4d566e7000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-29-#30%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69105 daemon
> prio=5 os_prio=0 tid=0x00007f4d3814f800 nid=0x3a92 waiting on condition
> [0x00007f4d567e8000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-28-#29%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69104 daemon
> prio=5 os_prio=0 tid=0x00007f4d3814d800 nid=0x3a91 waiting on condition
> [0x00007f4d568e9000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-27-#28%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69103 daemon
> prio=5 os_prio=0 tid=0x00007f4d3814b000 nid=0x3a90 waiting on condition
> [0x00007f4d569ea000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-26-#27%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69102 daemon
> prio=5 os_prio=0 tid=0x00007f4d38149000 nid=0x3a8f waiting on condition
> [0x00007f4d56aeb000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-25-#26%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69101 daemon
> prio=5 os_prio=0 tid=0x00007f4d38147000 nid=0x3a8e waiting on condition
> [0x00007f4d56bec000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-24-#25%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69100 daemon
> prio=5 os_prio=0 tid=0x00007f4d38145000 nid=0x3a8d waiting on condition
> [0x00007f4d56ced000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-23-#24%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69099 daemon
> prio=5 os_prio=0 tid=0x00007f4d38143800 nid=0x3a8c waiting on condition
> [0x00007f4d56dee000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-22-#23%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69098 daemon
> prio=5 os_prio=0 tid=0x00007f4d38141800 nid=0x3a8b waiting on condition
> [0x00007f4d56eef000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-21-#22%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69097 daemon
> prio=5 os_prio=0 tid=0x00007f4d3813f800 nid=0x3a8a waiting on condition
> [0x00007f4d56ff0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-20-#21%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69096 daemon
> prio=5 os_prio=0 tid=0x00007f4d3813e000 nid=0x3a89 waiting on condition
> [0x00007f4d570f1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-19-#20%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69095 daemon
> prio=5 os_prio=0 tid=0x00007f4d3813d000 nid=0x3a88 waiting on condition
> [0x00007f4d573f2000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-18-#19%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69094 daemon
> prio=5 os_prio=0 tid=0x00007f4d3813b800 nid=0x3a87 waiting on condition
> [0x00007f4d9ce9d000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-17-#18%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69093 daemon
> prio=5 os_prio=0 tid=0x00007f4d3813a000 nid=0x3a86 waiting on condition
> [0x00007f4d4fffe000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-16-#17%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69092 daemon
> prio=5 os_prio=0 tid=0x00007f4d38139000 nid=0x3a85 waiting on condition
> [0x00007f4d578f7000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-15-#16%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69091 daemon
> prio=5 os_prio=0 tid=0x00007f4d38137800 nid=0x3a84 waiting on condition
> [0x00007f4d576f5000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-14-#15%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69090 daemon
> prio=5 os_prio=0 tid=0x00007f4d38136800 nid=0x3a83 waiting on condition
> [0x00007f4d9d3a0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-13-#14%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69089 daemon
> prio=5 os_prio=0 tid=0x00007f4d38135800 nid=0x3a82 waiting on condition
> [0x00007f4d57af9000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-12-#13%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69088 daemon
> prio=5 os_prio=0 tid=0x00007f4d38134800 nid=0x3a81 waiting on condition
> [0x00007f4d574f3000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-11-#12%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69087 daemon
> prio=5 os_prio=0 tid=0x00007f4d38133000 nid=0x3a80 waiting on condition
> [0x00007f4d9c493000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-10-#11%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69086 daemon
> prio=5 os_prio=0 tid=0x00007f4d38132000 nid=0x3a7f waiting on condition
> [0x00007f4d9e4a9000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-9-#10%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69085 daemon
> prio=5 os_prio=0 tid=0x00007f4d38131000 nid=0x3a7e waiting on condition
> [0x00007f4cffefd000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-8-#9%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69084 daemon prio=5
> os_prio=0 tid=0x00007f4d38130000 nid=0x3a7d waiting on condition
> [0x00007f4d577f6000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-7-#8%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69083 daemon prio=5
> os_prio=0 tid=0x00007f4d3812f000 nid=0x3a7c waiting on condition
> [0x00007f4d579f8000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-6-#7%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69082 daemon prio=5
> os_prio=0 tid=0x00007f4d3811a800 nid=0x3a7b waiting on condition
> [0x00007f4d9ca99000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-5-#6%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69081 daemon prio=5
> os_prio=0 tid=0x00007f4d38119800 nid=0x3a7a waiting on condition
> [0x00007f4cffdfc000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-4-#5%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69080 daemon prio=5
> os_prio=0 tid=0x00007f4d38114000 nid=0x3a79 waiting on condition
> [0x00007f4d57ffe000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-3-#4%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69079 daemon prio=5
> os_prio=0 tid=0x00007f4d38117800 nid=0x3a78 waiting on condition
> [0x00007f4d9c998000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-2-#3%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69078 daemon prio=5
> os_prio=0 tid=0x00007f4d38116800 nid=0x3a77 waiting on condition
> [0x00007f4d9dba2000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-1-#2%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69077 daemon prio=5
> os_prio=0 tid=0x00007f4d38115800 nid=0x3a76 waiting on condition
> [0x00007f4d9cf9e000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "sys-stripe-0-#1%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69076 daemon prio=5
> os_prio=0 tid=0x00007f4d380ab000 nid=0x3a75 waiting on condition
> [0x00007f4d9f3b1000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
>         at
> org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
>         at
> org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
>         at java.lang.Thread.run(Thread.java:748)
>
> "TCP Worker Pool-thread-1" #190 prio=5 os_prio=0 tid=0x00007f4d70001000
> nid=0x40d3 waiting on condition [0x00007f4d9dda3000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> org.apache.ignite.internal.util.GridSpinReadWriteLock.writeLock(GridSpinReadWriteLock.java:206)
>         at
> org.apache.ignite.internal.util.GridSpinBusyLock.block(GridSpinBusyLock.java:76)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1222)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1207)
>         at
> org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.onKernalStop(DataStreamProcessor.java:155)
>         at 
> org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2101)
>         at 
> org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2049)
>         at
> org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2588)
>         - locked <0x00000004c3992740> (a
> org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance)
>         at
> org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2551)
>         at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:372)
>         at org.apache.ignite.Ignition.stop(Ignition.java:229)
>         at 
> org.apache.ignite.internal.IgniteKernal.close(IgniteKernal.java:3370)
>         at
> com.XXX.datagrid.DataGridClient.stopIgniteClient(DataGridClient.java:114)
>         at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:208)
>         at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:215)
>         at 
> com.XXX.datagrid.DataGridClient.writeToGrid(DataGridClient.java:146)
>         at
> com.XXX.calculator.components.PropertyMeasures.performIgnitePersistence(PropertyMeasures.java:1198)
>         at
> com.XXX.calculator.components.PropertyMeasures.execute(PropertyMeasures.java:251)
>         at
> com.XXX.indexfactory.pipeline.BusinessPipeline.execute(BusinessPipeline.java:225)
>         at
> com.XXX.indexfactory.pipeline.AlcyoneThread.runCalculation(AlcyoneThread.java:406)
>         at
> com.XXX.indexfactory.pipeline.AlcyoneThread.process(AlcyoneThread.java:160)
>         at
> com.XXX.calculator.XXXCalculator.executeWithResponseData(XXXCalculator.java:101)
>         at
> com.XXX.calculator.XXXCalculator.executeWithResponse(XXXCalculator.java:66)
>         at
> com.XXX.calculator.soa.server.CalculationRequestHandler.processCalculationRequest(CalculationRequestHandler.java:171)
>         at
> com.XXX.calculator.soa.server.CalculationRequestHandler.processRequest(CalculationRequestHandler.java:89)
>         at 
> com.XXX.alcyone.tcp.TCPSocketDispatcher.run(TCPSocketDispatcher.java:62)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "RMI Scheduler(0)" #44 daemon prio=5 os_prio=0 tid=0x00007f4d78007000
> nid=0x2ec0 waiting on condition [0x00007f4d9dea5000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c0000630> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
>         at
> java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "AtlasDispatcherThread" #41 prio=5 os_prio=0 tid=0x00007f4eb53e0000
> nid=0x2e6b in Object.wait() [0x00007f4d9dfa6000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at
> com.XXX.soa.server.AlcyoneRequestDispatcher.runAsDetached(AlcyoneRequestDispatcher.java:105)
>         - locked <0x00000004c1632cf8> (a java.lang.Object)
>         at
> com.XXX.soa.server.AlcyoneRequestDispatcher.run(AlcyoneRequestDispatcher.java:68)
>         at java.lang.Thread.run(Thread.java:748)
>
> "pool-4-thread-1" #40 prio=5 os_prio=0 tid=0x00007f4eb53de800 nid=0x2e6a
> runnable [0x00007f4d9e0a7000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> com.XXX.alcyone.tcp.DefaultTCPServerImpl$DispatcherRunnable.run(DefaultTCPServerImpl.java:208)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "SuspendDispatcherThread" #39 prio=5 os_prio=0 tid=0x00007f4eb539c000
> nid=0x2e66 in Object.wait() [0x00007f4d9e3a8000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000004c000ed88> (a java.lang.Object)
>         at java.lang.Object.wait(Object.java:502)
>         at
> org.apache.activemq.SimplePriorityMessageDispatchChannel.dequeue(SimplePriorityMessageDispatchChannel.java:87)
>         - locked <0x00000004c000ed88> (a java.lang.Object)
>         at
> org.apache.activemq.ActiveMQMessageConsumer.dequeue(ActiveMQMessageConsumer.java:468)
>         at
> org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:520)
>         at
> com.XXX.soa.server.AlcyoneJMSMessagingStrategy.receive(AlcyoneJMSMessagingStrategy.java:94)
>         at
> com.XXX.soa.server.AlcyoneJMSMessagingStrategy.getRequest(AlcyoneJMSMessagingStrategy.java:189)
>         at
> com.XXX.soa.server.AlcyoneRequestDispatcher.runAsAttached(AlcyoneRequestDispatcher.java:86)
>         at
> com.XXX.soa.server.AlcyoneRequestDispatcher.run(AlcyoneRequestDispatcher.java:67)
>         at java.lang.Thread.run(Thread.java:748)
>
> "SwatchThread" #37 prio=5 os_prio=0 tid=0x00007f4eb5574000 nid=0x2e58
> waiting on condition [0x00007f4d9e5aa000]
>    java.lang.Thread.State: TIMED_WAITING (sleeping)
>         at java.lang.Thread.sleep(Native Method)
>         at
> com.XXX.soa.server.AlcyoneSwatchRunnable.run(AlcyoneSwatchRunnable.java:90)
>         at java.lang.Thread.run(Thread.java:748)
>
> "InactivityMonitor WriteCheck" #36 daemon prio=10 os_prio=0
> tid=0x00007f4d88004800 nid=0x2e4c in Object.wait() [0x00007f4d9e6ab000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000004c00032a8> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "InactivityMonitor ReadCheck" #35 daemon prio=10 os_prio=0
> tid=0x00007f4d88003800 nid=0x2e4b in Object.wait() [0x00007f4d9e7ac000]
>    java.lang.Thread.State: TIMED_WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.util.TimerThread.mainLoop(Timer.java:552)
>         - locked <0x00000004c000eed8> (a java.util.TaskQueue)
>         at java.util.TimerThread.run(Timer.java:505)
>
> "ActiveMQ Transport: tcp://soa-prod/10.63.4.43:62617" #34 prio=10 os_prio=0
> tid=0x00007f4d9404a800 nid=0x2e48 runnable [0x00007f4d9e8ad000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.SocketInputStream.socketRead0(Native Method)
>         at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
>         at java.net.SocketInputStream.read(SocketInputStream.java:171)
>         at java.net.SocketInputStream.read(SocketInputStream.java:141)
>         at
> org.apache.activemq.transport.tcp.TcpBufferedInputStream.fill(TcpBufferedInputStream.java:50)
>         at
> org.apache.activemq.transport.tcp.TcpTransport$2.fill(TcpTransport.java:602)
>         at
> org.apache.activemq.transport.tcp.TcpBufferedInputStream.read(TcpBufferedInputStream.java:58)
>         at
> org.apache.activemq.transport.tcp.TcpTransport$2.read(TcpTransport.java:587)
>         at java.io.DataInputStream.readInt(DataInputStream.java:387)
>         at
> org.apache.activemq.openwire.OpenWireFormat.unmarshal(OpenWireFormat.java:275)
>         at
> org.apache.activemq.transport.tcp.TcpTransport.readCommand(TcpTransport.java:229)
>         at
> org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:221)
>         at
> org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:204)
>         at java.lang.Thread.run(Thread.java:748)
>
> "AdminThread" #33 prio=10 os_prio=0 tid=0x00007f4eb565b000 nid=0x2e3e in
> Object.wait() [0x00007f4d9edaf000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         - waiting on <0x00000004c0003320> (a java.lang.Object)
>         at java.lang.Object.wait(Object.java:502)
>         at
> org.apache.activemq.SimplePriorityMessageDispatchChannel.dequeue(SimplePriorityMessageDispatchChannel.java:87)
>         - locked <0x00000004c0003320> (a java.lang.Object)
>         at
> org.apache.activemq.ActiveMQMessageConsumer.dequeue(ActiveMQMessageConsumer.java:468)
>         at
> org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:520)
>         at
> com.XXX.soa.server.JMSMessagingStrategy.receive(JMSMessagingStrategy.java:94)
>         at
> com.XXX.soa.server.JMSMessagingStrategy.getRequest(JMSMessagingStrategy.java:166)
>         at
> com.XXX.soa.server.SOARequestDispatcher.run(SOARequestDispatcher.java:55)
>         at java.lang.Thread.run(Thread.java:748)
>
> "XXX.ALCYONE-pool1-thread-1" #32 prio=5 os_prio=0 tid=0x00007f4eb5659000
> nid=0x2e3b waiting on condition [0x00007f4d9eeb0000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c0013480> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at
> java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
>         at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
>         at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>         at java.lang.Thread.run(Thread.java:748)
>
> "Application Monitor Log Consumer" #27 daemon prio=5 os_prio=0
> tid=0x00007f4eb4fa1000 nid=0x2db3 waiting on condition [0x00007f4e0c535000]
>    java.lang.Thread.State: WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c000ef08> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
>         at
> java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
>         at com.XXX.applicationmonitor.async.LogQueue.take(LogQueue.java:49)
>         at
> com.XXX.applicationmonitor.async.LoggingActionConsumerLoop$1.next(LoggingActionConsumerLoop.java:9)
>         at
> com.XXX.applicationmonitor.async.BaseLoggingActionConsumer.processQueue(BaseLoggingActionConsumer.java:60)
>         at
> com.XXX.applicationmonitor.async.BaseLoggingActionConsumer.run(BaseLoggingActionConsumer.java:51)
>         at java.lang.Thread.run(Thread.java:748)
>
> "Log4j2-TF-1-AsyncLogger[AsyncContext@764c12b6]-1" #25 daemon prio=5
> os_prio=0 tid=0x00007f4eb4e97800 nid=0x2dab waiting on condition
> [0x00007f4e0ca51000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c000eda0> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
>         at
> com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
>         at
> com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
>         at 
> com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
>         at java.lang.Thread.run(Thread.java:748)
>
> "RMI TCP Accept-0" #24 daemon prio=5 os_prio=0 tid=0x00007f4eb4d23000
> nid=0x2d5a runnable [0x00007f4e0ce53000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:405)
>         at 
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:377)
>         at java.lang.Thread.run(Thread.java:748)
>
> "RMI TCP Accept-15138" #23 daemon prio=5 os_prio=0 tid=0x00007f4eb4cff800
> nid=0x2d50 runnable [0x00007f4e0cf54000]
>    java.lang.Thread.State: RUNNABLE
>         at java.net.PlainSocketImpl.socketAccept(Native Method)
>         at
> java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
>         at java.net.ServerSocket.implAccept(ServerSocket.java:545)
>         at java.net.ServerSocket.accept(ServerSocket.java:513)
>         at
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:405)
>         at 
> sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:377)
>         at java.lang.Thread.run(Thread.java:748)
>
> "Service Thread" #21 daemon prio=9 os_prio=0 tid=0x00007f4eb421e800
> nid=0x2cc7 runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C1 CompilerThread14" #20 daemon prio=9 os_prio=0 tid=0x00007f4eb421b800
> nid=0x2cc6 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C1 CompilerThread13" #19 daemon prio=9 os_prio=0 tid=0x00007f4eb4219000
> nid=0x2cc5 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C1 CompilerThread12" #18 daemon prio=9 os_prio=0 tid=0x00007f4eb4217000
> nid=0x2cc4 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C1 CompilerThread11" #17 daemon prio=9 os_prio=0 tid=0x00007f4eb4215000
> nid=0x2cc3 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C1 CompilerThread10" #16 daemon prio=9 os_prio=0 tid=0x00007f4eb4213000
> nid=0x2cc2 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread9" #15 daemon prio=9 os_prio=0 tid=0x00007f4eb4211000
> nid=0x2cc0 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread8" #14 daemon prio=9 os_prio=0 tid=0x00007f4eb420e000
> nid=0x2cbf waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread7" #13 daemon prio=9 os_prio=0 tid=0x00007f4eb420b800
> nid=0x2cbe waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread6" #12 daemon prio=9 os_prio=0 tid=0x00007f4eb4209800
> nid=0x2cbd waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread5" #11 daemon prio=9 os_prio=0 tid=0x00007f4eb4207800
> nid=0x2cbb waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread4" #10 daemon prio=9 os_prio=0 tid=0x00007f4eb4205000
> nid=0x2cb6 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread3" #9 daemon prio=9 os_prio=0 tid=0x00007f4eb41fb000
> nid=0x2cb4 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007f4eb41f8800
> nid=0x2cb2 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007f4eb41f6800
> nid=0x2cb1 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007f4eb41f4000
> nid=0x2cb0 waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007f4eb41f2800
> nid=0x2caf runnable [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0
> tid=0x00007f4eb41ed800 nid=0x2cad waiting on condition [0x0000000000000000]
>    java.lang.Thread.State: RUNNABLE
>
> "Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f4eb41be800 nid=0x2c87 in
> Object.wait() [0x00007f4e0f44f000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
>         - locked <0x00000004c00032d8> (a java.lang.ref.ReferenceQueue$Lock)
>         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
>         at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)
>
> "Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f4eb41bc000
> nid=0x2c7d in Object.wait() [0x00007f4e0f550000]
>    java.lang.Thread.State: WAITING (on object monitor)
>         at java.lang.Object.wait(Native Method)
>         at java.lang.Object.wait(Object.java:502)
>         at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
>         - locked <0x00000004c0014500> (a java.lang.ref.Reference$Lock)
>         at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
>
> "main" #1 prio=5 os_prio=0 tid=0x00007f4eb400b800 nid=0x2bb0 waiting on
> condition [0x00007f4eb8c3a000]
>    java.lang.Thread.State: TIMED_WAITING (parking)
>         at sun.misc.Unsafe.park(Native Method)
>         - parking to wait for  <0x00000004c000ef80> (a
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
>         at 
> java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
>         at
> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
>         at
> java.util.concurrent.ThreadPoolExecutor.awaitTermination(ThreadPoolExecutor.java:1475)
>         at
> java.util.concurrent.Executors$DelegatedExecutorService.awaitTermination(Executors.java:675)
>         at
> com.XXX.alcyone.tcp.DefaultTCPServerImpl.await(DefaultTCPServerImpl.java:133)
>         at com.XXX.indexfactory.AlcyoneServer.start(AlcyoneServer.java:274)
>         at com.XXX.indexfactory.AlcyoneServer.start(AlcyoneServer.java:173)
>         at
> com.XXX.calculator.soa.server.XXXServerCalculator.start(XXXServerCalculator.java:85)
>         at
> com.XXX.calculator.soa.server.XXXServerCalculator.main(XXXServerCalculator.java:127)
>
> "VM Thread" os_prio=0 tid=0x00007f4eb41b2000 nid=0x2c52 runnable
>
> "Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb401d000
> nid=0x2bb7 runnable
>
> "Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb401e800
> nid=0x2bb8 runnable
>
> "Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4020800
> nid=0x2bb9 runnable
>
> "Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4022800
> nid=0x2bba runnable
>
> "Gang worker#4 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4024000
> nid=0x2bbb runnable
>
> "Gang worker#5 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4026000
> nid=0x2bbc runnable
>
> "Gang worker#6 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4028000
> nid=0x2bbe runnable
>
> "Gang worker#7 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4029800
> nid=0x2bbf runnable
>
> "Gang worker#8 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb402b800
> nid=0x2bc0 runnable
>
> "Gang worker#9 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb402d000
> nid=0x2bc1 runnable
>
> "Gang worker#10 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb402f000
> nid=0x2bc2 runnable
>
> "Gang worker#11 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4031000
> nid=0x2bc3 runnable
>
> "Gang worker#12 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4032800
> nid=0x2bc4 runnable
>
> "Gang worker#13 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4034800
> nid=0x2bc5 runnable
>
> "Gang worker#14 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4036800
> nid=0x2bc6 runnable
>
> "Gang worker#15 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4038000
> nid=0x2bc7 runnable
>
> "Gang worker#16 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403a000
> nid=0x2bc8 runnable
>
> "Gang worker#17 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403c000
> nid=0x2bc9 runnable
>
> "Gang worker#18 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403d800
> nid=0x2bca runnable
>
> "Gang worker#19 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403f800
> nid=0x2bcb runnable
>
> "Gang worker#20 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4041000
> nid=0x2bcc runnable
>
> "Gang worker#21 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4043000
> nid=0x2bcd runnable
>
> "Gang worker#22 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4045000
> nid=0x2bcf runnable
>
> "Concurrent Mark-Sweep GC Thread" os_prio=0 tid=0x00007f4eb415d800
> nid=0x2c0a runnable
>
> "Gang worker#0 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4151800
> nid=0x2bfc runnable
>
> "Gang worker#1 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4153800
> nid=0x2bfe runnable
>
> "Gang worker#2 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4155800
> nid=0x2c00 runnable
>
> "Gang worker#3 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4157000
> nid=0x2c01 runnable
>
> "Gang worker#4 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4159000
> nid=0x2c03 runnable
>
> "Gang worker#5 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb415b000
> nid=0x2c05 runnable
>
> "VM Periodic Task Thread" os_prio=0 tid=0x00007f4eb4d25800 nid=0x2d5c
> waiting on condition
>
> JNI global references: 399
>
>
>
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/



-- 
Best regards,
Ivan Pavlukhin

Reply via email to