Re: ArtemisMQ 2.18 ARTEMIS-3271 not fixed

Clebert Suconic Thu, 16 Sep 2021 13:08:45 -0700

It seems an IO issue to me. the load you're generating is taking more
time than the configured time on CriticalAnalyzer would allow you to
do.



you should either get a faster device (If I'm right on this), or allow
more time, or diminish your load. (getting more nodes perhaps):


The thread I see on your thread dump (that the logger will generate).

ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77)"
Id=109 WAITING on
java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@74b53a3b
at sun.misc.Unsafe.park(Native Method)
-  waiting on
java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@74b53a3b
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
at
java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943)
at org.apache.activemq.artemis.core.paging.impl.PagingStoreImpl.page
(PagingStoreImpl.java:850)
at
org.apache.activemq.artemis.core.persistence.impl.journal.AbstractJournalStorageManager.addToPage(AbstractJournalStorageManager.java:2082)
at

On Thu, Sep 16, 2021 at 3:13 PM Justin Bertram <jbert...@apache.org> wrote:
>
> > I don't have the thread dump, just the logs.
>
> The thread dump is in the logs. It's denoted by, "AMQ222199: Thread dump."
> Thanks for including it, but unfortunately it's inconclusive.
>
> Are you able to reproduce this? If so, could you provide code or steps so
> that I could also reproduce it and analyze it further?
>
>
> Justin
>
> On Thu, Sep 16, 2021 at 12:43 PM foo bar <statuario...@gmail.com> wrote:
>
> > I don't have the thread dump, just the logs.
> >
> > 2021-09-16 12:56:49,986 WARN
> >  [org.apache.activemq.artemis.utils.critical.CriticalMeasure] Component
> > org.apache.activemq.artemis.core.server.impl.QueueImpl is expired on path 2
> > 2021-09-16 12:56:49,986 INFO  [org.apache.activemq.artemis.core.server]
> > AMQ224107: The Critical Analyzer detected slow paths on the broker.  It is
> > recommended that you enable trace logs on
> > org.apache.activemq.artemis.utils.critical while you troubleshoot this
> > issue. You should disable the trace logs when you have finished
> > troubleshooting.
> > 2021-09-16 12:56:49,987 ERROR [org.apache.activemq.artemis.core.server]
> > AMQ224079: The process for the virtual machine will be killed, as component
> >
> > QueueImpl[name=$.artemis.internal.sf.broker-cluster.2e779930-fe75-11ea-b419-0050569e434b,
> > postOffice=PostOfficeImpl [server=ActiveMQServerImpl::name=broker],
> > temp=false]@5ae728cd is not responsive
> > 2021-09-16 12:56:50,507 WARN  [org.apache.activemq.artemis.core.server]
> > AMQ222199: Thread dump:
> >
> > *******************************************************************************
> > Complete Thread dump
> > "Thread-78
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=222 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-77
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=221 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-76
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=220 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-75
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=219 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-74
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=218 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-72
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=216 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-73
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=217 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-70
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=214 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-71
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=215 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-68
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=212 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-69
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=213 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-67
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=211 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-66
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=210 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-65
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=209 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-60
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=202 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-59
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=201 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-57
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=200 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-58
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=199 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-53
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=195 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-52
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=194 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-49
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=192 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-29
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=189 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-27
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=186 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-30
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=188 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-28
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=187 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-48
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=185 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-46
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=183 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-26
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=182 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-45
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=181 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-25
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=180 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-44
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=179 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-42
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=178 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-35
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=162 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-33
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=160 TIMED_WAITING on
> > java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.SynchronousQueue$TransferStack@b83459
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
> > at
> >
> > java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
> > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-32
> >
> > (ActiveMQ-IO-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$7@2c35e847
> > )"
> > Id=157 RUNNABLE
> > at sun.nio.ch.FileDispatcherImpl.force0(Native Method)
> > at sun.nio.ch.FileDispatcherImpl.force(FileDispatcherImpl.java:76)
> > at sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:388)
> > at
> >
> > org.apache.activemq.artemis.core.io.nio.NIOSequentialFile.sync(NIOSequentialFile.java:318)
> > at org.apache.activemq.artemis.core.paging.impl.Page.sync(Page.java:484)
> > at
> >
> > org.apache.activemq.artemis.core.paging.impl.PagingStoreImpl.ioSync(PagingStoreImpl.java:337)
> > at
> >
> > org.apache.activemq.artemis.core.paging.impl.PageSyncTimer.tick(PageSyncTimer.java:96)
> > at
> >
> > org.apache.activemq.artemis.core.paging.impl.PageSyncTimer.run(PageSyncTimer.java:81)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent.runForExecutor(ActiveMQScheduledComponent.java:313)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent.lambda$bookedRunForScheduler$2(ActiveMQScheduledComponent.java:320)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent$$Lambda$107/405736032.run(Unknown
> > Source)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:42)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:31)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:65)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$31/1101048445.run(Unknown
> > Source)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> > Number of locked synchronizers = 1
> > - java.util.concurrent.ThreadPoolExecutor$Worker@3997357d
> >
> >
> > "Thread-23 (activemq-netty-threads)" Id=140 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-22 (activemq-netty-threads)" Id=134 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-21 (activemq-netty-threads)" Id=122 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-20 (activemq-netty-threads)" Id=121 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-19 (activemq-netty-threads)" Id=120 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-18 (activemq-netty-threads)" Id=118 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-17 (activemq-netty-threads)" Id=116 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "DestroyJavaVM" Id=115 RUNNABLE
> >
> >
> > "Thread-16 (activemq-netty-threads)" Id=114 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-15 (activemq-netty-threads)" Id=113 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-14 (activemq-netty-threads)" Id=112 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-13 (activemq-netty-threads)" Id=111 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-24
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=110 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-23
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=109 WAITING on
> > java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@74b53a3b
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> > java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync@74b53a3b
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
> > at
> >
> > java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943)
> > at org.apache.activemq.artemis.core.paging.impl.PagingStoreImpl.page
> > (PagingStoreImpl.java:850)
> > at
> >
> > org.apache.activemq.artemis.core.persistence.impl.journal.AbstractJournalStorageManager.addToPage(AbstractJournalStorageManager.java:2082)
> > at
> >
> > org.apache.activemq.artemis.core.postoffice.impl.PostOfficeImpl.processRoute(PostOfficeImpl.java:1530)
> > at
> >
> > org.apache.activemq.artemis.core.postoffice.impl.PostOfficeImpl.route(PostOfficeImpl.java:1165)
> > at
> >
> > org.apache.activemq.artemis.core.postoffice.impl.PostOfficeImpl.route(PostOfficeImpl.java:1068)
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.doSend(ServerSessionImpl.java:2204)
> > -  locked
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl@4d8b1ca3
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.send(ServerSessionImpl.java:1839)
> > -  locked
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl@4d8b1ca3
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.send(ServerSessionImpl.java:1776)
> > -  locked
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl@4d8b1ca3
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.send(ServerSessionImpl.java:1768)
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ServerSessionImpl.send(ServerSessionImpl.java:1761)
> > at
> >
> > org.apache.activemq.artemis.core.protocol.core.ServerSessionPacketHandler.onSessionSend(ServerSessionPacketHandler.java:749)
> > at
> >
> > org.apache.activemq.artemis.core.protocol.core.ServerSessionPacketHandler.onMessagePacket(ServerSessionPacketHandler.java:281)
> > at
> >
> > org.apache.activemq.artemis.core.protocol.core.ServerSessionPacketHandler$$Lambda$186/1175147483.onMessage(Unknown
> > Source)
> > at org.apache.activemq.artemis.utils.actors.Actor.doTask(Actor.java:33)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:65)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$31/1101048445.run(Unknown
> > Source)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:42)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.OrderedExecutor.doTask(OrderedExecutor.java:31)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.ProcessorBase.executePendingTasks(ProcessorBase.java:65)
> > at
> >
> > org.apache.activemq.artemis.utils.actors.ProcessorBase$$Lambda$31/1101048445.run(Unknown
> > Source)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> > Number of locked synchronizers = 1
> > - java.util.concurrent.ThreadPoolExecutor$Worker@6ac24038
> >
> >
> > "Thread-12 (activemq-netty-threads)" Id=108 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-11 (activemq-netty-threads)" Id=104 RUNNABLE
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-10 (activemq-netty-threads)" Id=103 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-9 (activemq-netty-threads)" Id=102 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-8 (activemq-netty-threads)" Id=101 RUNNABLE
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-7 (activemq-netty-threads)" Id=100 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-6 (activemq-netty-threads)" Id=99 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-5 (activemq-netty-threads)" Id=94 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Session-HouseKeeper-1133ec6e-1" Id=93 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@356ec208
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@356ec208
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-92" Id=92 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@25954565
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@25954565
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-91" Id=91 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@25954565
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@25954565
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-90" Id=90 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@25954565
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@25954565
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:382)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:974)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1018)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-89-acceptor-0@61b918d4-ServerConnector@75e01201{HTTP/1.1,
> > (http/1.1)}{artemismq-01:8161}" Id=89 RUNNABLE (in native)
> > at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
> > at
> > sun.nio.ch
> > .ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
> > at
> > sun.nio.ch
> > .ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
> > -  locked java.lang.Object@306e3b70
> > at
> > org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:388)
> > at
> >
> > org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:702)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-88" Id=88 RUNNABLE (in native)
> > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
> > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> > -  locked sun.nio.ch.Util$3@6d57bba4
> > -  locked java.util.Collections$UnmodifiableSet@2e6a4a84
> > -  locked sun.nio.ch.EPollSelectorImpl@21db9c41
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
> > at org.eclipse.jetty.io
> > .ManagedSelector.nioSelect(ManagedSelector.java:183)
> > at org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
> > at org.eclipse.jetty.io.ManagedSelector$$Lambda$232/931911789.run(Unknown
> > Source)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-87" Id=87 RUNNABLE (in native)
> > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
> > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> > -  locked sun.nio.ch.Util$3@602f96b1
> > -  locked java.util.Collections$UnmodifiableSet@30758b8b
> > -  locked sun.nio.ch.EPollSelectorImpl@4c37c96b
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
> > at org.eclipse.jetty.io
> > .ManagedSelector.nioSelect(ManagedSelector.java:183)
> > at org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
> > at org.eclipse.jetty.io.ManagedSelector$$Lambda$232/931911789.run(Unknown
> > Source)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-86" Id=86 RUNNABLE (in native)
> > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
> > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> > -  locked sun.nio.ch.Util$3@31f37d38
> > -  locked java.util.Collections$UnmodifiableSet@2d75ffa9
> > -  locked sun.nio.ch.EPollSelectorImpl@3140005f
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
> > at org.eclipse.jetty.io
> > .ManagedSelector.nioSelect(ManagedSelector.java:183)
> > at org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
> > at org.eclipse.jetty.io.ManagedSelector$$Lambda$232/931911789.run(Unknown
> > Source)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "qtp404947798-85" Id=85 RUNNABLE (in native)
> > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
> > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
> > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
> > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
> > -  locked sun.nio.ch.Util$3@434eeb8d
> > -  locked java.util.Collections$UnmodifiableSet@69fe4461
> > -  locked sun.nio.ch.EPollSelectorImpl@6bf46640
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
> > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
> > at org.eclipse.jetty.io
> > .ManagedSelector.nioSelect(ManagedSelector.java:183)
> > at org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:190)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.select(ManagedSelector.java:606)
> > at
> > org.eclipse.jetty.io
> > .ManagedSelector$SelectorProducer.produce(ManagedSelector.java:543)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produceTask(EatWhatYouKill.java:362)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:186)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173)
> > at
> >
> > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:137)
> > at org.eclipse.jetty.io.ManagedSelector$$Lambda$232/931911789.run(Unknown
> > Source)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883)
> > at
> >
> > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > "Thread-4 (activemq-netty-threads)" Id=84 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-3 (activemq-netty-threads)" Id=83 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-2 (activemq-netty-threads)" Id=82 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-1 (activemq-netty-threads)" Id=81 RUNNABLE
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-4 (ActiveMQ-client-global-scheduled-threads)" Id=80 WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-3 (ActiveMQ-client-global-scheduled-threads)" Id=77 WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-2 (ActiveMQ-client-global-scheduled-threads)" Id=76 WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-1 (ActiveMQ-client-global-scheduled-threads)" Id=75 WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-22
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=74 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-0 (activemq-netty-threads)" Id=73 RUNNABLE
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-0 (ActiveMQ-client-global-scheduled-threads)" Id=72 TIMED_WAITING
> > on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@5a87d199
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-21
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=71 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-20
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=70 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-19
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=69 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-18
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=68 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-17
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=67 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-16
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=66 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-15
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=65 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-14
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=64 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "activemq-failure-check-thread" Id=62 TIMED_WAITING on
> > java.util.concurrent.CountDownLatch$Sync@6ea14bc7
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on java.util.concurrent.CountDownLatch$Sync@6ea14bc7
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
> > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
> > at
> >
> > org.apache.activemq.artemis.core.remoting.server.impl.RemotingServiceImpl$FailureCheckAndFlushThread.run(RemotingServiceImpl.java:784)
> >
> >
> > "Thread-13
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=61 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-12
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=60 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-11
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=59 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-10
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=58 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-9
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=57 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-8
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=56 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-7
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=55 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-6
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=54 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-5
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=53 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-4
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=52 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-3
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=51 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-2
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=50 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-23 (ActiveMQ-client-netty-threads)" Id=49 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait0(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:176)
> > at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-22 (ActiveMQ-client-netty-threads)" Id=48 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait0(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:176)
> > at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-21 (ActiveMQ-client-netty-threads)" Id=47 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait0(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:176)
> > at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-20 (ActiveMQ-client-netty-threads)" Id=46 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-19 (ActiveMQ-client-netty-threads)" Id=45 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-18 (ActiveMQ-client-netty-threads)" Id=44 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-1
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=43 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-17 (ActiveMQ-client-netty-threads)" Id=42 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-16 (ActiveMQ-client-netty-threads)" Id=41 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-15 (ActiveMQ-client-netty-threads)" Id=40 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-14 (ActiveMQ-client-netty-threads)" Id=39 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-13 (ActiveMQ-client-netty-threads)" Id=38 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-12 (ActiveMQ-client-netty-threads)" Id=37 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-4 (ActiveMQ-scheduled-threads)" Id=36 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-11 (ActiveMQ-client-netty-threads)" Id=35 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-10 (ActiveMQ-client-netty-threads)" Id=34 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-9 (ActiveMQ-client-netty-threads)" Id=33 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-8 (ActiveMQ-client-netty-threads)" Id=32 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-3 (ActiveMQ-scheduled-threads)" Id=31 WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-7 (ActiveMQ-client-netty-threads)" Id=30 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-6 (ActiveMQ-client-netty-threads)" Id=29 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-5 (ActiveMQ-client-netty-threads)" Id=28 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-4 (ActiveMQ-client-netty-threads)" Id=27 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-2 (ActiveMQ-scheduled-threads)" Id=26 WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-3 (ActiveMQ-client-netty-threads)" Id=25 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-2 (ActiveMQ-client-netty-threads)" Id=24 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-1 (ActiveMQ-scheduled-threads)" Id=21 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-0 (ActiveMQ-scheduled-threads)" Id=20 WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7567d73e
> > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-1 (ActiveMQ-client-netty-threads)" Id=19 RUNNABLE
> > at io.netty.channel.epoll.Native.epollWait(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:192)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:185)
> > at
> >
> > io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:290)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:347)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-0 (ActiveMQ-client-netty-threads)" Id=18 RUNNABLE (in native)
> > at io.netty.channel.epoll.Native.epollWait0(Native Method)
> > at io.netty.channel.epoll.Native.epollWait(Native.java:176)
> > at io.netty.channel.epoll.EpollEventLoop.epollWait(EpollEventLoop.java:281)
> > at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:351)
> > at
> >
> > io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
> > at
> > io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-0
> >
> > (ActiveMQ-server-org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$6@1da2cb77
> > )"
> > Id=17 TIMED_WAITING on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at sun.misc.Unsafe.park(Native Method)
> > -  waiting on
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@45baba2a
> > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
> > at
> >
> > java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
> > at
> > java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:112)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadPoolExecutor$ThreadPoolQueue.poll(ActiveMQThreadPoolExecutor.java:45)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> >
> > "Thread-0 (-scheduled-threads)" Id=14 RUNNABLE
> > at sun.management.ThreadImpl.dumpThreads0(Native Method)
> > at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
> > at
> >
> > org.apache.activemq.artemis.utils.ThreadDumpUtil.threadDump(ThreadDumpUtil.java:47)
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.threadDump(ActiveMQServerImpl.java:1127)
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl.lambda$initializeCriticalAnalyzer$0(ActiveMQServerImpl.java:721)
> > at
> >
> > org.apache.activemq.artemis.core.server.impl.ActiveMQServerImpl$$Lambda$29/1497018177.run(Unknown
> > Source)
> > at
> >
> > org.apache.activemq.artemis.utils.critical.CriticalAnalyzerImpl.fireActions(CriticalAnalyzerImpl.java:155)
> > at
> >
> > org.apache.activemq.artemis.utils.critical.CriticalAnalyzerImpl.check(CriticalAnalyzerImpl.java:140)
> > at
> >
> > org.apache.activemq.artemis.utils.critical.CriticalAnalyzerImpl$1.run(CriticalAnalyzerImpl.java:53)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent.runForExecutor(ActiveMQScheduledComponent.java:313)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent.bookedRunForScheduler(ActiveMQScheduledComponent.java:328)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent.runForScheduler(ActiveMQScheduledComponent.java:339)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent.lambda$start$0(ActiveMQScheduledComponent.java:166)
> > at
> >
> > org.apache.activemq.artemis.core.server.ActiveMQScheduledComponent$$Lambda$28/547201549.run(Unknown
> > Source)
> > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> > at
> >
> > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> > at
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at
> >
> > org.apache.activemq.artemis.utils.ActiveMQThreadFactory$1.run(ActiveMQThreadFactory.java:118)
> >
> > Number of locked synchronizers = 1
> > - java.util.concurrent.ThreadPoolExecutor$Worker@d5b810e
> >
> >
> > "ActiveMQ Artemis Server Shutdown Timer" Id=12 TIMED_WAITING on
> > java.util.TaskQueue@3d6979b4
> > at java.lang.Object.wait(Native Method)
> > -  waiting on java.util.TaskQueue@3d6979b4
> > at java.util.TimerThread.mainLoop(Timer.java:552)
> > at java.util.TimerThread.run(Timer.java:505)
> >
> >
> > "Signal Dispatcher" Id=5 RUNNABLE
> >
> >
> > "Finalizer" Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@59067c99
> > at java.lang.Object.wait(Native Method)
> > -  waiting on java.lang.ref.ReferenceQueue$Lock@59067c99
> > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
> > at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
> > at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
> >
> >
> > "Reference Handler" Id=2 WAITING on java.lang.ref.Reference$Lock@3d9deb0d
> > at java.lang.Object.wait(Native Method)
> > -  waiting on java.lang.ref.Reference$Lock@3d9deb0d
> > at java.lang.Object.wait(Object.java:502)
> > at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
> > at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
> >
> >
> >
> > ===============================================================================
> > End Thread dump
> >
> > *******************************************************************************
> >
> >
> >
> > On Thu, Sep 16, 2021 at 9:46 AM Justin Bertram <jbert...@apache.org>
> > wrote:
> >
> > > I think perhaps you've misunderstood the issue reported via ARTEMIS-3271
> > > [1]. The issue was that the critical analyzer [2] would sometimes report
> > > false positives. The fix eliminated the false positives, but it didn't
> > > eliminate *all* reports. You may be hitting an actual issue. In order to
> > > investigate further you need to provide the thread dump logged by the
> > > critical analyzer.
> > >
> > > For what it's worth, you can configure the critical analyzer to just log
> > > the issue and not shutdown the broker. The documentation [2] has the
> > > configuration details.
> > >
> > >
> > > Justin
> > >
> > > [1] https://issues.apache.org/jira/browse/ARTEMIS-3271
> > > [2]
> > >
> > >
> > https://activemq.apache.org/components/artemis/documentation/latest/critical-analysis.html
> > >
> > > On Thu, Sep 16, 2021 at 8:54 AM foo bar <statuario...@gmail.com> wrote:
> > >
> > > > Hello,
> > > >
> > > > We are using ArtemisMQ version 2.15. We are attempting to upgrade to
> > > 2.18.
> > > > On 2.18, we generate some load with a couple of threads. We are getting
> > > the
> > > > exact same error noted here:
> > > >
> > > > https://www.mail-archive.com/issues@activemq.apache.org/msg58016.html
> > > >
> > > > ```
> > > > [org.apache.activemq.artemis.utils.critical.CriticalMeasure] Component
> > > > org.apache.activemq.artemis.core.server.impl.QueueImpl is expired on
> > > path 0
> > > >  2021-05-15 10:00:49,258
> > > > INFO  [org.apache.activemq.artemis.core.server]
> > > > AMQ224107: The Critical Analyzer detected slow paths on the broker.  It
> > > is
> > > > recommended that you enable trace logs on
> > > > org.apache.activemq.artemis.utils.critical while you troubleshoot this
> > > > issue.
> > > > You should disable the trace logs when you have finished
> > troubleshooting.
> > > >    2021-05-15 10:00:49,258 ERROR
> > > [org.apache.activemq.artemis.core.server]
> > > > AMQ224079: The process for the virtual machine will be killed, as
> > > component
> > > > QueueImpl[name=q_7, postOffice=PostOfficeImpl
> > > >
> > > >
> > >
> > [server=ActiveMQServerImpl::serverUUID=64e3f254-b585-11eb-8f02-000f532921b8],
> > > >
> > > > temp=false]@9a33f70 is not responsive
> > > >    2021-05-15 10:00:50,429 WARN
> > > [org.apache.activemq.artemis.core.server]
> > > > AMQ222199: Thread dump:
> > > > ```
> > > >
> > > > I do see a ticket here noting that the issue has been resolved in 2.18,
> > > > although we just encountered it.
> > > >
> > > >
> > > >
> > >
> > https://issues.apache.org/jira/browse/ARTEMIS-3271?focusedWorklogId=597221&page=com.atlassian.jira.plugin.system.issuetabpanels%3Aworklog-tabpanel#worklog-597221
> > > >
> > > > Once this happens the broker is down and needs to be restarted. Is
> > there
> > > a
> > > > workaround for this?
> > > >
> > > > Thanks
> > > >
> > >
> >



-- 
Clebert Suconic

Re: ArtemisMQ 2.18 ARTEMIS-3271 not fixed

Reply via email to