Hi.
I'm having the same problem in our production environment. I'm not using multicast,
though. This is very critical for us. I'm thinking about upgrading to newer JBoss
version.... Does anyone have a fix or configuration hints?
OS:
Solaris 7
JRE for JBoss App Server:
java version "1.4.2_04"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_04-b05)
Java HotSpot(TM) Client VM (build 1.4.2_04-b05, mixed mode)
JBoss:
JBoss3.2.3. Cluster consists of 2 nodes (based on the all config) in same partition on
same Solaris box. We don't use multicast, but hardcoded initial_hosts using TCPPING in
cluster-service.xml, which I got from this forum.
When the cluster is running under high load (getting many remote requests from our
webapps and batch applications using both HA_JNDI ports), the clients are hanging and
the JBoss servers seem to not accept more incoming calls. Internal EJB-> EJB calls on
each node go to local JNDI port.
Here is my JBoss stacktrace for non-applications threads:
[java] "RMI RenewClean-[146.192.109.65:14002]" daemon prio=5 tid=0x011d4388
nid=0x2318 in Object.wait() [e9781000..e97819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
[java] - locked <0xf4740d38> (a java.lang.ref.ReferenceQueue$Lock)
[java] at
sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:500)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "RMI RenewClean-[146.192.109.65:14001]" daemon prio=5 tid=0x012480a0
nid=0x2316 in Object.wait() [e9981000..e99819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
[java] - locked <0xf4740e00> (a java.lang.ref.ReferenceQueue$Lock)
[java] at
sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:500)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Thread-51" daemon prio=5 tid=0x00b5fde0 nid=0x303 waiting on condition
[ec781000..ec7819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.SQLWrapperBase$ExternalLockThread.run(SQLWrapperBase.java:2396)
[java] "Thread-50" daemon prio=5 tid=0x00daf970 nid=0xc4 waiting on condition
[e9a81000..e9a819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.SQLWrapperBase$ExternalLockThread.run(SQLWrapperBase.java:2396)
[java] "Thread-49" daemon prio=5 tid=0x011cfda8 nid=0xc3 waiting on condition
[e9e81000..e9e819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.SQLWrapperBase$ExternalLockThread.run(SQLWrapperBase.java:2396)
[java] "RMI RenewClean-[172.31.89.1:46795]" daemon prio=5 tid=0x017030b8 nid=0x96
in Object.wait() [e9d81000..e9d819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
[java] - locked <0xf4369bd0> (a java.lang.ref.ReferenceQueue$Lock)
[java] at
sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:500)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "MERGE2.FindSubgroups thread" daemon prio=5 tid=0x01cfb448 nid=0x89
waiting on condition [e9481000..e94819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at org.jgroups.util.Util.sleep(Util.java:69)
[java] at org.jgroups.protocols.MERGE2$FindSubgroups.run(MERGE2.java:232)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "ReusableThread" daemon prio=5 tid=0x0209f558 nid=0x81 in Object.wait()
[e9b81000..e9b819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf4356620> (a org.jgroups.util.ReusableThread)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.ReusableThread.run(ReusableThread.java:176)
[java] - locked <0xf4356620> (a org.jgroups.util.ReusableThread)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Thread-48" prio=5 tid=0x002d2b78 nid=0x79 in Object.wait()
[ea481000..ea4819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf431b6f0> (a java.lang.Object)
[java] at java.lang.Object.wait(Object.java:429)
[java] at
org.jboss.system.server.ServerImpl$LifeThread.run(ServerImpl.java:772)
[java] - locked <0xf431b6f0> (a java.lang.Object)
[java] "StandardManager[/web-console]" daemon prio=5 tid=0x02067128 nid=0x78
waiting on condition [ea681000..ea6819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
org.apache.catalina.session.StandardManager.threadSleep(StandardManager.java:810)
[java] at
org.apache.catalina.session.StandardManager.run(StandardManager.java:869)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "ScannerThread" daemon prio=5 tid=0x012a53a8 nid=0x77 waiting on condition
[ec281000..ec2819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.loop(AbstractDeploymentScanner.java:218)
[java] at
org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.run(AbstractDeploymentScanner.java:191)
[java] "StandardManager[/jmx-console]" daemon prio=5 tid=0x01cfe6c8 nid=0x76
waiting on condition [ec381000..ec3819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
org.apache.catalina.session.StandardManager.threadSleep(StandardManager.java:810)
[java] at
org.apache.catalina.session.StandardManager.run(StandardManager.java:869)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Thread-47" daemon prio=5 tid=0x00d4b640 nid=0x6d waiting on condition
[ea281000..ea2819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$DBReconnectThread.run(DBoManager.java:867)
[java] "Thread-46" daemon prio=5 tid=0x01749328 nid=0x6c waiting on condition
[ea381000..ea3819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$CheckTimeoutThread.run(DBoManager.java:902)
[java] "Thread-45" daemon prio=5 tid=0x00a086e0 nid=0x67 waiting on condition
[ea881000..ea8819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$DBReconnectThread.run(DBoManager.java:867)
[java] "Thread-44" daemon prio=5 tid=0x00a08540 nid=0x66 waiting on condition
[ea981000..ea9819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$CheckTimeoutThread.run(DBoManager.java:902)
[java] "Thread-43" daemon prio=5 tid=0x00cf9be8 nid=0x65 waiting on condition
[eaa81000..eaa819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$DBReconnectThread.run(DBoManager.java:867)
[java] "Thread-42" daemon prio=5 tid=0x01677cc8 nid=0x64 waiting on condition
[eab81000..eab819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$CheckTimeoutThread.run(DBoManager.java:902)
[java] "Thread-41" daemon prio=5 tid=0x00cf9f18 nid=0x63 waiting on condition
[eac81000..eac819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$DBReconnectThread.run(DBoManager.java:867)
[java] "Thread-40" daemon prio=5 tid=0x01677580 nid=0x62 waiting on condition
[ead81000..ead819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$CheckTimeoutThread.run(DBoManager.java:902)
[java] "Thread-39" daemon prio=5 tid=0x00fd8bd0 nid=0x5f waiting on condition
[eb181000..eb1819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$DBReconnectThread.run(DBoManager.java:867)
[java] "Thread-38" daemon prio=5 tid=0x00fd8a30 nid=0x5e waiting on condition
[eb381000..eb3819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$CheckTimeoutThread.run(DBoManager.java:902)
[java] "Thread-37" daemon prio=5 tid=0x00b148e0 nid=0x5d waiting on condition
[eb481000..eb4819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$DBReconnectThread.run(DBoManager.java:867)
[java] "Thread-36" daemon prio=5 tid=0x00bb57d8 nid=0x5c waiting on condition
[eb581000..eb5819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.wrapper.sql.DBoManager$CheckTimeoutThread.run(DBoManager.java:902)
[java] "Thread-35" daemon prio=5 tid=0x01f56380 nid=0x5a waiting on condition
[ec681000..ec6819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.service.monitoring.client.InfoStorage$HouseholdThread.run(InfoStorage.java:1324)
[java] "RMI RenewClean-[172.31.89.1:14022]" daemon prio=5 tid=0x00a9fb58 nid=0x53
in Object.wait() [ef901000..ef9019f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
[java] - locked <0xf25e7748> (a java.lang.ref.ReferenceQueue$Lock)
[java] at
sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:500)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "TLCJanitorThread-34" daemon prio=5 tid=0x00abf1e0 nid=0x50 waiting on
condition [ebf81000..ebf819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
com.telenor.ibus.system.misc.TLCacheJanitor.run(TLCacheJanitor.java:119)
[java] "Thread-33" daemon prio=5 tid=0x00b41090 nid=0x4e in Object.wait()
[eb781000..eb7819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at
org.jboss.util.timeout.TimeoutFactory.doWork(TimeoutFactory.java:503)
[java] - locked <0xf2548a78> (a org.jboss.util.timeout.TimeoutFactory)
[java] at
org.jboss.util.timeout.TimeoutFactory.access$300(TimeoutFactory.java:27)
[java] at org.jboss.util.timeout.TimeoutFactory$1.run(TimeoutFactory.java:542)
[java] "Thread-32" daemon prio=5 tid=0x00aac428 nid=0x4a in Object.wait()
[ec981000..ec9819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.util.TimerThread.mainLoop(Timer.java:429)
[java] - locked <0xf24746a0> (a java.util.TaskQueue)
[java] at java.util.TimerThread.run(Timer.java:382)
[java] "HAJNDI-AutomaticDiscovery" prio=5 tid=0x007a8cd8 nid=0x49 runnable
[ec181000..ec1819f0]
[java] at java.net.PlainDatagramSocketImpl.receive(Native Method)
[java] - waiting to lock <0xf22b6be8> (a java.net.PlainDatagramSocketImpl)
[java] at java.net.DatagramSocket.receive(DatagramSocket.java:711)
[java] - locked <0xf22b6c18> (a java.net.DatagramPacket)
[java] - locked <0xf22b6c38> (a java.net.MulticastSocket)
[java] at
org.jboss.ha.jndi.HANamingService$AutomaticDiscovery.run(HANamingService.java:519)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "RMI TCP Accept-0" daemon prio=5 tid=0x00ae7fb0 nid=0x46 runnable
[ec481000..ec4819f0]
[java] at java.net.PlainSocketImpl.socketAccept(Native Method)
[java] at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
[java] - locked <0xf22b6d58> (a java.net.PlainSocketImpl)
[java] at java.net.ServerSocket.implAccept(ServerSocket.java:448)
[java] at java.net.ServerSocket.accept(ServerSocket.java:419)
[java] at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "ClusteredHTTPSessionService - CleanupDaemon" prio=5 tid=0x00ae1550
nid=0x45 in Object.wait() [ec581000..ec5819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf2295500> (a
org.jboss.ha.httpsession.server.ClusteredHTTPSessionService$CleanupDaemon)
[java] at
org.jboss.ha.httpsession.server.ClusteredHTTPSessionService$CleanupDaemon.run(ClusteredHTTPSessionService.java:455)
[java] - locked <0xf2295500> (a
org.jboss.ha.httpsession.server.ClusteredHTTPSessionService$CleanupDaemon)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "AsynchHAMembershipListener Thread" prio=5 tid=0x00a4fad8 nid=0x42 in
Object.wait() [ec881000..ec8819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf226a498> (a java.lang.Object)
[java] at java.lang.Object.wait(Object.java:429)
[java] at
EDU.oswego.cs.dl.util.concurrent.LinkedQueue.take(LinkedQueue.java:122)
[java] - locked <0xf226a498> (a java.lang.Object)
[java] at
org.jboss.ha.framework.server.HAPartitionImpl$AsynchViewChangeHandler.run(HAPartitionImpl.java:933)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "ConnectionTable.Connection.HandlerThread" daemon prio=5 tid=0x007d9200
nid=0x40 runnable [eca81000..eca819f0]
[java] at java.net.SocketInputStream.socketRead0(Native Method)
[java] at java.net.SocketInputStream.read(SocketInputStream.java:129)
[java] at java.net.SocketInputStream.read(SocketInputStream.java:182)
[java] at java.io.DataInputStream.readInt(DataInputStream.java:443)
[java] at
org.jgroups.blocks.ConnectionTable$Connection.run(ConnectionTable.java:670)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "ConnectionTable.Connection.HandlerThread" daemon prio=5 tid=0x00540738
nid=0x3f runnable [ecb81000..ecb819f0]
[java] at java.net.SocketInputStream.socketRead0(Native Method)
[java] at java.net.SocketInputStream.read(SocketInputStream.java:129)
[java] at java.net.SocketInputStream.read(SocketInputStream.java:182)
[java] at java.io.DataInputStream.readInt(DataInputStream.java:443)
[java] at
org.jgroups.blocks.ConnectionTable$Connection.run(ConnectionTable.java:670)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "ConnectionTable.AcceptorThread" daemon prio=5 tid=0x00544348 nid=0x3d
runnable [ecd81000..ecd819f0]
[java] at java.net.PlainSocketImpl.socketAccept(Native Method)
[java] at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
[java] - locked <0xf2273178> (a java.net.PlainSocketImpl)
[java] at java.net.ServerSocket.implAccept(ServerSocket.java:448)
[java] at java.net.ServerSocket.accept(ServerSocket.java:419)
[java] at org.jgroups.blocks.ConnectionTable.run(ConnectionTable.java:313)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "TimeScheduler.Thread" daemon prio=5 tid=0x005476c0 nid=0x3c runnable
[ece81000..ece819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at org.jgroups.util.TimeScheduler._run(TimeScheduler.java:323)
[java] - locked <0xf22512f8> (a org.jgroups.util.TimeScheduler$TaskQueue)
[java] at org.jgroups.util.TimeScheduler.access$000(TimeScheduler.java:45)
[java] at org.jgroups.util.TimeScheduler$Loop.run(TimeScheduler.java:117)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Scheduler main thread" daemon prio=5 tid=0x008c7698 nid=0x3b in
Object.wait() [ecf81000..ecf819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf2261050> (a java.lang.Object)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.peek(Queue.java:377)
[java] - locked <0xf2261050> (a java.lang.Object)
[java] at org.jgroups.util.Scheduler.run(Scheduler.java:64)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "UpHandler (STATE_TRANSFER)" prio=5 tid=0x008c66a0 nid=0x3a runnable
[ed081000..ed0819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2261100> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (STATE_TRANSFER)" prio=5 tid=0x008c52a8 nid=0x39 in
Object.wait() [ed181000..ed1819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2261180> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (GMS)" prio=5 tid=0x008c46b8 nid=0x38 in Object.wait()
[ed281000..ed2819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2261200> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (GMS)" prio=5 tid=0x008c3ac8 nid=0x37 in Object.wait()
[ed381000..ed3819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2268e18> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (FRAG)" prio=5 tid=0x008c2ed8 nid=0x36 in Object.wait()
[ed481000..ed4819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf22573f0> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (FRAG)" prio=5 tid=0x008c22e8 nid=0x35 in Object.wait()
[ed581000..ed5819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257418> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (UNICAST)" prio=5 tid=0x008c16f8 nid=0x34 in Object.wait()
[ed681000..ed6819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257440> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (UNICAST)" prio=5 tid=0x00ab5ff8 nid=0x33 in Object.wait()
[ed781000..ed7819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257468> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (STABLE)" prio=5 tid=0x00ab5408 nid=0x32 in Object.wait()
[ed881000..ed8819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257490> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (STABLE)" prio=5 tid=0x00ab4818 nid=0x31 in Object.wait()
[ed981000..ed9819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf22574b8> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (NAKACK)" prio=5 tid=0x00ab3c28 nid=0x30 in Object.wait()
[eda81000..eda819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf22574e0> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (NAKACK)" prio=5 tid=0x00aaeb98 nid=0x2f in Object.wait()
[edb81000..edb819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257508> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (VERIFY_SUSPECT)" prio=5 tid=0x00aadfa8 nid=0x2e in
Object.wait() [edc81000..edc819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257530> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (VERIFY_SUSPECT)" prio=5 tid=0x00a5bd70 nid=0x2d in
Object.wait() [edd81000..edd819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257558> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (FD)" prio=5 tid=0x00a5c790 nid=0x2c in Object.wait()
[ede81000..ede819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257580> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (FD)" prio=5 tid=0x00ab68c8 nid=0x2b in Object.wait()
[edf81000..edf819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf22575a8> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "UpHandler (TCPPING)" prio=5 tid=0x00ab3288 nid=0x2a in Object.wait()
[ee081000..ee0819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf22575d0> (a java.lang.Object)
[java] at org.jgroups.stack.UpHandler.run(Protocol.java:44)
[java] "DownHandler (TCPPING)" prio=5 tid=0x00ab65e0 nid=0x29 in Object.wait()
[ee181000..ee1819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf22575f8> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "DownHandler (TCP)" prio=5 tid=0x00a5c150 nid=0x28 in Object.wait()
[ee281000..ee2819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at org.jgroups.util.Queue.remove(Queue.java:217)
[java] - locked <0xf2257620> (a java.lang.Object)
[java] at org.jgroups.stack.DownHandler.run(Protocol.java:98)
[java] "SnmpPortal--1-FastReceiver" prio=5 tid=0x0073e3e8 nid=0x27 runnable
[ee381000..ee3819f0]
[java] at java.net.PlainDatagramSocketImpl.receive(Native Method)
[java] at java.net.DatagramSocket.receive(DatagramSocket.java:711)
[java] - locked <0xf4dd0050> (a java.net.DatagramPacket)
[java] - locked <0xf218ae68> (a java.net.DatagramSocket)
[java] at org.opennms.protocols.snmp.SnmpPortal$1.run(SnmpPortal.java:305)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "SnmpPortal--1" prio=5 tid=0x0073de48 nid=0x26 runnable
[ee481000..ee4819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at
org.opennms.protocols.snmp.SnmpPortal$Receiver.run(SnmpPortal.java:372)
[java] - locked <0xf218af00> (a java.util.LinkedList)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "SnmpTimer" prio=5 tid=0x006c4df0 nid=0x25 runnable [ee581000..ee5819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at
org.opennms.protocols.snmp.SnmpTimer$Scheduler.run(SnmpTimer.java:208)
[java] - locked <0xf218af70> (a java.lang.Object)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "SnmpPortal--1-FastReceiver" prio=5 tid=0x00740158 nid=0x24 runnable
[ee681000..ee6819f0]
[java] at java.net.PlainDatagramSocketImpl.receive(Native Method)
[java] at java.net.DatagramSocket.receive(DatagramSocket.java:711)
[java] - locked <0xf4dd0030> (a java.net.DatagramPacket)
[java] - locked <0xf2153820> (a java.net.DatagramSocket)
[java] at org.opennms.protocols.snmp.SnmpPortal$1.run(SnmpPortal.java:305)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Thread-11" prio=5 tid=0x005f65e8 nid=0x23 in Object.wait()
[ee781000..ee7819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf2147748> (a org.jboss.mx.util.RunnableScheduler)
[java] at java.lang.Object.wait(Object.java:429)
[java] at
org.jboss.mx.util.RunnableScheduler.waitOutstanding(RunnableScheduler.java:181)
[java] - locked <0xf2147748> (a org.jboss.mx.util.RunnableScheduler)
[java] at org.jboss.mx.util.RunnableScheduler.run(RunnableScheduler.java:93)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "SnmpPortal--1" prio=5 tid=0x005f32d8 nid=0x22 runnable
[efa01000..efa019f0]
[java] at java.lang.Object.wait(Native Method)
[java] at
org.opennms.protocols.snmp.SnmpPortal$Receiver.run(SnmpPortal.java:372)
[java] - locked <0xf2153900> (a java.util.LinkedList)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "StandardManager[/jboss-net]" daemon prio=5 tid=0x007c1c18 nid=0x21
waiting on condition [eea81000..eea819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
org.apache.catalina.session.StandardManager.threadSleep(StandardManager.java:810)
[java] at
org.apache.catalina.session.StandardManager.run(StandardManager.java:869)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "StandardManager[/invoker]" daemon prio=5 tid=0x007dcff0 nid=0x20 waiting
on condition [eeb81000..eeb819f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
org.apache.catalina.session.StandardManager.threadSleep(StandardManager.java:810)
[java] at
org.apache.catalina.session.StandardManager.run(StandardManager.java:869)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "TP-Monitor" daemon prio=5 tid=0x008cb8e8 nid=0x1f in Object.wait()
[eec81000..eec819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf1f90fd8> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
[java] at
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:560)
[java] - locked <0xf1f90fd8> (a
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "TP-Processor4" daemon prio=5 tid=0x0086b5e0 nid=0x1e runnable
[eed81000..eed819f0]
[java] at java.net.PlainSocketImpl.socketAccept(Native Method)
[java] at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
[java] - locked <0xf1fe0140> (a java.net.PlainSocketImpl)
[java] at java.net.ServerSocket.implAccept(ServerSocket.java:448)
[java] at java.net.ServerSocket.accept(ServerSocket.java:419)
[java] at
org.apache.tomcat.util.net.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:107)
[java] at
org.apache.tomcat.util.net.PoolTcpEndpoint.acceptSocket(PoolTcpEndpoint.java:387)
[java] at
org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoint.java:569)
[java] at
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:677)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "TP-Processor3" daemon prio=5 tid=0x0086ac40 nid=0x1d in Object.wait()
[eee81000..eee819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf1f91138> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
[java] at java.lang.Object.wait(Object.java:429)
[java] at
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:653)
[java] - locked <0xf1f91138> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "TP-Processor2" daemon prio=5 tid=0x0086c7c0 nid=0x1c in Object.wait()
[eef81000..eef819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf1f911b8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
[java] at java.lang.Object.wait(Object.java:429)
[java] at
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:653)
[java] - locked <0xf1f911b8> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "TP-Processor1" daemon prio=5 tid=0x0086c620 nid=0x1b in Object.wait()
[ef081000..ef0819f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf1f91238> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
[java] at java.lang.Object.wait(Object.java:429)
[java] at
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:653)
[java] - locked <0xf1f91238> (a
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Thread-5" daemon prio=5 tid=0x00722078 nid=0x1a in Object.wait()
[ef501000..ef5019f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.util.TimerThread.mainLoop(Timer.java:429)
[java] - locked <0xf1db46a8> (a java.util.TaskQueue)
[java] at java.util.TimerThread.run(Timer.java:382)
[java] "Thread-4" prio=5 tid=0x0060dda8 nid=0x19 runnable [ef601000..ef6019f0]
[java] at java.net.PlainSocketImpl.socketAccept(Native Method)
[java] at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
[java] - locked <0xf1ca2bb0> (a java.net.PlainSocketImpl)
[java] at java.net.ServerSocket.implAccept(ServerSocket.java:448)
[java] at java.net.ServerSocket.accept(ServerSocket.java:419)
[java] at
org.jboss.invocation.pooled.server.PooledInvoker.run(PooledInvoker.java:211)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "RMI TCP Accept-14023" daemon prio=5 tid=0x0060c630 nid=0x17 runnable
[ef701000..ef7019f0]
[java] at java.net.PlainSocketImpl.socketAccept(Native Method)
[java] at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
[java] - locked <0xf1c80630> (a java.net.PlainSocketImpl)
[java] at java.net.ServerSocket.implAccept(ServerSocket.java:448)
[java] at java.net.ServerSocket.accept(ServerSocket.java:419)
[java] at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "RMI LeaseChecker" daemon prio=5 tid=0x00614bb0 nid=0x16 waiting on
condition [ef801000..ef8019f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at sun.rmi.transport.DGCImpl$LeaseChecker.run(DGCImpl.java:307)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "GC Daemon" daemon prio=2 tid=0x00159208 nid=0x12 in Object.wait()
[efb01000..efb019f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf1c74170> (a sun.misc.GC$LatencyLock)
[java] at sun.misc.GC$Daemon.run(GC.java:100)
[java] - locked <0xf1c74170> (a sun.misc.GC$LatencyLock)
[java] "RMI Reaper" prio=5 tid=0x001587f0 nid=0x11 in Object.wait()
[efc01000..efc019f0]
[java] at java.lang.Object.wait(Native Method)
[java] - waiting on <0xf1c741c0> (a java.lang.ref.ReferenceQueue$Lock)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
[java] - locked <0xf1c741c0> (a java.lang.ref.ReferenceQueue$Lock)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
[java] at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:330)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Thread-3" daemon prio=5 tid=0x005e5188 nid=0x10 in Object.wait()
[efd01000..efd019f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.util.TimerThread.mainLoop(Timer.java:429)
[java] - locked <0xf1c74238> (a java.util.TaskQueue)
[java] at java.util.TimerThread.run(Timer.java:382)
[java] "RMI TCP Accept-14022" daemon prio=5 tid=0x005e4940 nid=0xf runnable
[efe01000..efe019f0]
[java] at java.net.PlainSocketImpl.socketAccept(Native Method)
[java] at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
[java] - locked <0xf1c742a0> (a java.net.PlainSocketImpl)
[java] at java.net.ServerSocket.implAccept(ServerSocket.java:448)
[java] at java.net.ServerSocket.accept(ServerSocket.java:419)
[java] at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
[java] at java.lang.Thread.run(Thread.java:534)
[java] "Thread-2" daemon prio=5 tid=0x001581b0 nid=0xe runnable
[eff01000..eff019f0]
[java] at java.net.PlainSocketImpl.socketAccept(Native Method)
[java] at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
[java] - locked <0xf1c74370> (a java.net.PlainSocketImpl)
[java] at java.net.ServerSocket.implAccept(ServerSocket.java:448)
[java] at java.net.ServerSocket.accept(ServerSocket.java:419)
[java] at org.jboss.web.WebServer.run(WebServer.java:258)
[java] at org.jboss.web.ThreadPool$Worker.run(ThreadPool.java:163)
[java] "ScannerThread" daemon prio=5 tid=0x005feea8 nid=0xd waiting on condition
[f0001000..f00019f0]
[java] at java.lang.Thread.sleep(Native Method)
[java] at
org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.loop(AbstractDeploymentScanner.java:218)
[java] at
org.jboss.deployment.scanner.AbstractDeploymentScanner$ScannerThread.run(AbstractDeploymentScanner.java:191)
[java] "Thread-0" daemon prio=5 tid=0x004dae90 nid=0xc in Object.wait()
[f0101000..f01019f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.util.TimerThread.mainLoop(Timer.java:429)
[java] - locked <0xf1bd9438> (a java.util.TaskQueue)
[java] at java.util.TimerThread.run(Timer.java:382)
[java] "DestroyJavaVM" prio=5 tid=0x0002ec48 nid=0x1 waiting on condition
[0..ffbee128]
[java] "Signal Dispatcher" daemon prio=10 tid=0x000c4c10 nid=0x8 waiting on
condition [0..0]
[java] "Finalizer" daemon prio=8 tid=0x000c0e88 nid=0x6 in Object.wait()
[fc381000..fc3819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
[java] - locked <0xf1b269a0> (a java.lang.ref.ReferenceQueue$Lock)
[java] at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
[java] at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
[java] "Reference Handler" daemon prio=10 tid=0x000bf528 nid=0x5 in Object.wait()
[fde81000..fde819f0]
[java] at java.lang.Object.wait(Native Method)
[java] at java.lang.Object.wait(Object.java:429)
[java] at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
[java] - locked <0xf1b26758> (a java.lang.ref.Reference$Lock)
[java] "VM Thread" prio=5 tid=0x000be6c0 nid=0x4 runnable
[java] "VM Periodic Task Thread" prio=10 tid=0x000c7268 nid=0xa runnable
[java] "Suspend Checker Thread" prio=10 tid=0x000c42a8 nid=0x7 runnable
View the original post :
http://www.jboss.org/index.html?module=bb&op=viewtopic&p=3850610#3850610
Reply to the post :
http://www.jboss.org/index.html?module=bb&op=posting&mode=reply&p=3850610
-------------------------------------------------------
This SF.net email is sponsored by: IT Product Guide on ITManagersJournal
Use IT products in your business? Tell us what you think of them. Give us
Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more
http://productguide.itmanagersjournal.com/guidepromo.tmpl
_______________________________________________
JBoss-user mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/jboss-user
