FYI, I'm just the linux admin as the "applicatons" group/developer and coder is
not making any headway into resolving this. This is a mobility application (ie.
Mobile banking, so you go to your iphone and go to your bank.mobi..)not that it
matter but....
Ok, So yesterday I did perform a kill -3 and got a THREAD DUMP in the
catalina.out file. I have copied most of it below:
===== FULL THREAD DUMP ===============
Tue Jun 9 15:32:27 2009
BEA JRockit(R) R27.1.0-109-73164-1.5.0_08-20061129-1415-linux-x86_64
"Main Thread" id=1 idx=0x2 tid=10410 prio=5 alive, in native
"(Signal Handler)" id=2 idx=0x4 tid=10412 prio=5 alive, in native, daemon
"(Code Generation Thread 1)" id=3 idx=0x6 tid=10413 prio=5 alive, in native,
native_waiting, daemon
"(Code Optimization Thread 1)" id=4 idx=0x8 tid=10414 prio=5 alive, in native,
native_waiting, daem
on
"(GC Main Thread)" id=5 idx=0xa tid=10415 prio=5 alive, in native, daemon
"(GC Worker Thread 1)" id=? idx=0xc tid=10416 prio=5 terminated, daemon
"(GC Worker Thread 2)" id=? idx=0xe tid=10417 prio=5 terminated, daemon
"(GC Worker Thread 3)" id=? idx=0x10 tid=10418 prio=5 terminated, daemon
"(GC Worker Thread 4)" id=? idx=0x12 tid=10419 prio=5 terminated, daemon
"(GC Worker Thread 5)" id=? idx=0x14 tid=10420 prio=5 terminated, daemon
"(GC Worker Thread 6)" id=? idx=0x16 tid=10421 prio=5 terminated, daemon
"(GC Worker Thread 7)" id=? idx=0x18 tid=10422 prio=5 terminated, daemon
"(GC Worker Thread 8)" id=? idx=0x1a tid=10423 prio=5 terminated, daemon
"(VM Periodic Task)" id=6 idx=0x1c tid=10424 prio=10 alive, in native, daemon
"Finalizer" id=7 idx=0x1e tid=10425 prio=8 alive, in native, native_waiting,
daemon
at jrockit/memory/Finalizer.getPendingFinalizee(Z)Ljava/lang/Object;(Native
Method)
at jrockit/memory/Finalizer.access$100(Z)Ljava/lang/Object;(Unknown
Source)[optimized]
at jrockit/memory/Finalizer$4.run()V(Unknown Source)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"Reference Handler" id=8 idx=0x20 tid=10426 prio=10 alive, in native,
native_waiting, daemon
at java/lang/ref/Reference.getPending()Ljava/lang/ref/Reference;(Native
Method)
at java/lang/ref/Reference.access$000()Ljava/lang/ref/Reference;(Unknown
Source)
at java/lang/ref/Reference$ReferenceHandler.run()V(Unknown Source)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"(Sensor Event Thread)" id=9 idx=0x22 tid=10427 prio=5 alive, in native, daemon
"Thread-1" id=12 idx=0x24 tid=10436 prio=1 alive, in native, sleeping,
native_waiting
at java/lang/Thread.sleep(J)V(Native Method)
at com/mshift/d/j.run()V(Unknown Source)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"ContainerBackgroundProcessor[StandardEngine[Standalone]]" id=13 idx=0x26
tid=10437 prio=5 alive, i
n native, sleeping, native_waiting, daemon
at java/lang/Thread.sleep(J)V(Native Method)
at
org/apache/catalina/core/ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1
549)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"http-81-Acceptor-0" id=14 idx=0x28 tid=10439 prio=5 alive, in native, daemon
at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native
Method)
at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:384)
^-- Holding lock: java/net/sockssocketi...@0x13141ec0[thin lock]
at java/net/ServerSocket.implAccept(ServerSocket.java:450)
at java/net/ServerSocket.accept(ServerSocket.java:421)
at
org/apache/tomcat/util/net/DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactor
y.java:61)
at org/apache/tomcat/util/net/JIoEndpoint$Acceptor.run(JIoEndpoint.java:310)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=105163 idx=0x2a tid=18944 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/net/jioendpoint$wor...@0x27a6a568[fat lo
ck]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at java/lang/Object.wait()V(Native Method)[optimized]
at org/apache/tomcat/util/net/JIoEndpoint$Worker.await(JIoEndpoint.java:414)
^-- Lock released while waiting:
org/apache/tomcat/util/net/jioendpoint$wor...@0x27a6a568[fat l
ock]
at org/apache/tomcat/util/net/JIoEndpoint$Worker.run(JIoEndpoint.java:440)
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=16 idx=0x2c tid=10441 prio=5 alive, in native, daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)[inline
d]
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)[inlined]
at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)[optimized]
at
java/io/BufferedInputStream.read1(BufferedInputStream.java:256)[optimized]
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)[optimized]
^-- Holding lock: java/io/bufferedinputstr...@0x296b4100[thin lock]
at org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[inlined]
at
org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)[inlined]
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=105166 idx=0x2e tid=18947 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x283
060e8[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at jrockit/vm/Locks.wait(Ljava/lang/Object;)V(Unknown Source)[inlined]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)[optimized
]
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x28
3060e8[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"TP-Processor4" id=18 idx=0x30 tid=10443 prio=5 alive, in native, daemon
at java/net/PlainSocketImpl.socketAccept(Ljava/net/SocketImpl;)V(Native
Method)
at java/net/PlainSocketImpl.accept(PlainSocketImpl.java:384)
^-- Holding lock: java/net/sockssocketi...@0x1247c760[thin lock]
at java/net/ServerSocket.implAccept(ServerSocket.java:450)
at java/net/ServerSocket.accept(ServerSocket.java:421)
at
org/apache/jk/common/ChannelSocket.accept(ChannelSocket.java:306)[optimized]
at
org/apache/jk/common/ChannelSocket.acceptConnections(ChannelSocket.java:660)
at
org/apache/jk/common/ChannelSocket$SocketAcceptor.runIt(ChannelSocket.java:870)
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"TP-Monitor" id=19 idx=0x32 tid=10444 prio=5 alive, in native, waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$monitorrunna...@0x128
1cc08[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at
org/apache/tomcat/util/threads/ThreadPool$MonitorRunnable.run(ThreadPool.java:561)
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$monitorrunna...@0x12
81cc08[fat lock]
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=34 idx=0x34 tid=10647 prio=5 alive, in native, daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)
at java/net/SocketInputStream.read(SocketInputStream.java:129)
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)
at java/io/BufferedInputStream.read1(BufferedInputStream.java:256)
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)
^-- Holding lock: java/io/bufferedinputstr...@0x1b663408[thin lock]
at org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[inlined]
at
org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)[inlined]
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=22 idx=0x36 tid=10614 prio=5 alive, in native, daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)
at java/net/SocketInputStream.read(SocketInputStream.java:129)
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)
at java/io/BufferedInputStream.read1(BufferedInputStream.java:256)
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)
^-- Holding lock: java/io/bufferedinputstr...@0x17090670[thin lock]
at
org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[optimized]
at org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)
at org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=105168 idx=0x38 tid=18949 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x283
05ec0[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at jrockit/vm/Locks.wait(Ljava/lang/Object;)V(Unknown Source)[inlined]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)[optimized
]
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x28
305ec0[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: TS=Sun Jun 07 09:56:49 EDT 2009; RI=32.133.22.225; URI=/c2ht;
QS=appno=qa2&msestks=chase
.xml&msdxid=O11IB820594039643486758861&qxq=1244383000473&stk=acct_hist_1&show=all&type=deposit&ai=6
4886262; UA=Mozilla/5.0 (iPhone; U; CPU iPhone OS 2_2_1 like Mac OS X; en-us)
AppleWebKit/525.18.1
(KHTML, like Gecko) Mobile/5H11" id=24 idx=0x3a tid=10616 prio=5 alive, daemon
at java/lang/Character.toLowerCase(Character.java:4204)[optimized]
at java/lang/String.toLowerCase(String.java:2254)[optimized]
at java/lang/String.toLowerCase(String.java:2296)[inlined]
at com/mshift/engine/a.bf(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.a(ZLorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.bk(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.a(ZLorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.bk(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.Q()V(Unknown Source)[optimized]
at
com/mshift/engine/a.a(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServlet
Response;ILjava/lang/String;I)V(Unknown Source)[optimized]
at
com/mshift/engine/MShiftStack.a(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/H
ttpServletResponse;)V(Unknown Source)
at
com/mshift/engine/MShiftStack.<init>(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/h
ttp/HttpServletResponse;I)V(Unknown Source)
at C2HTService.doGet(C2HTService.java:35)
at javax/servlet/http/HttpServlet.service(HttpServlet.java:690)
at javax/servlet/http/HttpServlet.service(HttpServlet.java:803)
at
org/apache/catalina/core/ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java
:290)
at
org/apache/catalina/core/ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org/apache/catalina/core/StandardWrapperValve.invoke(StandardWrapperValve.java:228)
at
org/apache/catalina/core/StandardContextValve.invoke(StandardContextValve.java:175)
at
org/apache/catalina/core/StandardHostValve.invoke(StandardHostValve.java:128)
at
org/apache/catalina/valves/ErrorReportValve.invoke(ErrorReportValve.java:104)
at
org/apache/catalina/core/StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org/apache/catalina/connector/CoyoteAdapter.service(CoyoteAdapter.java:216)
at org/apache/jk/server/JkCoyoteHandler.invoke(JkCoyoteHandler.java:190)
at org/apache/jk/common/HandlerRequest.invoke(HandlerRequest.java:283)
at org/apache/jk/common/ChannelSocket.invoke(ChannelSocket.java:767)
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:697)
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=105169 idx=0x3c tid=18950 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x283
05c98[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at jrockit/vm/Locks.wait(Ljava/lang/Object;)V(Unknown Source)[inlined]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)[optimized
]
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x28
305c98[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=105170 idx=0x3e tid=18951 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x283
05a70[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at jrockit/vm/Locks.wait(Ljava/lang/Object;)V(Unknown Source)[inlined]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)[optimized
]
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x28
305a70[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=109449 idx=0x40 tid=7349 prio=5 alive, in native,
daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)[inline
d]
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)[inlined]
at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)[optimized]
at
java/io/BufferedInputStream.read1(BufferedInputStream.java:256)[optimized]
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)[optimized]
^-- Holding lock: java/io/bufferedinputstr...@0x2abf48c0[thin lock]
at org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[inlined]
at
org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)[inlined]
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)[optimized
]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49713 idx=0x42 tid=23179 prio=5 alive, in native,
daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)[inline
d]
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)[inlined]
at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)[optimized]
at
java/io/BufferedInputStream.read1(BufferedInputStream.java:256)[optimized]
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)[optimized]
^-- Holding lock: java/io/bufferedinputstr...@0x2aca6e20[thin lock]
at org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[inlined]
at
org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)[inlined]
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49714 idx=0x44 tid=23186 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x1bb
39008[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at java/lang/Object.wait()V(Native Method)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x1b
b39008[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=109451 idx=0x46 tid=7351 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x289
06380[fat lock]
.
.
.
.
.
.
at jrockit/vm/ExceptionHandler.throwPendingType()V(Native Method)
at jrockit/vm/RNI.contextMarker()V(Unknown Source)
at
com/mshift/engine/a.if(Lorg/w3c/dom/Node;Ljava/lang/String;)Ljava/lang/String;(Unknown
Sourc
e)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.bf(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.a(ZLorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.bk(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.a(ZLorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.bk(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.R(Lorg/w3c/dom/Node;)V(Unknown Source)[optimized]
at com/mshift/engine/a.Q()V(Unknown Source)[optimized]
at
com/mshift/engine/a.a(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServlet
Response;ILjava/lang/String;I)V(Unknown Source)[optimized]
at
com/mshift/engine/MShiftStack.a(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/H
ttpServletResponse;)V(Unknown Source)[optimized]
at
com/mshift/engine/MShiftStack.<init>(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/h
ttp/HttpServletResponse;I)V(Unknown Source)
at C2HTService.doGet(C2HTService.java:35)
at javax/servlet/http/HttpServlet.service(HttpServlet.java:690)[optimized]
at javax/servlet/http/HttpServlet.service(HttpServlet.java:803)
at
org/apache/catalina/core/ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java
:290)[inlined]
at
org/apache/catalina/core/ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)[op
timized]
at
org/apache/catalina/core/StandardWrapperValve.invoke(StandardWrapperValve.java:228)[optimize
d]
at
org/apache/catalina/core/StandardContextValve.invoke(StandardContextValve.java:175)[optimize
d]
at
org/apache/catalina/core/StandardHostValve.invoke(StandardHostValve.java:128)[optimized]
at
org/apache/catalina/valves/ErrorReportValve.invoke(ErrorReportValve.java:104)[optimized]
at
org/apache/catalina/core/StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org/apache/catalina/connector/CoyoteAdapter.service(CoyoteAdapter.java:216)[optimized]
at
org/apache/jk/server/JkCoyoteHandler.invoke(JkCoyoteHandler.java:190)[optimized]
at
org/apache/jk/common/HandlerRequest.invoke(HandlerRequest.java:283)[optimized]
at org/apache/jk/common/ChannelSocket.invoke(ChannelSocket.java:767)
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:697)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49300 idx=0x14e tid=21001 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x1b9
93e60[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at java/lang/Object.wait()V(Native Method)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x1b
993e60[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49946 idx=0x160 tid=24337 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x1ba
7e428[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at java/lang/Object.wait()V(Native Method)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x1b
a7e428[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49947 idx=0x162 tid=24338 prio=5 alive, in native,
daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)[inline
d]
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)[inlined]
at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)[optimized]
at
java/io/BufferedInputStream.read1(BufferedInputStream.java:256)[optimized]
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)[optimized]
^-- Holding lock: java/io/bufferedinputstr...@0x2ac752a0[thin lock]
at org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[inlined]
at
org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)[inlined]
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49958 idx=0x168 tid=24395 prio=5 alive, in native,
daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)[inline
d]
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)[inlined]
at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)[optimized]
at
java/io/BufferedInputStream.read1(BufferedInputStream.java:256)[optimized]
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)[optimized]
^-- Holding lock: java/io/bufferedinputstr...@0x2e1a5920[thin lock]
at org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[inlined]
at
org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)[inlined]
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49960 idx=0x16c tid=24397 prio=5 alive, in native,
daemon
at
jrockit/net/SocketNativeIO.readBytesPinned(Ljava/io/FileDescriptor;[BIII)I(Native
Method)
at
jrockit/net/SocketNativeIO.socketRead(Ljava/io/FileDescriptor;[BIII)I(Unknown
Source)[inline
d]
at
java/net/SocketInputStream.socketRead0(Ljava/io/FileDescriptor;[BIII)I(SocketInputStream.jav
a)[inlined]
at java/net/SocketInputStream.read(SocketInputStream.java:129)[optimized]
at java/io/BufferedInputStream.fill(BufferedInputStream.java:218)[optimized]
at
java/io/BufferedInputStream.read1(BufferedInputStream.java:256)[optimized]
at java/io/BufferedInputStream.read(BufferedInputStream.java:313)[optimized]
^-- Holding lock: java/io/bufferedinputstr...@0x2ab873c8[thin lock]
at org/apache/jk/common/ChannelSocket.read(ChannelSocket.java:620)[inlined]
at
org/apache/jk/common/ChannelSocket.receive(ChannelSocket.java:558)[inlined]
at
org/apache/jk/common/ChannelSocket.processConnection(ChannelSocket.java:685)[optimized]
at
org/apache/jk/common/ChannelSocket$SocketConnection.runIt(ChannelSocket.java:889)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:686)
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49500 idx=0x18e tid=22045 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x198
12ae0[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at java/lang/Object.wait()V(Native Method)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x19
812ae0[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
"aRequest: -Completed-" id=49508 idx=0x196 tid=22091 prio=5 alive, in native,
waiting, daemon
-- Waiting for notification on:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x198
73a80[fat lock]
at jrockit/vm/Threads.waitForSignal(J)Z(Native Method)
at jrockit/vm/Locks.wait(Ljava/lang/Object;J)V(Unknown Source)[inlined]
at java/lang/Object.wait()V(Native Method)[optimized]
at
org/apache/tomcat/util/threads/ThreadPool$ControlRunnable.run(ThreadPool.java:658)
^-- Lock released while waiting:
org/apache/tomcat/util/threads/threadpool$controlrunna...@0x19
873a80[fat lock]
at java/lang/Thread.run(Thread.java:595)[optimized]
at jrockit/vm/RNI.c2java(JJJJ)V(Native Method)
-- end of trace
===== END OF THREAD DUMP ===============
-----Original Message-----
From: Peter Crowther [mailto:peter.crowt...@melandra.com]
Sent: Wednesday, June 10, 2009 12:16 PM
To: 'Tomcat Users List'
Subject: RE: Tomcat maxThreads Issue
> From: Jones, Keven [mailto:keven.jo...@ncr.com] How do I
>
> A. get thread dumps when the processes are dying
The top of
http://java.sun.com/developer/technicalArticles/Programming/Stacktrace/ is good
general reading.
kill -QUIT <pid of Java process>
If ps is confused by all the threads, depending on your Java version, you might
be able to use jps
(http://java.sun.com/j2se/1.5.0/docs/tooldocs/share/jps.html) to get the pid.
Depending on your Java version, jstack
(http://java.sun.com/j2se/1.5.0/docs/tooldocs/share/jstack.html) will also give
you thread dumps.
- Peter
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org
