Hi All,
Kindly help me to resolve an issue in our production system, where tomcat is
frequenctly getting hunged and axis request threads are been in BLOCKED state.
Below is the snaphot of jstack during hunged state.
Tomcat : 5.5
MySQL : 5
=======================================================
jstack 12243
=======================================================
Attaching to process ID 12243, please wait...
Debugger attached successfully.
Server compiler detected.
JVM version is 1.5.0_05-b05
Thread 7767: (state = IN_NATIVE)
- java.net.SocketInputStream.socketRead0(java.io.FileDescriptor, byte[], int,
int, int) @bci=0 (Compiled frame; information may be imprecise)
- java.net.SocketInputStream.read(byte[], int, int) @bci=84, line=129
(Compiled frame)
- java.io.BufferedInputStream.fill() @bci=175, line=218 (Interpreted frame)
- java.io.BufferedInputStream.read() @bci=12, line=235 (Interpreted frame)
- java.io.FilterInputStream.read() @bci=4, line=66 (Interpreted frame)
-
sun.rmi.transport.tcp.TCPTransport.handleMessages(sun.rmi.transport.Connection,
boolean) @bci=25, line=442 (Interpreted frame)
- sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run() @bci=685,
line=701 (Interpreted frame)
- java.lang.Thread.run() @bci=11, line=595 (Interpreted frame)
Thread 2102: (state = BLOCKED)
- java.sql.DriverManager.getConnection(java.lang.String, java.lang.String,
java.lang.String) @bci=0, line=158 (Interpreted frame)
- com.zt.ebiz.util.DBUtil.getUnpooledConnection(java.lang.String,
java.lang.String, java.lang.String, java.lang.String) @bci=15, line=465
(Interpreted frame)
- com.zt.ebiz.util.DBUtil.getConnection(java.lang.String, java.lang.String,
long, java.lang.String, java.lang.String, java.lang.String, boolean) @bci=123,
line=351 (Interpreted frame)
- com.zt.ebiz.handler.RTHandler.updateRTSchedule(long, long, int, int, int,
java.util.LinkedHashMap) @bci=570, line=875 (Compiled frame)
-
com.zt.ebiz.handler.RTHandler.publishRealTimeCampaign(com.zt.ebiz.server.Campaign,
long, int, java.util.LinkedHashMap) @bci=263, line=158 (Interpreted frame)
- com.zt.ebiz.core.EbizServer.publishRealTimeCampaign(java.lang.String, long,
int, java.util.LinkedHashMap) @bci=29, line=6927 (Interpreted frame)
-
com.zt.ebiz.ws.realtime.RealTimeServiceSoapBindingImpl.sendEbizMail(java.lang.String,
java.lang.String, java.lang.String, com.zt.ebiz.ws.profile.ProfileDTO)
@bci=214, line=132 (Interpreted frame)
- sun.reflect.GeneratedMethodAccessor67.invoke(java.lang.Object,
java.lang.Object[]) @bci=68 (Interpreted frame)
- sun.reflect.DelegatingMethodAccessorImpl.invoke(java.lang.Object,
java.lang.Object[]) @bci=6, line=25 (Compiled frame)
-
org.apache.axis.providers.java.RPCProvider.invokeMethod(org.apache.axis.MessageContext,
java.lang.reflect.Method, java.lang.Object, java.lang.Object[]) @bci=4,
line=397 (Interpreted frame)
-
org.apache.axis.providers.java.RPCProvider.processMessage(org.apache.axis.MessageContext,
org.apache.axis.message.SOAPEnvelope, org.apache.axis.message.SOAPEnvelope,
java.lang.Object) @bci=549, line=186 (Compiled frame)
-
org.apache.axis.providers.java.JavaProvider.invoke(org.apache.axis.MessageContext)
@bci=248, line=323 (Interpreted frame)
- org.apache.axis.strategies.InvocationStrategy.visit(org.apache.axis.Handler,
org.apache.axis.MessageContext) @bci=2, line=32 (Interpreted frame)
- org.apache.axis.SimpleChain.doVisiting(org.apache.axis.MessageContext,
org.apache.axis.HandlerIterationStrategy) @bci=37, line=118 (Compiled frame)
- org.apache.axis.SimpleChain.invoke(org.apache.axis.MessageContext) @bci=31,
line=83 (Compiled frame)
-
org.apache.axis.handlers.soap.SOAPService.invoke(org.apache.axis.MessageContext)
@bci=70, line=453 (Interpreted frame)
- org.apache.axis.server.AxisServer.invoke(org.apache.axis.MessageContext)
@bci=552, line=281 (Interpreted frame)
-
org.apache.axis.transport.http.AxisServlet.doPost(javax.servlet.http.HttpServletRequest,
javax.servlet.http.HttpServletResponse) @bci=450, line=699 (Compiled frame)
-
javax.servlet.http.HttpServlet.service(javax.servlet.http.HttpServletRequest,
javax.servlet.http.HttpServletResponse) @bci=139, line=709 (Interpreted frame)
-
org.apache.axis.transport.http.AxisServletBase.service(javax.servlet.http.HttpServletRequest,
javax.servlet.http.HttpServletResponse) @bci=6, line=327 (Interpreted frame)
- javax.servlet.http.HttpServlet.service(javax.servlet.ServletRequest,
javax.servlet.ServletResponse) @bci=30, line=802 (Interpreted frame)
-
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(javax.servlet.ServletRequest,
javax.servlet.ServletResponse) @bci=354, line=252 (Interpreted frame)
-
org.apache.catalina.core.ApplicationFilterChain.doFilter(javax.servlet.ServletRequest,
javax.servlet.ServletResponse) @bci=101, line=173 (Interpreted frame)
-
org.apache.catalina.core.StandardWrapperValve.invoke(org.apache.catalina.connector.Request,
org.apache.catalina.connector.Response) @bci=670, line=213 (Interpreted frame)
-
org.apache.catalina.core.StandardContextValve.invoke(org.apache.catalina.connector.Request,
org.apache.catalina.connector.Response) @bci=285, line=178 (Interpreted frame)
-
org.apache.catalina.core.StandardHostValve.invoke(org.apache.catalina.connector.Request,
org.apache.catalina.connector.Response) @bci=64, line=126 (Interpreted frame)
-
org.apache.catalina.valves.ErrorReportValve.invoke(org.apache.catalina.connector.Request,
org.apache.catalina.connector.Response) @bci=6, line=105 (Interpreted frame)
-
org.apache.catalina.core.StandardEngineValve.invoke(org.apache.catalina.connector.Request,
org.apache.catalina.connector.Response) @bci=42, line=107 (Interpreted frame)
-
org.apache.catalina.connector.CoyoteAdapter.service(org.apache.coyote.Request,
org.apache.coyote.Response) @bci=141, line=148 (Interpreted frame)
- org.apache.jk.server.JkCoyoteHandler.invoke(org.apache.jk.core.Msg,
org.apache.jk.core.MsgContext) @bci=123, line=199 (Interpreted frame)
- org.apache.jk.common.HandlerRequest.invoke(org.apache.jk.core.Msg,
org.apache.jk.core.MsgContext) @bci=327, line=282 (Interpreted frame)
- org.apache.jk.common.ChannelSocket.invoke(org.apache.jk.core.Msg,
org.apache.jk.core.MsgContext) @bci=191, line=744 (Interpreted frame)
-
org.apache.jk.common.ChannelSocket.processConnection(org.apache.jk.core.MsgContext)
@bci=101, line=674 (Interpreted frame)
-
org.apache.jk.common.ChannelSocket$SocketConnection.runIt(java.lang.Object[])
@bci=8, line=866 (Interpreted frame)
- org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run() @bci=167,
line=684 (Compiled frame)
- java.lang.Thread.run() @bci=11, line=595 (Interpreted frame)
Thanks
Sunil.
