On Nov 5, 2012, at 9:36 PM, Shak S <[email protected]> wrote: > Thanks Dan! > > I too have no clue. Service hosting people enabled sharkwire and they said, > they are getting the requests without body. When I checked the http stack > trace where our log4j enabled to degug for all including application debug > and 3rd party jars, I see content as null. > > However, I restarted the server with log4j level as error and the issue is > gone without any fix. To replicate the issue, I changed log4j back to debug > for all and I see issue again. I repeated it at least 4 times, each time I > set log4j to debug for all, including application and 3rd party libs, I see > the following issue. I'm not sure how they are related but this is how we > can reproduce the issue and fix the issue.
What version of CXF are you using? This is eerily similar to: https://issues.apache.org/jira/browse/CXF-3466 but that's been fixed for a very long time. Dan > > Thanks, > Shak > > > > > > > > > > > > > > On Mon, Nov 5, 2012 at 1:52 PM, Daniel Kulp <[email protected]> wrote: > >> >> On Nov 5, 2012, at 10:15 AM, Shak S <[email protected]> wrote: >> >>> CXF users/team, >>> I've WS client that is configured in spring using jax-ws with help of >> CXF. >>> While the client is calling the service, I see the following exception >> but >>> it is not recurring. My Client is running on top of weblogic 10. >>> >>> My question is, who is closing the socket. Is it client or server? How do >>> we exactly know from which side I need to troubleshoot the issue. Service >>> hosting folks say they could not see any error logs at their end. >> >> No idea really. The stack trace shows that CXF is trying to flush and >> close the output stream. Thus, it looks like the other side has closed >> the connection, but no idea why. Since this is an SSL connection, you >> could likely turn on the SSL debug traces via the system property: >> -Djavax.net.debug=all and see if any information is useful from that, but >> that will spit out a TON of stuff. >> >> Dan >> >>> >>> Thanks, >>> Shak >>> >>> org.apache.cxf.interceptor.Fault: Could not send Message. >>>> at >>> >> org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:64) >>>> at >>> >> org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:263) >>>> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:269) >>>> at >>> org.apache.cxf.jaxws.JaxWsClientProxy.invoke(JaxWsClientProxy.java:124) >>>> at $Proxy110.addToCart(Unknown Source) >>>> at >>> >> com.frequencymarketing.citi.view.http.struts.action.rewards.client.AddToCartAction.execute(AddToCartAction.java:69) >>>> at >>> >> com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:118) >>>> at >>> >> org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224) >>>> at >>> org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196) >>>> at >>> org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:434) >>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:821) >>>> at >>> >> weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227) >>>> at >>> >> weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292) >>>> at >>> weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:27) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:143) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:71) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.values.PerfDeltaTime.stopTime(PerfDeltaTime.java:70) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.PerfManager.stop(PerfManager.java:82) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.PerfManager.stopCount(PerfManager.java:93) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:57) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> weblogicx.servlet.gzip.filter.GZIPFilter.doFilter(GZIPFilter.java:70) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:738) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.VanityURLFilter.doFilter(VanityURLFilter.java:91) >>>> at >>> >> weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3496) >>>> at >>> >> weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321) >>>> at >>> >> weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086) >>>> at >>> >> weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406) >>>> at weblogic.work.ExecuteThread.run(ExecuteThread.java:173) >>>> *Caused by: java.net.SocketException: SocketException invoking >>> https://servciehost.com/service: Socket is closed* >>>> at >>> sun.reflect.GeneratedConstructorAccessor1942.newInstance(Unknown Source) >>>> at >>> >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) >>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:513) >>>> at >>> >> org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.mapException(HTTPConduit.java:1385) >>>> at >>> >> org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.close(HTTPConduit.java:1370) >>>> at >>> >> org.apache.cxf.io.CacheAndWriteOutputStream.postClose(CacheAndWriteOutputStream.java:47) >>>> at >>> org.apache.cxf.io.CachedOutputStream.close(CachedOutputStream.java:188) >>>> at >>> org.apache.cxf.transport.AbstractConduit.close(AbstractConduit.java:56) >>>> at >>> org.apache.cxf.transport.http.HTTPConduit.close(HTTPConduit.java:614) >>>> at >>> >> org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:62) >>>> at >>> >> org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:263) >>>> at >> org.apache.cxf.endpoint.ClientImpl.doInvoke(ClientImpl.java:484) >>>> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:414) >>>> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:317) >>>> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:269) >>>> at >>> org.apache.cxf.frontend.ClientProxy.invokeSync(ClientProxy.java:73) >>>> at >>> org.apache.cxf.jaxws.JaxWsClientProxy.invoke(JaxWsClientProxy.java:124) >>>> at $Proxy110.addToCart(Unknown Source) >>>> at >>> >> com.frequencymarketing.citi.view.http.struts.action.rewards.client.AddToCartAction.execute(AddToCartAction.java:69) >>>> at >>> >> com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:186) >>>> at >>> >> com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:118) >>>> at >>> >> org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:419) >>>> at >>> >> org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224) >>>> at >>> org.apache.struts.action.ActionServlet.process(ActionServlet.java:1194) >>>> at >>> org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432) >>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) >>>> at >>> >> weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227) >>>> at >>> >> weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125) >>>> at >>> >> weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292) >>>> at >>> weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:141) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:69) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:55) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) >>>> at >>> weblogicx.servlet.gzip.filter.GZIPFilter.doFilter(GZIPFilter.java:70) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) >>>> at >>> >> org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:738) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.VanityURLFilter.doFilter(VanityURLFilter.java:91) >>>> at >>> >> weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2180) >>>> at >>> >> weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086) >>>> at >>> >> weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406) >>>> at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201) >>>> ... 1 more >>> *> Caused by: java.net.SocketException: Socket is closed* >>> *> at >>> >> com.sun.net.ssl.internal.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1316) >>> * >>>> at >>> >> com.sun.net.ssl.internal.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1337) >>>> at >>> >> com.sun.net.ssl.internal.ssl.AppOutputStream.write(AppOutputStream.java:44) >>>> at >>> java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:66) >>>> at >>> java.io.BufferedOutputStream.flush(BufferedOutputStream.java:124) >>>> at java.io.FilterOutputStream.flush(FilterOutputStream.java:124) >>>> at >>> >> weblogic.net.http.ContentLengthOutputStream.close(ContentLengthOutputStream.java:56) >>>> at >>> >> org.apache.cxf.io.CacheAndWriteOutputStream.closeFlowthroughStream(CacheAndWriteOutputStream.java:43) >>>> at >>> >> org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.close(HTTPConduit.java:1352) >>>> at >>> >> org.apache.cxf.io.CacheAndWriteOutputStream.postClose(CacheAndWriteOutputStream.java:48) >>>> at >>> org.apache.cxf.io.CachedOutputStream.close(CachedOutputStream.java:189) >>>> at >>> org.apache.cxf.transport.AbstractConduit.close(AbstractConduit.java:56) >>>> at >>> org.apache.cxf.transport.http.HTTPConduit.close(HTTPConduit.java:614) >>>> at >>> >> org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:62) >>>> at >>> >> org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:264) >>>> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:269) >>>> at >>> org.apache.cxf.jaxws.JaxWsClientProxy.invoke(JaxWsClientProxy.java:124) >>>> at $Proxy110.addToCart(Unknown Source) >>>> at >>> >> com.frequencymarketing.citi.view.http.struts.action.rewards.client.AddToCartAction.execute(AddToCartAction.java:69) >>>> at >>> >> com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:118) >>>> at >>> >> org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224) >>>> at >>> org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196) >>>> at >>> org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:434) >>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) >>>> at javax.servlet.http.HttpServlet.service(HttpServlet.java:821) >>>> at >>> >> weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227) >>>> at >>> >> weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292) >>>> at >>> weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:27) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:143) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:71) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.values.PerfDeltaTime.stopTime(PerfDeltaTime.java:70) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.PerfManager.stop(PerfManager.java:82) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.PerfManager.stopCount(PerfManager.java:93) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:57) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:143) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:71) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.values.PerfDeltaTime.stopTime(PerfDeltaTime.java:70) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.PerfManager.stop(PerfManager.java:82) >>>> at >>> >> com.frequencymarketing.common.app.perf.track.PerfManager.stopCount(PerfManager.java:93) >>>> at >>> >> com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:57) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> weblogicx.servlet.gzip.filter.GZIPFilter.doFilter(GZIPFilter.java:70) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:738) >>>> at >>> >> weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) >>>> at >>> >> com.frequencymarketing.citi.view.http.servlet.VanityURLFilter.doFilter(VanityURLFilter.java:91) >>>> at >>> >> weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3496) >>>> at >>> >> weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321) >>>> at >>> >> weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086) >>>> at >>> >> weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406) >>>> ... 1 more >> >> -- >> Daniel Kulp >> [email protected] - http://dankulp.com/blog >> Talend Community Coder - http://coders.talend.com >> >> -- Daniel Kulp [email protected] - http://dankulp.com/blog Talend Community Coder - http://coders.talend.com
