Hi, There were 2 scenarios reproducing this error initially.
1. When completing workflow tasks ( https://wso2.org/jira/browse/APIMANAGER-2360) - FIXED 2. When invoking workflows I can reproduce the following error intermittently on BPS for scenario 2. Tasks do not get created when this is reproduced. [2014-05-20 10:16:50,054] ERROR {org.wso2.carbon.bpel.b4p.extension.PeopleActivity} - org.apache.axis2.AxisFault: Timeout waiting for connection org.apache.axis2.AxisFault: Timeout waiting for connection at org.apache.axis2.AxisFault.makeFault(AxisFault.java:430) at org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:197) at org.apache.axis2.transport.http.HTTPSender.send(HTTPSender.java:75) at org.apache.axis2.transport.http.CommonsHTTPTransportSender.writeMessageWithCommons(CommonsHTTPTransportSender.java:451) at org.apache.axis2.transport.http.CommonsHTTPTransportSender.invoke(CommonsHTTPTransportSender.java:278) at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442) at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:430) at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225) at org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) at org.wso2.carbon.bpel.core.ode.integration.utils.AxisServiceUtils.invokeService(AxisServiceUtils.java:305) at org.wso2.carbon.bpel.b4p.extension.PeopleActivity.invoke(PeopleActivity.java:734) at org.wso2.carbon.bpel.b4p.extension.BPEL4PeopleExtensionOperation.runAsync(BPEL4PeopleExtensionOperation.java:66) at org.apache.ode.bpel.runtime.extension.AbstractLongRunningExtensionOperation.run(AbstractLongRunningExtensionOperation.java:95) at sun.reflect.GeneratedMethodAccessor69.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.ode.jacob.vpu.JacobVPU$JacobThreadImpl.run(JacobVPU.java:451) at org.apache.ode.jacob.vpu.JacobVPU.execute(JacobVPU.java:139) at org.apache.ode.bpel.engine.BpelRuntimeContextImpl.execute(BpelRuntimeContextImpl.java:898) at org.apache.ode.bpel.engine.PartnerLinkMyRoleImpl.invokeNewInstance(PartnerLinkMyRoleImpl.java:208) at org.apache.ode.bpel.engine.BpelProcess$1.invoke(BpelProcess.java:283) at org.apache.ode.bpel.engine.BpelProcess.invokeProcess(BpelProcess.java:224) at org.apache.ode.bpel.engine.BpelProcess.invokeProcess(BpelProcess.java:279) at org.apache.ode.bpel.engine.BpelProcess.handleJobDetails(BpelProcess.java:434) at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:558) at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:467) at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:536) at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:530) at org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:280) at org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:235) at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:530) at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:514) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: org.apache.commons.httpclient.ConnectionPoolTimeoutException: Timeout waiting for connection at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager.doGetConnection(MultiThreadedHttpConnectionManager.java:497) at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager.getConnectionWithTimeout(MultiThreadedHttpConnectionManager.java:416) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:153) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.axis2.transport.http.AbstractHTTPSender.executeMethod(AbstractHTTPSender.java:622) at org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:193) ... 34 more On Thu, May 15, 2014 at 10:41 PM, Amila De Silva <ami...@wso2.com> wrote: > Hi Charitha, > Do you get this for the super tenant or for a tenant? If it is for the > super tenant, can you try by changing the application/json message builder > to org.apache.axis2.json.JSONBuilder? > > > On Fri, May 9, 2014 at 10:04 PM, Charitha Kankanamge <chari...@wso2.com>wrote: > >> Hi Amila, >> Seems we are still seeing this error. I observe the following error >> frequently in BPS-3.2.0 when working with AM workflow scenarios. Everything >> running locally so not sure readtimeout makes sense. >> https://wso2.org/jira/browse/BPS-507 >> >> >> [2014-05-09 21:36:44,857] ERROR >> {org.wso2.carbon.bpel.core.ode.integration.PartnerService} - Error >> sending message to Axis2 for ODE mex >> {PartnerRoleMex#hqejbhcnphr99p0v6qjh9q [PID {http://workflow.ap >> plication.apimgt.carbon.wso2.org}ApplicationApprovalWorkFlowProcess-1] >> calling org.apache.ode.bpel.epr.WSAEndpoint@5055c844.resumeEvent(...) >> Status REQUEST} >> org.apache.axis2.AxisFault: Read timed out >> at org.apache.axis2.AxisFault.makeFault(AxisFault.java:430) >> at >> org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:197) >> at >> org.apache.axis2.transport.http.HTTPSender.send(HTTPSender.java:75) >> at >> org.apache.axis2.transport.http.CommonsHTTPTransportSender.writeMessageWithCommons(Common >> sHTTPTransportSender.java:451) >> at >> org.apache.axis2.transport.http.CommonsHTTPTransportSender.invoke(CommonsHTTPTransportSen >> der.java:278) >> at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442) >> at >> org.apache.axis2.description.OutOnlyAxisOperationClient.executeImpl(OutOnlyAxisOperation. >> java:297) >> at >> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) >> at >> org.wso2.carbon.bpel.core.ode.integration.utils.AxisServiceUtils.invokeService(AxisServic >> eUtils.java:305) >> at >> org.wso2.carbon.bpel.core.ode.integration.PartnerService.invoke(PartnerService.java:324) >> at >> org.wso2.carbon.bpel.core.ode.integration.BPELMessageExchangeContextImpl.invokePartner(BP >> ELMessageExchangeContextImpl.java:43) >> at >> org.apache.ode.bpel.engine.BpelRuntimeContextImpl.invoke(BpelRuntimeContextImpl.java:793) >> at org.apache.ode.bpel.runtime.INVOKE.run(INVOKE.java:130) >> at sun.reflect.GeneratedMethodAccessor44.invoke(Unknown Source) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:601) >> at >> org.apache.ode.jacob.vpu.JacobVPU$JacobThreadImpl.run(JacobVPU.java:451) >> at org.apache.ode.jacob.vpu.JacobVPU.execute(JacobVPU.java:139) >> at >> org.apache.ode.bpel.engine.BpelRuntimeContextImpl.execute(BpelRuntimeContextImpl.java:898 >> ) >> at >> org.apache.ode.bpel.engine.PartnerLinkMyRoleImpl.invokeInstance(PartnerLinkMyRoleImpl.jav >> a:250) >> at >> org.apache.ode.bpel.engine.BpelProcess$1.invoke(BpelProcess.java:288) >> at >> org.apache.ode.bpel.engine.BpelProcess.invokeProcess(BpelProcess.java:224) >> at >> org.apache.ode.bpel.engine.BpelProcess.invokeProcess(BpelProcess.java:279) >> at >> org.apache.ode.bpel.engine.BpelProcess.handleJobDetails(BpelProcess.java:434) >> at >> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:558) >> at >> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:467) >> at >> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:536) >> at >> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:530) >> at >> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:280) >> >> at >> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:235) >> >> at >> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:530) >> at >> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:514) >> at >> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) >> at java.util.concurrent.FutureTask.run(FutureTask.java:166) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >> at java.lang.Thread.run(Thread.java:722) >> Caused by: java.net.SocketTimeoutException: Read timed out >> at java.net.SocketInputStream.socketRead0(Native Method) >> at java.net.SocketInputStream.read(SocketInputStream.java:150) >> at java.net.SocketInputStream.read(SocketInputStream.java:121) >> at sun.security.ssl.InputRecord.readFully(InputRecord.java:312) >> at sun.security.ssl.InputRecord.read(InputRecord.java:350) >> at >> sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:893) >> at >> sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:850) >> at sun.security.ssl.AppInputStream.read(AppInputStream.java:102) >> at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) >> at java.io.BufferedInputStream.read(BufferedInputStream.java:254) >> at >> org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78) >> at >> org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106) >> at >> org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116) >> at >> org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.re >> adLine(MultiThreadedHttpConnectionManager.java:1413) >> at >> org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973) >> at >> org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735) >> at >> org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098) >> at >> org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java >> :398) >> at >> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:17 >> 1) >> at >> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) >> at >> org.apache.axis2.transport.http.AbstractHTTPSender.executeMethod(AbstractHTTPSender.java: >> 622) >> at >> org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:193) >> ... 35 more >> >> >> Charitha Kankanamge >> cell: +1 812-391-7730 >> http://charithaka.blogspot.com >> *SOA and Testing without nonsense* >> >> >> On Mon, Mar 17, 2014 at 7:30 PM, Amila De Silva <ami...@wso2.com> wrote: >> >>> Hi, >>> >>> Got the following error[1] when invoking a BPEL workflow hosted by a >>> tenant. >>> When the BPEL workflow is invoked , it creates a HumanTask instance and >>> suspends until the task is completed. Upon completing the task, BPEL >>> resumes its execution and sends the outcome of the task to a callback >>> service. >>> The call back service is secured with Basic Authentication and the >>> credentials to invoke the service is provided in an .epr file which gets >>> deployed with the BPEL . While investigating the error it was found that >>> the Authorization header is not sent when the BPEL resumes and calls the >>> callback service. >>> >>> As per the current investigations the problem occurs due to the >>> following reasons. >>> >>> 1. When resuming the BPEL, at some point, UnifiedEndpointHandler reads >>> the .epr file get the credentials and create the Basic Authentication >>> header. This header is set to the messageContext using, >>> >>> msgContext.getOptions().setProperty(HTTPConstants.HTTP_HEADERS, headers); >>> >>> 2. Before sending the request out, CommonsHTTPTransportSender reads this >>> header from the message Context. >>> >>> Object httpHeadersObj = >>> msgContext.getProperty(HTTPConstants.HTTP_HEADERS); >>> >>> 3. If the BPEL is deployed in super.tenants space, by the time execution >>> reaches the TransportSender, the Header gets properly set into a property >>> in the messageContext. But in case of a tenant, this doesn't happen. >>> >>> One way to fix this would be to populate this Header within the >>> TenantTransportSender. The other way would be to locate the point where >>> this is done in the super tenants flow and incorporate that when invoking a >>> tenant's flow. >>> >>> [1] [2014-03-17 17:00:51,520] ERROR >>> {org.wso2.carbon.bpel.core.ode.integration.PartnerService} - Error sending >>> message to Axis2 for ODE mex {PartnerRoleMex#hqejbhcnphr94qgl0ib2e4 [PID { >>> http://workflow.application.apimgt.carbon.wso2.org}ApplicationApprovalWorkFlowProcess-2] >>> calling org.apache.ode.bpel.epr.WSAEndpoint@5e186a21.resumeEvent(...) >>> Status REQUEST} >>> org.apache.axis2.AxisFault: Transport error: 401 Error: Unauthorized >>> at >>> org.apache.axis2.transport.http.HTTPSender.handleResponse(HTTPSender.java:311) >>> at >>> org.apache.axis2.transport.http.HTTPSender.sendViaPost(HTTPSender.java:194) >>> at org.apache.axis2.transport.http.HTTPSender.send(HTTPSender.java:75) >>> at >>> org.apache.axis2.transport.http.CommonsHTTPTransportSender.writeMessageWithCommons(CommonsHTTPTransportSender.java:451) >>> at >>> org.apache.axis2.transport.http.CommonsHTTPTransportSender.invoke(CommonsHTTPTransportSender.java:278) >>> at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442) >>> at >>> org.wso2.carbon.core.multitenancy.transports.TenantTransportSender.invoke(TenantTransportSender.java:198) >>> at org.apache.axis2.engine.AxisEngine.send(AxisEngine.java:442) >>> at >>> org.apache.axis2.description.OutOnlyAxisOperationClient.executeImpl(OutOnlyAxisOperation.java:297) >>> at >>> org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) >>> at >>> org.wso2.carbon.bpel.core.ode.integration.utils.AxisServiceUtils.invokeService(AxisServiceUtils.java:305) >>> at >>> org.wso2.carbon.bpel.core.ode.integration.PartnerService.invoke(PartnerService.java:324) >>> at >>> org.wso2.carbon.bpel.core.ode.integration.BPELMessageExchangeContextImpl.invokePartner(BPELMessageExchangeContextImpl.java:43) >>> at >>> org.apache.ode.bpel.engine.BpelRuntimeContextImpl.invoke(BpelRuntimeContextImpl.java:793) >>> at org.apache.ode.bpel.runtime.INVOKE.run(INVOKE.java:130) >>> at sun.reflect.GeneratedMethodAccessor41.invoke(Unknown Source) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) >>> at java.lang.reflect.Method.invoke(Method.java:597) >>> at >>> org.apache.ode.jacob.vpu.JacobVPU$JacobThreadImpl.run(JacobVPU.java:451) >>> at org.apache.ode.jacob.vpu.JacobVPU.execute(JacobVPU.java:139) >>> at >>> org.apache.ode.bpel.engine.BpelRuntimeContextImpl.execute(BpelRuntimeContextImpl.java:898) >>> at >>> org.apache.ode.bpel.engine.PartnerLinkMyRoleImpl.invokeInstance(PartnerLinkMyRoleImpl.java:250) >>> at org.apache.ode.bpel.engine.BpelProcess$1.invoke(BpelProcess.java:288) >>> at >>> org.apache.ode.bpel.engine.BpelProcess.invokeProcess(BpelProcess.java:224) >>> at >>> org.apache.ode.bpel.engine.BpelProcess.invokeProcess(BpelProcess.java:279) >>> at >>> org.apache.ode.bpel.engine.BpelProcess.handleJobDetails(BpelProcess.java:434) >>> at >>> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:558) >>> at >>> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:467) >>> at >>> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:536) >>> at >>> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:530) >>> at >>> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:280) >>> at >>> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:235) >>> at >>> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:530) >>> at >>> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:514) >>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:138) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) >>> at java.lang.Thread.run(Thread.java:662) >>> >>> -- >>> *Amila De Silva* >>> >>> *Software Engineer* >>> WSO2 Inc. >>> mobile :(+94) 775119302 >>> >>> >>> _______________________________________________ >>> Dev mailing list >>> Dev@wso2.org >>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>> >>> >> > > > -- > *Amila De Silva* > > WSO2 Inc. > mobile :(+94) 775119302 > > > _______________________________________________ > Dev mailing list > Dev@wso2.org > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- *Asanthi Kulasinghe* WSO2 Inc; http://www.wso2.com/. Mobile: +94777355522
_______________________________________________ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
