Udara Liyanage created STRATOS-941: -------------------------------------- Summary: Error while undeploying application Key: STRATOS-941 URL: https://issues.apache.org/jira/browse/STRATOS-941 Project: Stratos Issue Type: Bug Reporter: Udara Liyanage
[2014-11-07 12:16:17,328] INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} - Un-deploying the [application] mysql-onlyby marking it as terminating.. [2014-11-07 12:16:17,329] INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} - Applicationmysql-only updated as terminating [2014-11-07 12:16:17,329] INFO {org.apache.stratos.autoscaler.monitor.application.ApplicationMonitor} - [ApplicationMonitor] mysql-only state changes from Created to Terminating [2014-11-07 12:16:17,331] INFO {org.apache.stratos.autoscaler.event.publisher.ClusterStatusEventPublisher} - Publishing Cluster Terminating event for [application]: null [cluster]: mymysql.mysql.domain [2014-11-07 12:16:17,347] INFO {org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager} - Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from [ Created ] to [ Terminating ] [2014-11-07 12:16:17,364] INFO {org.apache.stratos.autoscaler.applications.topic.ApplicationsEventPublisher} - Publishing Application terminated event for [application]: mysql-only [2014-11-07 12:16:17,378] ERROR {org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator} - Failed to retrieve application status event message java.lang.RuntimeException: Failed to process message using available message processors: [type] org.apache.stratos.messaging.event.applications.ApplicationTerminatingEvent [body] {"appId":"mysql-only"} at org.apache.stratos.messaging.message.processor.applications.ApplicationUndeployedMessageProcessor.process(ApplicationUndeployedMessageProcessor.java:93) at org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatedMessageProcessor.process(ApplicationTerminatedMessageProcessor.java:85) at org.apache.stratos.messaging.message.processor.applications.CompleteApplicationsMessageProcessor.process(CompleteApplicationsMessageProcessor.java:69) at org.apache.stratos.messaging.message.processor.applications.ApplicationTerminatingMessageProcessor.process(ApplicationTerminatingMessageProcessor.java:72) at org.apache.stratos.messaging.message.processor.applications.ApplicationInactivatedMessageProcessor.process(ApplicationInactivatedMessageProcessor.java:72) at org.apache.stratos.messaging.message.processor.applications.ApplicationCreatedMessageProcessor.process(ApplicationCreatedMessageProcessor.java:67) at org.apache.stratos.messaging.message.processor.applications.ApplicationActivatedMessageProcessor.process(ApplicationActivatedMessageProcessor.java:72) at org.apache.stratos.messaging.message.processor.applications.GroupTerminatingProcessor.process(GroupTerminatingProcessor.java:69) at org.apache.stratos.messaging.message.processor.applications.GroupTerminatedProcessor.process(GroupTerminatedProcessor.java:69) at org.apache.stratos.messaging.message.processor.applications.GroupInActivateProcessor.process(GroupInActivateProcessor.java:69) at org.apache.stratos.messaging.message.processor.applications.GroupActivatedProcessor.process(GroupActivatedProcessor.java:69) at org.apache.stratos.messaging.message.processor.applications.GroupResetProcessor.process(GroupResetProcessor.java:69) at org.apache.stratos.messaging.message.processor.MessageProcessorChain.process(MessageProcessorChain.java:60) at org.apache.stratos.messaging.message.receiver.applications.ApplicationsEventMessageDelegator.run(ApplicationsEventMessageDelegator.java:71) at java.lang.Thread.run(Thread.java:662) [2014-11-07 12:16:17,445] INFO {org.apache.stratos.cloud.controller.topology.TopologyEventPublisher} - Publishing Cluster terminating event: [appId] null [cluster id] mymysql.mysql.domain [2014-11-07 12:16:17,458] INFO {org.apache.stratos.messaging.domain.topology.lifecycle.LifeCycleStateManager} - Topology element [ mymysql.mysql.domain ]'s life Cycle State changed from [ Created ] to [ Terminating ] [2014-11-07 12:16:17,460] INFO {org.apache.stratos.autoscaler.event.receiver.topology.AutoscalerTopologyEventReceiver} - [ClusterTerminatingEvent] Received: class org.apache.stratos.messaging.event.topology.ClusterTerminatingEvent [2014-11-07 12:16:17,461] INFO {org.apache.stratos.autoscaler.monitor.cluster.AbstractClusterMonitor} - [Cluster] mymysql.mysql.domain is not notifying the parent, since it is in Terminating State [2014-11-07 12:16:17,469] INFO {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} - Starting to terminate all members in Network Partition [ ec2 ], Partition [ p1 ] [2014-11-07 12:16:17,469] INFO {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} - Terminating pending member [member id] mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 [2014-11-07 12:16:17,469] INFO {org.apache.stratos.autoscaler.client.CloudControllerClient} - Terminating instance via cloud controller: [member] mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 [2014-11-07 12:16:17,481] ERROR {org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl} - Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 [2014-11-07 12:16:17,482] ERROR {org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver} - Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 org.apache.stratos.cloud.controller.exception.InvalidMemberException: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 at org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl.terminateInstance(CloudControllerServiceImpl.java:619) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.axis2.rpc.receivers.RPCUtil.invokeServiceClass(RPCUtil.java:212) at org.apache.axis2.rpc.receivers.RPCInOnlyMessageReceiver.invokeBusinessLogic(RPCInOnlyMessageReceiver.java:66) at org.apache.axis2.receivers.AbstractMessageReceiver.receive(AbstractMessageReceiver.java:110) at org.apache.axis2.engine.AxisEngine.receive(AxisEngine.java:180) at org.apache.axis2.transport.http.HTTPTransportUtils.processHTTPPostRequest(HTTPTransportUtils.java:172) at org.apache.axis2.transport.http.AxisServlet.doPost(AxisServlet.java:146) at org.wso2.carbon.core.transports.CarbonServlet.doPost(CarbonServlet.java:231) at javax.servlet.http.HttpServlet.service(HttpServlet.java:755) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.equinox.http.servlet.internal.ServletRegistration.service(ServletRegistration.java:61) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.processAlias(ProxyServlet.java:128) at org.eclipse.equinox.http.servlet.internal.ProxyServlet.service(ProxyServlet.java:68) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.wso2.carbon.tomcat.ext.servlet.DelegationServlet.service(DelegationServlet.java:68) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.wso2.carbon.tomcat.ext.filter.CharacterSetFilter.doFilter(CharacterSetFilter.java:61) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:99) at org.wso2.carbon.tomcat.ext.valves.CompositeValve.continueInvocation(CompositeValve.java:178) at org.wso2.carbon.tomcat.ext.valves.CarbonTomcatValve$1.invoke(CarbonTomcatValve.java:47) at org.wso2.carbon.webapp.mgt.TenantLazyLoaderValve.invoke(TenantLazyLoaderValve.java:56) at org.wso2.carbon.tomcat.ext.valves.TomcatValveContainer.invokeValves(TomcatValveContainer.java:47) at org.wso2.carbon.tomcat.ext.valves.CompositeValve.invoke(CompositeValve.java:141) at org.wso2.carbon.tomcat.ext.valves.CarbonStuckThreadDetectionValve.invoke(CarbonStuckThreadDetectionValve.java:156) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:936) at org.wso2.carbon.tomcat.ext.valves.CarbonContextCreatorValve.invoke(CarbonContextCreatorValve.java:52) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1004) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1653) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918) at java.lang.Thread.run(Thread.java:662) [2014-11-07 12:16:17,515] ERROR {org.apache.stratos.autoscaler.client.CloudControllerClient} - Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 org.apache.axis2.AxisFault: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 at org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531) at org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91) at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445) at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225) at org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) at org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.terminateInstance(CloudControllerServiceStub.java:1832) at org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:250) at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.terminateMember(VMClusterMonitor.java:714) at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.access$100(VMClusterMonitor.java:55) at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor$1.run(VMClusterMonitor.java:693) at java.lang.Thread.run(Thread.java:662) [2014-11-07 12:16:17,516] ERROR {org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor} - Unable to terminate member [member id ] mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 org.apache.stratos.autoscaler.exception.TerminationException: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 at org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:258) at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.terminateMember(VMClusterMonitor.java:714) at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor.access$100(VMClusterMonitor.java:55) at org.apache.stratos.autoscaler.monitor.cluster.VMClusterMonitor$1.run(VMClusterMonitor.java:693) at java.lang.Thread.run(Thread.java:662) Caused by: org.apache.axis2.AxisFault: Termination failed. Invalid Member Id: mymysql.mysql.domain980d95d4-1117-45ec-93b8-b54961c6f145 at org.apache.axis2.util.Utils.getInboundFaultFromMessageContext(Utils.java:531) at org.apache.axis2.description.RobustOutOnlyAxisOperation$RobustOutOnlyOperationClient.handleResponse(RobustOutOnlyAxisOperation.java:91) at org.apache.axis2.description.OutInAxisOperationClient.send(OutInAxisOperation.java:445) at org.apache.axis2.description.OutInAxisOperationClient.executeImpl(OutInAxisOperation.java:225) at org.apache.axis2.client.OperationClient.execute(OperationClient.java:149) at org.apache.stratos.cloud.controller.stub.CloudControllerServiceStub.terminateInstance(CloudControllerServiceStub.java:1832) at org.apache.stratos.autoscaler.client.CloudControllerClient.terminate(CloudControllerClient.java:250) ... 4 more -- This message was sent by Atlassian JIRA (v6.3.4#6332)