It is like this. That's happened due to nested group with several
members.That's application deployment and un-deployement happen without of
a considerable wait time.

So if we have duplicate MemberActivateEvent , it can be triggered in any
occasion during the life cycle of the application. So if the
MemberActivateEvent event triggered in those sort of case,we can have a NPE
for the members.

Also this may not cause any issue with the single application deployment.
But with several deployment and un-deployments.

Thanks,
Gayan

On Tue, Oct 13, 2015 at 12:02 AM, Akila Ravihansa Perera <raviha...@wso2.com
> wrote:

> Hi Gayan,
>
> What additional threads? And where do they get created?
>
> Clearly, it should not be published twice, but I still don't understand
> what exactly goes wrong if it is published again.
>
> Thanks.
>
> On Mon, Oct 12, 2015 at 11:51 PM, Gayan Gunarathne <gay...@wso2.com>
> wrote:
>
>>
>> On Mon, Oct 12, 2015 at 9:59 PM, Akila Ravihansa Perera <
>> raviha...@wso2.com> wrote:
>>
>>> Hi Thanuja,
>>>
>>> Thanks for the update. It seems Stratos Jenkins build has returned to
>>> normal with your last commit [1]. So could this duplicate call to 
>>> sendMemberActivatedEvent()
>>> method have been the culprit all this time?
>>>
>>
>> We don't need to send the MemberActivatedEvent twice. Seems it leads to
>> create additional threads and those threads leads to this build failure.
>>
>>>
>>> @Reka: Autoscaler is listening to MemberActivated event and executing
>>> this logic at [2] for each event. Will it cause an issue if it is executed
>>> multiple times? I cannot think of any other place it could have caused any
>>> issue. Even TopologyHandler class used by integration tests do not listen
>>> to this event.
>>>
>>> [1] https://builds.apache.org/job/Stratos-41x-Commit-Build/87/
>>> [2]
>>> https://github.com/apache/stratos/blob/stratos-4.1.x/components/org.apache.stratos.autoscaler/src/main/java/org/apache/stratos/autoscaler/status/processor/cluster/ClusterStatusProcessorChain.java#L49
>>>
>>> Thanks.
>>>
>>>
>>> On Mon, Oct 12, 2015 at 9:28 PM, Thanuja Uruththirakodeeswaran <
>>> thanu...@wso2.com> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I did several builds with latest changes. Each local build triggered
>>>> successfully with no test failures. But there are RuntimeExceptions.
>>>> I tried following scenarios
>>>> 1. Reverted metering service changes as in commit [1] - build success
>>>> 2. Build stratos 4.1.x branch with latest commit [2] - build success
>>>> 3. Build stratos 4.1.x branch without latest commit [2] - tests failed
>>>>
>>>> For the 3rd scenario, I got test failures as below and I've attached
>>>> part of test log here:
>>>>
>>>>
>>>> Tests run: 21, Failures: 4, Errors: 0, Skipped: 0, Time elapsed:
>>>> 1,499.716 sec <<< FAILURE! - in TestSuite
>>>> testTerminationBehavior(org.apache.stratos.integration.tests.application.GroupStartupOrderTestCase)
>>>>  Time elapsed: 312.479 sec  <<< FAILURE!
>>>> java.lang.AssertionError:
>>>> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
>>>> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
>>>> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:33)
>>>> at
>>>> org.apache.stratos.integration.tests.application.GroupStartupOrderTestCase.assertCreationOfNodes(GroupStartupOrderTestCase.java:339)
>>>> at
>>>> org.apache.stratos.integration.tests.application.GroupStartupOrderTestCase.testTerminationBehavior(GroupStartupOrderTestCase.java:149)
>>>>
>>>> testApplication(org.apache.stratos.integration.tests.application.SampleApplicationStartupTestCase)
>>>>  Time elapsed: 0.351 sec  <<< FAILURE!
>>>> java.lang.AssertionError:
>>>> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
>>>> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
>>>> at org.testng.AssertJUnit.assertFalse(AssertJUnit.java:41)
>>>> at org.testng.AssertJUnit.assertFalse(AssertJUnit.java:49)
>>>> at
>>>> org.apache.stratos.integration.tests.application.SampleApplicationStartupTestCase.testApplication(SampleApplicationStartupTestCase.java:105)
>>>>
>>>> testApplicationList(org.apache.stratos.integration.tests.application.SampleApplicationsTestCase)
>>>>  Time elapsed: 1.032 sec  <<< FAILURE!
>>>> java.lang.AssertionError:
>>>> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
>>>> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
>>>> at org.testng.AssertJUnit.assertFalse(AssertJUnit.java:41)
>>>> at org.testng.AssertJUnit.assertFalse(AssertJUnit.java:49)
>>>> at
>>>> org.apache.stratos.integration.tests.application.SampleApplicationsTestCase.testApplicationList(SampleApplicationsTestCase.java:350)
>>>>
>>>> testApplicationBusting(org.apache.stratos.integration.tests.application.ApplicationBurstingTestCase)
>>>>  Time elapsed: 32.926 sec  <<< FAILURE!
>>>> java.lang.AssertionError:
>>>> at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
>>>> at org.testng.AssertJUnit.assertTrue(AssertJUnit.java:24)
>>>> at org.testng.AssertJUnit.assertFalse(AssertJUnit.java:41)
>>>> at org.testng.AssertJUnit.assertFalse(AssertJUnit.java:49)
>>>> at
>>>> org.apache.stratos.integration.tests.application.ApplicationBurstingTestCase.testApplicationBusting(ApplicationBurstingTestCase.java:138)
>>>>
>>>>
>>>> Results :
>>>>
>>>> Failed tests:
>>>>   ApplicationBurstingTestCase.testApplicationBusting:138
>>>>
>>>> GroupStartupOrderTestCase.testTerminationBehavior:149->assertCreationOfNodes:339
>>>>   SampleApplicationStartupTestCase.testApplication:105
>>>>   SampleApplicationsTestCase.testApplicationList:350
>>>>
>>>>
>>>>
>>>> Tests run: 21, Failures: 4, Errors: 0, Skipped: 0
>>>>
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Reactor Summary:
>>>> [INFO]
>>>> [INFO] Apache Stratos - Integration Aggregation Module ... SUCCESS
>>>> [1.360s]
>>>> [INFO] Apache Stratos - Integration Common Module ........ SUCCESS
>>>> [6.356s]
>>>> [INFO] Apache Stratos - Integration Tests ................ FAILURE
>>>> [25:05.695s]
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>>
>>>> I continuously ran more integration test on above scenarios and if I
>>>> get any different result, I'll update in this thread.
>>>>
>>>> [1].
>>>> https://github.com/Thanu/stratos/commit/631d1a1cc71ade793a6a6c59edabb34bd1594747
>>>> [2].
>>>> https://github.com/apache/stratos/commit/4bc27f29cb84d86fdaac554ca5a426cb0eb3776f
>>>>
>>>> Thanks.
>>>>
>>>> On Sun, Oct 11, 2015 at 6:29 PM, Gayan Gunarathne <gay...@wso2.com>
>>>> wrote:
>>>>
>>>>> Seems even application is terminated, some of the group monitors are
>>>>> still running. Mostly in the nested group scenario. Those group monitors
>>>>> looking for the application monitor that didn't exist at that time.So I
>>>>> think we need to recheck the logic of group monitor termination logic in
>>>>> the application un-deployment. Will check further on this.
>>>>>
>>>>> 2015-10-11 18:15:07 ERROR
>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:73 -
>>>>> Exception in thread "pool-39-thread-36" java.lang.NullPointerException
>>>>> 2015-10-11 18:15:07 ERROR
>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:73 
>>>>> -  at
>>>>> org.apache.stratos.autoscaler.monitor.component.GroupMonitor$1.run(GroupMonitor.java:163)
>>>>> 2015-10-11 18:15:07 ERROR
>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:73 
>>>>> -  at
>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>>> 2015-10-11 18:15:07 ERROR
>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:73 
>>>>> -  at
>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>> 2015-10-11 18:15:07 ERROR
>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:73 
>>>>> -  at
>>>>> java.lang.Thread.run(Thread.java:744)
>>>>> 2015-10-11 18:15:07 INFO
>>>>>  {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70 
>>>>> -
>>>>> [2015-10-11 18:15:07,285] DEBUG
>>>>> {org.apache.stratos.autoscaler.monitor.component.GroupMonitor} -  Group
>>>>> monitor is running: [group] my-group6-group-startup-order-test
>>>>>
>>>>> Thanks,
>>>>> Gayan
>>>>>
>>>>> On Sat, Oct 10, 2015 at 3:35 PM, Akila Ravihansa Perera <
>>>>> raviha...@wso2.com> wrote:
>>>>>
>>>>>> This is occurring frequently even in local build. I think this is a
>>>>>> blocker for 4.1.4 release.
>>>>>>
>>>>>> On Fri, Oct 9, 2015 at 9:20 PM, Imesh Gunaratne <im...@apache.org>
>>>>>> wrote:
>>>>>>
>>>>>>> Thanks Reka! It is important to identify the root cause of this
>>>>>>> issue. I'm also looking in.
>>>>>>>
>>>>>>> On Thu, Oct 8, 2015 at 6:13 PM, Reka Thirunavukkarasu <r...@wso2.com
>>>>>>> > wrote:
>>>>>>>
>>>>>>>> Hi
>>>>>>>>
>>>>>>>> After going through the logs of integration, please find the break
>>>>>>>> down as below. For my-group6-group-tom2-group-startup-order-test, it
>>>>>>>> seems that the Adder got triggered twice or somehow monitor creation 
>>>>>>>> got
>>>>>>>> triggered twice which cause the memory to inconsistent state. Hence the
>>>>>>>> particular GroupMonitor got removed somehow. So that the application
>>>>>>>> hierarchy was incomplete and application was unable to become active. 
>>>>>>>> I'm
>>>>>>>> still investigating on it to find out the root cause.
>>>>>>>>
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,504]  INFO
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.ParentComponentMonitor}
>>>>>>>>  -
>>>>>>>> Monitor scheduled: [type] cluster [component]
>>>>>>>> group-startup-order-test.my-group-tom2-tomcat2-group-startup-order-test.tomcat2-group-startup-order-test.domain
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,504] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.monitor.cluster.ClusterMonitor} -
>>>>>>>> ClusterMonitor task interval set to : [application-id] null [cluster]
>>>>>>>> group-startup-order-test.my-group7-tomcat-group-startup-order-test.tomcat-group-startup-order-test.domain
>>>>>>>> [monitor-interval] 90000
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,504]  INFO
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.ParentComponentMonitor}
>>>>>>>>  -
>>>>>>>> Starting monitor: [type] cluster [component]
>>>>>>>> group-startup-order-test.my-group-tom2-tomcat2-group-startup-order-test.tomcat2-group-startup-order-test.domain
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,504] ERROR
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.ParentComponentMonitor}
>>>>>>>>  -  An
>>>>>>>> error occurred while starting monitor: [type] group [component]
>>>>>>>> my-group6-group-tom2-group-startup-order-test
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> java.lang.NullPointerException
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> org.apache.stratos.autoscaler.monitor.Monitor.addInstance(Monitor.java:149)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> org.apache.stratos.autoscaler.monitor.component.GroupMonitor.createGroupInstanceAndAddToMonitor(GroupMonitor.java:816)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> org.apache.stratos.autoscaler.monitor.component.GroupMonitor.createInstanceAndStartDependencyAtStartup(GroupMonitor.java:898)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> org.apache.stratos.autoscaler.monitor.MonitorFactory.getGroupMonitor(MonitorFactory.java:161)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> org.apache.stratos.autoscaler.monitor.MonitorFactory.getMonitor(MonitorFactory.java:81)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> org.apache.stratos.autoscaler.monitor.component.ParentComponentMonitor$MonitorAdder.run(ParentComponentMonitor.java:1001)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at
>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>>     at java.lang.Thread.run(Thread.java:745)
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,505] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.GroupMonitor} -  Group
>>>>>>>> monitor is running: [group] 
>>>>>>>> my-group6-group-tom2-group-startup-order-test
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,504] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.context.partition.ParentLevelPartitionContext}
>>>>>>>> -  Instance expiry time is set to: 900000
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,505] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.context.partition.ParentLevelPartitionContext}
>>>>>>>> -  Instance obsolete expiry time is set to: 86400000
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,505] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.context.partition.ParentLevelPartitionContext}
>>>>>>>> -  Instance pending termination expiry time is set to: 1800000
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,505]  INFO
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.GroupMonitor} -
>>>>>>>> [Partition] partition-1has been added for the [Group]
>>>>>>>> my-group9-group-startup-order-test
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,505]  INFO
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.ParentComponentMonitor}
>>>>>>>>  -
>>>>>>>> Monitor started successfully: [type] group [component]
>>>>>>>> my-group6-group-tom2-group-startup-order-test [dependents] none
>>>>>>>> [startup-time] 0 seconds
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,505]  INFO
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.GroupMonitor} -  Group
>>>>>>>> [Instance context] group-startup-order-test-1 has been added to [Group]
>>>>>>>> my-group9-group-startup-order-test
>>>>>>>> 2015-10-08 13:49:52 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:49:52,505]  INFO
>>>>>>>> {org.apache.stratos.autoscaler.monitor.component.GroupMonitor} -  
>>>>>>>> Starting
>>>>>>>> the dependencies for the [Group] my-group9-group-startup-order-test
>>>>>>>>
>>>>>>>> --------------------------------------
>>>>>>>>
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.status.processor.group.GroupStatusProcessor}
>>>>>>>> -  Checking the status of cluster
>>>>>>>> group-startup-order-test.my-group-tom2-tomcat3-group-startup-order-test.tomcat3-group-startup-order-test.domain
>>>>>>>> instance status is: Active
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.status.processor.group.GroupStatusProcessor}
>>>>>>>> -  Checking the status of cluster
>>>>>>>> group-startup-order-test.my-group-tom2-tomcat2-group-startup-order-test.tomcat2-group-startup-order-test.domain
>>>>>>>> instance status is: Active
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100] DEBUG
>>>>>>>> {org.apache.stratos.cloud.controller.messaging.topology.TopologyManager}
>>>>>>>>  -
>>>>>>>> Write lock released
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100]  INFO
>>>>>>>> {org.apache.stratos.autoscaler.status.processor.group.GroupStatusActiveProcessor}
>>>>>>>> -  Sending group instance active for [group]
>>>>>>>> my-group6-group-tom2-group-startup-order-test [instance]
>>>>>>>> group-startup-order-test-1
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100] DEBUG
>>>>>>>> {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -
>>>>>>>> Handling group activation for the [group-id]:
>>>>>>>> my-group6-group-tom2-group-startup-order-test in the [application-id]
>>>>>>>> group-startup-order-test [instance] group-startup-order-test-1
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100] DEBUG
>>>>>>>> {org.apache.stratos.cloud.controller.messaging.topology.TopologyManager}
>>>>>>>>  -
>>>>>>>> Write lock acquired
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100]  WARN
>>>>>>>> {org.apache.stratos.autoscaler.applications.topic.ApplicationBuilder} -
>>>>>>>> Group monitor cannot be found: [group-id]
>>>>>>>> my-group6-group-tom2-group-startup-order-test [application-id]
>>>>>>>> group-startup-order-test
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100]  INFO
>>>>>>>> {org.apache.stratos.cloud.controller.messaging.topology.TopologyBuilder}
>>>>>>>>  -
>>>>>>>> Cluster activated adding status started for
>>>>>>>> group-startup-order-test.my-group-tom2-tomcat3-group-startup-order-test.tomcat3-group-startup-order-test.domain
>>>>>>>> 2015-10-08 13:51:19 INFO
>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>  -
>>>>>>>> [2015-10-08 13:51:19,100] DEBUG
>>>>>>>> {org.apache.stratos.cloud.controller.messaging.topology.TopologyManager}
>>>>>>>>  -
>>>>>>>> Updating topology
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Reka
>>>>>>>>
>>>>>>>>
>>>>>>>> On Thu, Oct 8, 2015 at 4:47 PM, Reka Thirunavukkarasu <
>>>>>>>> r...@wso2.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Akila
>>>>>>>>>
>>>>>>>>> On Thu, Oct 8, 2015 at 2:51 PM, Akila Ravihansa Perera <
>>>>>>>>> raviha...@wso2.com> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Thanuja,
>>>>>>>>>>
>>>>>>>>>> I was referring to the build fail in [1]. Please see line
>>>>>>>>>> starting from:
>>>>>>>>>>
>>>>>>>>>> 2015-10-02 07:28:32 INFO
>>>>>>>>>>  
>>>>>>>>>> {org.wso2.carbon.automation.extensions.servers.utils.ServerLogReader}:70
>>>>>>>>>>  -
>>>>>>>>>> [2015-10-02 07:28:32,834] ERROR
>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -  Cannot 
>>>>>>>>>> terminate
>>>>>>>>>> instance
>>>>>>>>>>
>>>>>>>>>> I think this is a separate issue that occurs very rarely. As you
>>>>>>>>>> noticed, NPE in GroupMonitor occurs when undeploying applications. 
>>>>>>>>>> The
>>>>>>>>>> problem is group monitors are retrieving the status from other group
>>>>>>>>>> monitor objects.
>>>>>>>>>>
>>>>>>>>>> @Reka: shall we change that logic to read the application status
>>>>>>>>>> from topology or ApplicationHolder instead of reading from monitors?
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> We can't read the Application status from Topology as Application
>>>>>>>>> will not contain any status rather only application instance will 
>>>>>>>>> contain
>>>>>>>>> the status. By accessing application instance, we can't identify 
>>>>>>>>> whether
>>>>>>>>> undeployment or force undeployment is in-progress. Hence we will have 
>>>>>>>>> to
>>>>>>>>> maintain these flags to ApplicationMonitor to identity the 
>>>>>>>>> undeployment or
>>>>>>>>> force undeployment. All other status are actually referring from the
>>>>>>>>> Topology.
>>>>>>>>>
>>>>>>>>> Thanks,
>>>>>>>>> Reka
>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> [1]
>>>>>>>>>> https://builds.apache.org/job/Stratos-41x-Commit-Build/68/consoleFull
>>>>>>>>>>
>>>>>>>>>> Thanks.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Reka Thirunavukkarasu
>>>>>>>>> Senior Software Engineer,
>>>>>>>>> WSO2, Inc.:http://wso2.com,
>>>>>>>>> Mobile: +94776442007
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Reka Thirunavukkarasu
>>>>>>>> Senior Software Engineer,
>>>>>>>> WSO2, Inc.:http://wso2.com,
>>>>>>>> Mobile: +94776442007
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Imesh Gunaratne
>>>>>>>
>>>>>>> Senior Technical Lead, WSO2
>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Akila Ravihansa Perera
>>>>>> WSO2 Inc.;  http://wso2.com/
>>>>>>
>>>>>> Blog: http://ravihansa3000.blogspot.com
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Gayan Gunarathne
>>>>> Technical Lead, WSO2 Inc. (http://wso2.com)
>>>>> Committer & PMC Member, Apache Stratos
>>>>> email : gay...@wso2.com  | mobile : +94 775030545 <%2B94%20766819985>
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Thanuja Uruththirakodeeswaran
>>>> Software Engineer
>>>> WSO2 Inc.;http://wso2.com
>>>> lean.enterprise.middleware
>>>>
>>>> mobile: +94 774363167
>>>>
>>>
>>>
>>>
>>> --
>>> Akila Ravihansa Perera
>>> WSO2 Inc.;  http://wso2.com/
>>>
>>> Blog: http://ravihansa3000.blogspot.com
>>>
>>
>>
>>
>> --
>>
>> Gayan Gunarathne
>> Technical Lead, WSO2 Inc. (http://wso2.com)
>> Committer & PMC Member, Apache Stratos
>> email : gay...@wso2.com  | mobile : +94 775030545 <%2B94%20766819985>
>>
>>
>>
>
>
>
> --
> Akila Ravihansa Perera
> WSO2 Inc.;  http://wso2.com/
>
> Blog: http://ravihansa3000.blogspot.com
>



-- 

Gayan Gunarathne
Technical Lead, WSO2 Inc. (http://wso2.com)
Committer & PMC Member, Apache Stratos
email : gay...@wso2.com  | mobile : +94 775030545 <%2B94%20766819985>

Reply via email to