I'd rather keep it simple Akila (this would complex the scenario of second
derivative too) :-) Isn't it?
On Thu, Nov 6, 2014 at 9:03 AM, Akila Ravihansa Perera <raviha...@wso2.com>
wrote:
> Until t2 - t1 > 1
>
> On Thu, Nov 6, 2014 at 12:50 AM, Nirmal Fernando <nirmal070...@gmail.com>
> wrote:
>
>>
>>
>> On Thu, Nov 6, 2014 at 8:33 AM, Akila Ravihansa Perera <
>> raviha...@wso2.com> wrote:
>>
>>> Thanks for the explanation, Nirmal. It makes sense now.
>>>
>>> Perhaps as an alternative solution, window processor can be set to wait
>>> until sufficient events have arrived to calculate the gradient?
>>>
>>
>> What would be the sufficient value? Theoretically in gradient case it's
>> 2, in second derivative case it's 3. And we're doing that already.
>>
>>>
>>> On Wed, Nov 5, 2014 at 11:48 PM, Rajkumar Rajaratnam <rajkum...@wso2.com
>>> > wrote:
>>>
>>>> In other words, fix reduces the risks which are coming from bad samples.
>>>>
>>>> On Thu, Nov 6, 2014 at 12:08 PM, Rajkumar Rajaratnam <
>>>> rajkum...@wso2.com> wrote:
>>>>
>>>>>
>>>>>
>>>>> On Thu, Nov 6, 2014 at 11:38 AM, Imesh Gunaratne <im...@apache.org>
>>>>> wrote:
>>>>>
>>>>>> On Thu, Nov 6, 2014 at 9:22 AM, Rajkumar Rajaratnam <
>>>>>> rajkum...@wso2.com> wrote:
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> No Imesh. There are no difference between *taking the the
>>>>>>> difference and dividing it by 1000* and *dividing it by 1000 and
>>>>>>> taking the difference*.
>>>>>>>
>>>>>>
>>>>>> Raj: I agree, in this scenario it makes no difference, however when
>>>>>> we are applying a fomular the unit conversion should happen prior to
>>>>>> applying values.
>>>>>>
>>>>>
>>>>> Not exactly Imesh. We can do operations if operands are in the same
>>>>> units. So we can do subtract operation in milliseconds. And then we can do
>>>>> division operation to make it in seconds. On the other hand, we can do a
>>>>> division operation to make each operands to seconds, then since both are
>>>>> seconds, we can do a subtract operation. So we can apply the formula if
>>>>> operands are in same unit. I guess this is same for all scenarios.
>>>>>
>>>>>
>>>>>> Still I see a problem with this correction, take the same example:
>>>>>> Gradient: -999.9999999999998 Last val: 7.000000000000001 First val:
>>>>>> 12.0 Time Gap: 5 t1: 1415213232152 t2: 1415213232157
>>>>>>
>>>>>> *Manual calulation:*
>>>>>> The value difference: 7 - 12 = -5
>>>>>> Time difference: 1415213232157 - 1415213232152 = 5 ms => 5/1000 =
>>>>>> 0.005 sec
>>>>>> *Gradient = - 5/0.005 = -1000*
>>>>>>
>>>>>> *According to the current fix:*
>>>>>> long millisecondsForASecond = 1000;
>>>>>> long tGap = t2 - t1 > millisecondsForASecond ? t2 - t1 :
>>>>>> millisecondsForASecond;
>>>>>> double gradient = 0.0;
>>>>>> if (tGap > 0) {
>>>>>> gradient = ((lastVal - firstVal) *
>>>>>> millisecondsForASecond) / tGap;
>>>>>> }
>>>>>>
>>>>>> t1: 1415213232152 t2: 1415213232157 firstVal: 12 lastVall: 7
>>>>>> Gradient = -5 * 1000 / 1000 = - 5
>>>>>>
>>>>>
>>>>> IMO, this is a sufficient solution.
>>>>>
>>>>> Let me explain how I see Nirmal's solution.
>>>>>
>>>>> We are taking only first and last values in a window for gradient
>>>>> calculation. If there are more events in that window, and if that is a
>>>>> good
>>>>> sample, tGap will be taking some higher values than 1s. This is usual
>>>>> situation. Nirmal's fix is nothing to do with this scenario.
>>>>>
>>>>> If there are few events in that window(say only 2), they can be really
>>>>> nearer. So there is a possibility that tGap can take a value near to 0. In
>>>>> that case gradient will be a very big value. Hence, if the tGap is very
>>>>> low
>>>>> (less than 1 second), then we can assume that the first and last events
>>>>> actually occurred in 1 second gap. The reason why tGap is less than 0 is,
>>>>> there are only few events in that window, and that sample is not good
>>>>> enough. But this a rare situation, it can only happen once in a while.
>>>>> Nirmal's fix is only dealing with this scenario. Fix imposes a lower limit
>>>>> in the time interval between two events. This fix is really important to
>>>>> deal with samples which are not good enough.
>>>>>
>>>>> By previous formula, we get -1000. This happened because the sample is
>>>>> not good enough (may be there are few events). Fix makes it to -5.
>>>>>
>>>>> So my understanding is that the solution is good enough for now.
>>>>>
>>>>> Thanks.
>>>>>
>>>>>>
>>>>>> Nirmal: Can you please justify this?
>>>>>>
>>>>>> Thanks
>>>>>>
>>>>>> On Thu, Nov 6, 2014 at 11:31 AM, Nirmal Fernando <
>>>>>> nirmal070...@gmail.com> wrote:
>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Thu, Nov 6, 2014 at 6:05 AM, Gayan Gunarathne <gay...@wso2.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> AFAIU this is not related with the gradient calculation formula
>>>>>>>> that we used. But It is related with the how we calculate gradient
>>>>>>>> when the
>>>>>>>> denominator become a small number.IMO when the divisor (timeInSeconds)
>>>>>>>> approaches to the small number we do need to normalize the result.
>>>>>>>>
>>>>>>>> IMO we do have max and min scale up and down values. So based on
>>>>>>>> that we can calculate the gradient on that value range.Simply if the
>>>>>>>> denominator approaches zero result approaches to infinity.
>>>>>>>>
>>>>>>>> I think that's what Nirmal doing here by making the lower threshold
>>>>>>>> as "millisecondsForASecond"
>>>>>>>>
>>>>>>>
>>>>>>> You got it! thanks.
>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> long tGap = t2 - t1 > millisecondsForASecond ? t2 - t1 :
>>>>>>>> millisecondsForASecond;
>>>>>>>> double gradient = 0.0;
>>>>>>>> if (tGap > 0) {
>>>>>>>> gradient = ((lastVal - firstVal) *
>>>>>>>> millisecondsForASecond) / tGap;
>>>>>>>> }
>>>>>>>>
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>> Gayan
>>>>>>>>
>>>>>>>> On Thu, Nov 6, 2014 at 9:22 AM, Rajkumar Rajaratnam <
>>>>>>>> rajkum...@wso2.com> wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> On Thu, Nov 6, 2014 at 9:03 AM, Imesh Gunaratne <im...@apache.org>
>>>>>>>>> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Nirmal,
>>>>>>>>>>
>>>>>>>>>> I do not think the milliseconds to seconds convertion is correct
>>>>>>>>>> here.
>>>>>>>>>>
>>>>>>>>>> As I see we are taking the difference of two timestamp values and
>>>>>>>>>> then dividing it by 1000. The corect way might be to first divide
>>>>>>>>>> each
>>>>>>>>>> value by 1000 and then take the difference.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> No Imesh. There are no difference between *taking the the
>>>>>>>>> difference and dividing it by 1000* and *dividing it by 1000 and
>>>>>>>>> taking the difference*.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> On the other hand we might not need to convert these values to
>>>>>>>>>> seconds since we are taking a time difference and calculating a
>>>>>>>>>> gradient.
>>>>>>>>>>
>>>>>>>>>> I did a quick test with the following sample:
>>>>>>>>>> Gradient: -999.9999999999998 Last val: 7.000000000000001 First
>>>>>>>>>> val: 12.0 Time Gap: 5 t1: 1415213232152 t2: 1415213232157
>>>>>>>>>>
>>>>>>>>>> *According previous code:*
>>>>>>>>>> long tGap = t2 - t1;
>>>>>>>>>> double gradient = 0.0;
>>>>>>>>>> if (tGap > 0) {
>>>>>>>>>> gradient = ((lastVal - firstVal) * 1000) / tGap;
>>>>>>>>>> }
>>>>>>>>>>
>>>>>>>>>> t1: 1415213232152 t2: 1415213232157 firstVal: 12 lastVall: 7
>>>>>>>>>> gradient: -1000.0
>>>>>>>>>>
>>>>>>>>>> *According to your fix:*
>>>>>>>>>> long millisecondsForASecond = 1000;
>>>>>>>>>> long tGap = t2 - t1 > millisecondsForASecond ? t2 - t1 :
>>>>>>>>>> millisecondsForASecond;
>>>>>>>>>> double gradient = 0.0;
>>>>>>>>>> if (tGap > 0) {
>>>>>>>>>> gradient = ((lastVal - firstVal) *
>>>>>>>>>> millisecondsForASecond) / tGap;
>>>>>>>>>> }
>>>>>>>>>>
>>>>>>>>>> t1: 1415213232152 t2: 1415213232157 firstVal: 12 lastVall: 7
>>>>>>>>>> gradient: -5.0
>>>>>>>>>>
>>>>>>>>>> *According to an online gradient calculator:*
>>>>>>>>>> gradient: -1
>>>>>>>>>>
>>>>>>>>>> http://www.calculator.net/slope-calculator.html?type=1&x11=1415213232152&y11=12&x12=1415213232157&y12=7&x=27&y=19
>>>>>>>>>>
>>>>>>>>>> According to the online gradient calculator (assuming their
>>>>>>>>>> calculation is correct), the calculation in your fix is not correct.
>>>>>>>>>> I
>>>>>>>>>> believe the logic should be simple as follows:
>>>>>>>>>>
>>>>>>>>>> long tGap = t2 - t1;
>>>>>>>>>> double gradient = 0.0;
>>>>>>>>>> if (tGap > 0) {
>>>>>>>>>> gradient = ((lastVal - firstVal)) / tGap;
>>>>>>>>>> }
>>>>>>>>>>
>>>>>>>>>> t1: 1415213232152 t2: 1415213232157 firstVal: 12 lastVall: 7
>>>>>>>>>> gradient: -1.0
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> And AFAIK, standard way to calculate gradient =
>>>>>>>>> (v1-v2)/timeInSeconds.
>>>>>>>>>
>>>>>>>>> Well, we can divide it by what ever time units we wants, but the
>>>>>>>>> result's unit will be different.
>>>>>>>>>
>>>>>>>>> In Nirmal's case, he get will get *stats/seconds*. In your case,
>>>>>>>>> you will get *stats/milliseconds*
>>>>>>>>>
>>>>>>>>> And AS prediction is based on *seconds*, CEP should use *seconds*
>>>>>>>>> for the calculation.
>>>>>>>>>
>>>>>>>>> wdyt?
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>> Thanks
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> On Thu, Nov 6, 2014 at 1:32 AM, Nirmal Fernando <
>>>>>>>>>> nirmal070...@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi Guys,
>>>>>>>>>>>
>>>>>>>>>>> So, I got a chance to reproduce and analyze this issue.
>>>>>>>>>>>
>>>>>>>>>>> How we calculate gradient of two events?
>>>>>>>>>>>
>>>>>>>>>>> Say the events are; e1(t1,v1) and e2(t2,v2)
>>>>>>>>>>>
>>>>>>>>>>> tx - time in *milliseconds* when xth event occurred
>>>>>>>>>>> vx - value (memory, cpu etc.) that xth event carries
>>>>>>>>>>>
>>>>>>>>>>> *time gap = t(2-1) = t2 -t1 milliseconds*
>>>>>>>>>>> time gap in seconds = t(2-1) = (t2 - t1)/1000 seconds
>>>>>>>>>>>
>>>>>>>>>>> Hence,
>>>>>>>>>>> *Gradient = (v2 - v1) / t(2-1) = ( (v2 - v1) * 1000 ) / (t2 -
>>>>>>>>>>> t1)*
>>>>>>>>>>>
>>>>>>>>>>> I've enabled debug logs for CEP extension;
>>>>>>>>>>>
>>>>>>>>>>> log4j.logger.org.apache.stratos.cep.extension=DEBUG
>>>>>>>>>>>
>>>>>>>>>>> Please find the following 3 logs extracted from the debug logs;
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> ===================================================================
>>>>>>>>>>> TID: [0] [STRATOS] [2014-11-05 19:47:27,073] DEBUG
>>>>>>>>>>> {org.apache.stratos.cep.extension.SecondDerivativeFinderWindowProcessor}
>>>>>>>>>>> -
>>>>>>>>>>> Gradient: -0.1996007984031936 Last val: 9.0 First val: 12.0 *Time
>>>>>>>>>>> Gap: 15030* t1: 1415213202095 t2: 1415213217125 hash: 155426542
>>>>>>>>>>>
>>>>>>>>>>> TID: [0] [STRATOS] [2014-11-05 19:47:27,073] DEBUG
>>>>>>>>>>> {org.apache.stratos.cep.extension.SecondDerivativeFinderWindowProcessor}
>>>>>>>>>>> - Gradient:
>>>>>>>>>>> -999.9999999999998 Last val: 7.000000000000001 First val: 12.0 *Time
>>>>>>>>>>> Gap: 5* t1: 1415213232152 t2: 1415213232157 hash: 155426542
>>>>>>>>>>>
>>>>>>>>>>> TID: [0] [STRATOS] [2014-11-05 19:47:27,074] DEBUG
>>>>>>>>>>> {org.apache.stratos.cep.extension.SecondDerivativeFinderWindowProcessor}
>>>>>>>>>>> -
>>>>>>>>>>> Gradient: -44.34884666437174 Last val: -999.9999999999998 First
>>>>>>>>>>> val:
>>>>>>>>>>> -0.1996007984031936 *Time Gap: 22544* t1: 1415213209610 t2:
>>>>>>>>>>> 1415213232154 hash: 155426542
>>>>>>>>>>>
>>>>>>>>>>> ===================================================================
>>>>>>>>>>>
>>>>>>>>>>> So, as you can see the reason behind a large value is when the
>>>>>>>>>>> time gap between two subjected events is less than 1 second. This
>>>>>>>>>>> could
>>>>>>>>>>> happen since events are coming from different asynchronous agents
>>>>>>>>>>> and also
>>>>>>>>>>> when there are less number of events.
>>>>>>>>>>>
>>>>>>>>>>> So, the fix I propose is a very simple one and it will not
>>>>>>>>>>> compromise anything AFAIS.
>>>>>>>>>>>
>>>>>>>>>>> Fix is to calculate time gap as follows;
>>>>>>>>>>> *____
>>>>>>>>>>> t2 - t1*
>>>>>>>>>>> *| yes?*
>>>>>>>>>>> *time gap = t(2-1) = t2 -t1 > 1000 ---*
>>>>>>>>>>> *|____
>>>>>>>>>>> 1000*
>>>>>>>>>>>
>>>>>>>>>>> I have tested this and works fine.
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> ---------- Forwarded message ----------
>>>>>>>>>>> From: Manula Chathurika Thantriwatte <manu...@wso2.com>
>>>>>>>>>>> Date: Tue, Oct 28, 2014 at 5:16 AM
>>>>>>>>>>> Subject: Re: CEP sends very large values for gradient and second
>>>>>>>>>>> derivative of load average
>>>>>>>>>>> To: "dev@stratos.apache.org" <dev@stratos.apache.org>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Hi Raj,
>>>>>>>>>>>
>>>>>>>>>>> Yes it has. But it's very easy to find the values from the agent
>>>>>>>>>>> with the time stamp. Then we can search that time stamp in the CEP
>>>>>>>>>>> trace
>>>>>>>>>>> logs and compare the summarized values.
>>>>>>>>>>>
>>>>>>>>>>> Thanks !
>>>>>>>>>>>
>>>>>>>>>>> On Mon, Oct 27, 2014 at 9:23 PM, Rajkumar Rajaratnam <
>>>>>>>>>>> rajkum...@wso2.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Mon, Oct 27, 2014 at 7:56 PM, Manula Chathurika Thantriwatte
>>>>>>>>>>>> <manu...@wso2.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Raj,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Shall we enable the cartridge agent debug logs. Then we can
>>>>>>>>>>>>> compare both CEP and agent logs with the time stamp. Then we can
>>>>>>>>>>>>> narrow
>>>>>>>>>>>>> down where the actual problem is.
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Manula, cep-trace log have the values sent by cartridge agent
>>>>>>>>>>>> also right?
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks !
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Mon, Oct 27, 2014 at 5:06 PM, Rajkumar Rajaratnam <
>>>>>>>>>>>>> rajkum...@wso2.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Mon, Oct 27, 2014 at 12:53 PM, Manula Chathurika
>>>>>>>>>>>>>> Thantriwatte <manu...@wso2.com> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Hi Raj,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Is this happen frequently or intermittently ? Once I go
>>>>>>>>>>>>>>> though the logs I'm unable to find the high input values for
>>>>>>>>>>>>>>> load average.
>>>>>>>>>>>>>>> But output have high values.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> 22:10:38,698 [-] [Siddhi-Scheduler-pool-10-thread-1] INFO
>>>>>>>>>>>>>>> EVENT_TRACE_LOGGER TenantId=-1234 : Output Event Adaptor :
>>>>>>>>>>>>>>> JMSOutputAdaptor, sent
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> {"org.apache.stratos.messaging.event.health.stat.SecondDerivativeOfLoadAverageEvent":{"message":{"clusterId":"php.php.domain","networkPartitionId":"","value":"2000000.0"}}}
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> This is happening intermittently. Experienced now too. This
>>>>>>>>>>>>>> is a serious issue. We need to somehow sort this out.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Also networkPartitionId is empty. In the current execution
>>>>>>>>>>>>>>> plans it took networkPartitionId for the calculation. IMO we
>>>>>>>>>>>>>>> need to update
>>>>>>>>>>>>>>> the CEP execution plans for 4.1.0.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Thanks !
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Sun, Oct 26, 2014 at 8:49 AM, Manula Chathurika
>>>>>>>>>>>>>>> Thantriwatte <manu...@wso2.com> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks Raj. I'll go through them.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Thanks !
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Sun, Oct 26, 2014 at 8:33 AM, Rajkumar Rajaratnam <
>>>>>>>>>>>>>>>> rajkum...@wso2.com> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Hi Manula,
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> You can see those values in the same log I attached in the
>>>>>>>>>>>>>>>>> previous mail.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Sun, Oct 26, 2014 at 8:29 AM, Rajkumar Rajaratnam <
>>>>>>>>>>>>>>>>> rajkum...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Hi Chamila,
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I couldn't find any large values sent by agent. There are
>>>>>>>>>>>>>>>>>> traces for CEP sending large values. Find the cep trace log
>>>>>>>>>>>>>>>>>> here [1]
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> 1.
>>>>>>>>>>>>>>>>>> https://drive.google.com/file/d/0B1haIleqJMHIS3FFVFpfa0JlbVE/view?usp=sharing
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> On Sun, Oct 26, 2014 at 8:23 AM, Manula Chathurika
>>>>>>>>>>>>>>>>>> Thantriwatte <manu...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Shall we enable the cartridge agent debug logs and see
>>>>>>>>>>>>>>>>>>> what are the load average values sent from the agent. If
>>>>>>>>>>>>>>>>>>> those values are
>>>>>>>>>>>>>>>>>>> normal then we can narrow down to the CEP.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Thanks !
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> On Sat, Oct 25, 2014 at 10:43 PM, Chamila De Alwis <
>>>>>>>>>>>>>>>>>>> chami...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> Hi Raj,
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> Can you inspect the CEP trace logs for the same time
>>>>>>>>>>>>>>>>>>>> period? It will have the events published from the agent.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>>>>>> Chamila de Alwis
>>>>>>>>>>>>>>>>>>>> Software Engineer | WSO2 | +94772207163
>>>>>>>>>>>>>>>>>>>> Blog: code.chamiladealwis.com
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> On Sat, Oct 25, 2014 at 10:39 PM, Rajkumar Rajaratnam <
>>>>>>>>>>>>>>>>>>>> rajkum...@wso2.com> wrote:
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> I am doing a test round with M3 with python agent. And
>>>>>>>>>>>>>>>>>>>>> faced this very strange scenario, $Subject.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,693] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,693] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] -2000.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,694] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,694] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,694] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,694] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 1.9090909
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,694] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,694] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 28.718182
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,695] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Second
>>>>>>>>>>>>>>>>>>>>> Derivation of Memory Consumption event: [cluster]
>>>>>>>>>>>>>>>>>>>>> php.php.domain [value]
>>>>>>>>>>>>>>>>>>>>> 200000.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,695] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,695] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,695] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Second
>>>>>>>>>>>>>>>>>>>>> Derivation of load avg event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,695] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,696] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Second
>>>>>>>>>>>>>>>>>>>>> Derivation of load avg event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,696] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,696] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 3.3636363
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,696] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,696] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 0.11670045
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,696] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 28.7
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Second
>>>>>>>>>>>>>>>>>>>>> Derivation of Memory Consumption event: [cluster]
>>>>>>>>>>>>>>>>>>>>> php.php.domain [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 28.7
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 5.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,697] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 2000.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,698] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,698] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 28.7
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,698] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,698] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,698] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,699] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Second
>>>>>>>>>>>>>>>>>>>>> Derivation of Memory Consumption event: [cluster]
>>>>>>>>>>>>>>>>>>>>> php.php.domain [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,699] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,700] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Second
>>>>>>>>>>>>>>>>>>>>> Derivation of load avg event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 2000000.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,700] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,700] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 13500.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,700] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,701] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 50.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,701] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,701] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 28.738462
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,701] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,702] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 2.3333333
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,702] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,702] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,702] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,703] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,703] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,703] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 31.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,703] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,704] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,704] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,704] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 39.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,704] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,704] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] 39.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,705] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,706] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> load avg event: [cluster] php.php.domain [value] -11000.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,706] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Load average
>>>>>>>>>>>>>>>>>>>>> stats are reset, ready to do scale check [kub cluster]
>>>>>>>>>>>>>>>>>>>>> KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,708] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Grad of
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,708] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,709] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> - Avg
>>>>>>>>>>>>>>>>>>>>> Memory Consumption event: [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> [value] 28.8
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,709] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.KubernetesClusterContext}
>>>>>>>>>>>>>>>>>>>>> - Memory
>>>>>>>>>>>>>>>>>>>>> consumption stats are reset, ready to do scale check [kub
>>>>>>>>>>>>>>>>>>>>> cluster] KubGrp1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,811] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.util.PodActivationWatcher}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> PodActivationWatcher running : Running
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,942] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.util.PodActivationWatcher}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> PodActivationWatcher running : Running
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:38,945] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.util.PodActivationWatcher}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> PodActivationWatcher running : Running
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,712] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesServiceClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> KubernetesServiceClusterMonitor is running..
>>>>>>>>>>>>>>>>>>>>> KubernetesServiceClusterMonitor [
>>>>>>>>>>>>>>>>>>>>> kubernetesHostClusterId=KubGrp1,
>>>>>>>>>>>>>>>>>>>>> clusterId=php.php.domain, serviceId=php]
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,713] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesServiceClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> Running min check for [kub-cluster] : KubGrp1 [cluster]
>>>>>>>>>>>>>>>>>>>>> : php.php.domain
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,713] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - Running
>>>>>>>>>>>>>>>>>>>>> minimum rule:
>>>>>>>>>>>>>>>>>>>>> [kub-cluster] KubGrp1 [cluster] php.php.domain
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,714] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} -
>>>>>>>>>>>>>>>>>>>>> [min-check] [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [Replicas] nonTerminated : 3
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,714] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} -
>>>>>>>>>>>>>>>>>>>>> [min-check] [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [Replicas] minReplicas : 3
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,715] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - Running
>>>>>>>>>>>>>>>>>>>>> obsolete containers
>>>>>>>>>>>>>>>>>>>>> rule [kub-cluster] : KubGrp1 [cluster] : php.php.domain
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,715] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} -
>>>>>>>>>>>>>>>>>>>>> [obsolete-check] [cluster]
>>>>>>>>>>>>>>>>>>>>> : php.php.domain [Replicas] obsoleteReplicas : 0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,715] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.AutoscalerRuleEvaluator}
>>>>>>>>>>>>>>>>>>>>> - Minimum
>>>>>>>>>>>>>>>>>>>>> check executed for :
>>>>>>>>>>>>>>>>>>>>> org.apache.stratos.autoscaler.KubernetesClusterContext@21d906d0
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,715] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesServiceClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> flag of rifReset : true flag of memoryConsumptionReset :
>>>>>>>>>>>>>>>>>>>>> true flag of
>>>>>>>>>>>>>>>>>>>>> loadAverageReset : true
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,715] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.monitor.KubernetesServiceClusterMonitor}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> Running scale check for [kub-cluster] : KubGrp1
>>>>>>>>>>>>>>>>>>>>> [cluster] : php.php.domain
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,716] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - Running
>>>>>>>>>>>>>>>>>>>>> scaling rule
>>>>>>>>>>>>>>>>>>>>> [kub-cluster] : KubGrp1 [cluster] : php.php.domain
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,716] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -
>>>>>>>>>>>>>>>>>>>>> Predicting the
>>>>>>>>>>>>>>>>>>>>> value, [average]: 0.0 , [gradient]: 0.0 , [second
>>>>>>>>>>>>>>>>>>>>> derivative]: 0.0 , [time
>>>>>>>>>>>>>>>>>>>>> intervals]: 1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,716] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -
>>>>>>>>>>>>>>>>>>>>> Predicting the
>>>>>>>>>>>>>>>>>>>>> value, [average]: 28.8 , [gradient]: 0.0 , [second
>>>>>>>>>>>>>>>>>>>>> derivative]: 0.0 , [time
>>>>>>>>>>>>>>>>>>>>> intervals]: 1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,717] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleTasksDelegator} -
>>>>>>>>>>>>>>>>>>>>> Predicting the
>>>>>>>>>>>>>>>>>>>>> value, [average]: 39.0 , [gradient]: -11000.0 , [second
>>>>>>>>>>>>>>>>>>>>> derivative]:
>>>>>>>>>>>>>>>>>>>>> 2000000.0 , [time intervals]: 1
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,717] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [Replicas] minReplicas : 3
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,717] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [Replicas] maxReplicas : 10
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [Replicas] nonTerminated : 3
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [Replicas] activeReplicas : 3
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [RequestInFlight] predicted value : 0.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [RequestInFlight] upper limit : 80.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [RequestInFlight] lower limit : 5.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [MemoryConsumption] predicted value :
>>>>>>>>>>>>>>>>>>>>> 28.799999237060547
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [MemoryConsumption] upper limit : 80.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [MemoryConsumption] lower limit : 15.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,718] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [LoadAverage] predicted value : 989039.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,719] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [LoadAverage] upper limit : 180.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,719] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [LoadAverage] lower limit : 20.0
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,719] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain scale-up action : true
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,719] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain scale-down action : false
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,719] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain [LoadAverage] predicted replicas : 16484
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,720] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain predicted replicas > max replicas :
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,720] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} - [scaling]
>>>>>>>>>>>>>>>>>>>>> Decided to
>>>>>>>>>>>>>>>>>>>>> scale-up : [cluster] : php.php.domain
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,720] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.rule.RuleLog} -
>>>>>>>>>>>>>>>>>>>>> [scaling-up] [cluster] :
>>>>>>>>>>>>>>>>>>>>> php.php.domain valid number of replicas to expand : 10
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,720] INFO
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.autoscaler.client.cloud.controller.CloudControllerClient}
>>>>>>>>>>>>>>>>>>>>> - Updating kubernetes replication controller via cloud
>>>>>>>>>>>>>>>>>>>>> controller:
>>>>>>>>>>>>>>>>>>>>> [cluster] php.php.domain [replicas] 10
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,734] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> CloudControllerServiceImpl:updateContainers for cluster
>>>>>>>>>>>>>>>>>>>>> : php.php.domain
>>>>>>>>>>>>>>>>>>>>> TID: [0] [STRATOS] [2014-10-25 22:10:43,758] DEBUG
>>>>>>>>>>>>>>>>>>>>> {org.apache.stratos.cloud.controller.impl.CloudControllerServiceImpl}
>>>>>>>>>>>>>>>>>>>>> -
>>>>>>>>>>>>>>>>>>>>> Cloud Controller is delegating request to update a
>>>>>>>>>>>>>>>>>>>>> replication controller
>>>>>>>>>>>>>>>>>>>>> php.php.domain to Kubernetes layer.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> I couldn't investigate the agent side, since
>>>>>>>>>>>>>>>>>>>>> containers are destroyed.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Any idea?
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Thanks.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>>>>>>>>> Software Engineer | WSO2, Inc.
>>>>>>>>>>>>>>>>>>>>> Mobile +94777568639 | +94783498120
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>>>>> Manula Chathurika Thantriwatte
>>>>>>>>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> email : manu...@wso2.com / man...@apache.org
>>>>>>>>>>>>>>>>>>> phone : +94 772492511
>>>>>>>>>>>>>>>>>>> blog : http://manulachathurika.blogspot.com/
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>>>>>> Software Engineer | WSO2, Inc.
>>>>>>>>>>>>>>>>>> Mobile +94777568639 | +94783498120
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>>>>> Software Engineer | WSO2, Inc.
>>>>>>>>>>>>>>>>> Mobile +94777568639 | +94783498120
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>> Manula Chathurika Thantriwatte
>>>>>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> email : manu...@wso2.com / man...@apache.org
>>>>>>>>>>>>>>>> phone : +94 772492511
>>>>>>>>>>>>>>>> blog : http://manulachathurika.blogspot.com/
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>> Manula Chathurika Thantriwatte
>>>>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> email : manu...@wso2.com / man...@apache.org
>>>>>>>>>>>>>>> phone : +94 772492511
>>>>>>>>>>>>>>> blog : http://manulachathurika.blogspot.com/
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>>>> Software Engineer | WSO2, Inc.
>>>>>>>>>>>>>> Mobile +94777568639 | +94783498120
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>> Manula Chathurika Thantriwatte
>>>>>>>>>>>>> Software Engineer
>>>>>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>>>>
>>>>>>>>>>>>> email : manu...@wso2.com / man...@apache.org
>>>>>>>>>>>>> phone : +94 772492511
>>>>>>>>>>>>> blog : http://manulachathurika.blogspot.com/
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Rajkumar Rajaratnam
>>>>>>>>>>>> Software Engineer | WSO2, Inc.
>>>>>>>>>>>> Mobile +94777568639 | +94783498120
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Regards,
>>>>>>>>>>> Manula Chathurika Thantriwatte
>>>>>>>>>>> Software Engineer
>>>>>>>>>>> WSO2 Inc. : http://wso2.com
>>>>>>>>>>> lean . enterprise . middleware
>>>>>>>>>>>
>>>>>>>>>>> email : manu...@wso2.com / man...@apache.org
>>>>>>>>>>> phone : +94 772492511
>>>>>>>>>>> blog : http://manulachathurika.blogspot.com/
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Best Regards,
>>>>>>>>>>> Nirmal
>>>>>>>>>>>
>>>>>>>>>>> Nirmal Fernando.
>>>>>>>>>>> PPMC Member & Committer of Apache Stratos,
>>>>>>>>>>> Senior Software Engineer, WSO2 Inc.
>>>>>>>>>>>
>>>>>>>>>>> Blog: http://nirmalfdo.blogspot.com/
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Imesh Gunaratne
>>>>>>>>>>
>>>>>>>>>> Technical Lead, WSO2
>>>>>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Raj
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>>
>>>>>>>> Gayan Gunarathne
>>>>>>>> Technical Lead
>>>>>>>> WSO2 Inc. (http://wso2.com)
>>>>>>>> email : gay...@wso2.com | mobile : +94 766819985
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Best Regards,
>>>>>>> Nirmal
>>>>>>>
>>>>>>> Nirmal Fernando.
>>>>>>> PPMC Member & Committer of Apache Stratos,
>>>>>>> Senior Software Engineer, WSO2 Inc.
>>>>>>>
>>>>>>> Blog: http://nirmalfdo.blogspot.com/
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Imesh Gunaratne
>>>>>>
>>>>>> Technical Lead, WSO2
>>>>>> Committer & PMC Member, Apache Stratos
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Raj
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Raj
>>>>
>>>
>>>
>>>
>>> --
>>> Akila Ravihansa Perera
>>> Software Engineer, WSO2
>>>
>>> Blog: http://ravihansa3000.blogspot.com
>>>
>>
>>
>>
>> --
>> Best Regards,
>> Nirmal
>>
>> Nirmal Fernando.
>> PPMC Member & Committer of Apache Stratos,
>> Senior Software Engineer, WSO2 Inc.
>>
>> Blog: http://nirmalfdo.blogspot.com/
>>
>
>
>
> --
> Akila Ravihansa Perera
> Software Engineer, WSO2
>
> Blog: http://ravihansa3000.blogspot.com
>
--
Best Regards,
Nirmal
Nirmal Fernando.
PPMC Member & Committer of Apache Stratos,
Senior Software Engineer, WSO2 Inc.
Blog: http://nirmalfdo.blogspot.com/
