[Dev] Latency Calculation Feature in WSO2 GW

2015-12-16 Thread Nadeeshaan Gunasinghe
Hi all, It has been a requirement to implement a feature for keeping track of the various types of latency metrics in WSO2 GW. At the moment I am involved in implementing this latency metrics calculation feature according to the architecture proposed at [1]. As the first step I am capturing the raw

Re: [Dev] Latency Calculation Feature in WSO2 GW

2015-12-16 Thread Kasun Indrasiri
We may also need a bit of high level stats too.. For instance things we have included in ESB 4.10. On Thu, Dec 17, 2015 at 10:17 AM, Nadeeshaan Gunasinghe wrote: > Hi all, > It has been a requirement to implement a feature for keeping track of the > various types of latency metrics in WSO2 GW. A

Re: [Dev] Latency Calculation Feature in WSO2 GW

2015-12-16 Thread Viraj Senevirathne
Hi All, In ESB 4.10.0 we are introducing new statistic feature which lets user drill down service level statistics. So for higher level statistics we can include, - Avg,Min, Maximum Mediation times for each service - Statistics of each endpoints - Allow users to enable and disable stati

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-01-25 Thread Chamil Elladeniya
Hi all, Currently I'm tasked with implementing latency metrics calculation feature according to the proposed architecture [1]. So far I have integrated carbon-metrics and working on load testing to check if there is any performance degradation of GW. [1] [Architecture] Implementing Latency Metric

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-03 Thread Chamil Elladeniya
Hi all, This is the perf test results which performed in order to compare metrics integrated GW and the pure. Original GW Integrated GW # of requests Concurrency Requests per second [#/sec] Time per request [ms] # of requests Concurrency Requests per second [#/sec] Time per request [ms] 100 10

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-03 Thread Chamil Elladeniya
Adding the team On Wed, Feb 3, 2016 at 6:59 PM, Chamil Elladeniya wrote: > Hi all, > This is the perf test results which performed in order to compare metrics > integrated GW and the pure. > > Original GW > Integrated GW > # of requests Concurrency Requests per second [#/sec] Time per request >

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-03 Thread Isuru Perera
The results are not consistent. For example, in Original GW, the RPS is very low in 500 & 900 concurrency. Therefore we cannot exactly tell whether there is a considerable performance impact when using Carbon Metrics. We first need to make sure there are no issues in the performance testing enviro

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-04 Thread Kasun Indrasiri
Yes. We need to run this on perf testing environments and do a detailed analysis of JFRs. Also, we better use 'wrk' instead of ab. I guess the results were quite consistent with GW's performance test suite. @Ranawaka can you please comment on the behavior of perf testing results. On Wed, Feb 3, 2

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-04 Thread Isuru Ranawaka
Hi Chamila, Results should be consisted and we have seen consisted results while doing perf testing . Here we need to ensure whether there are other processes running on server which can lead to degrade performance while doing load testing and as Kasun mentioned and we can run perf testing by enab

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-04 Thread Nadeeshaan Gunasinghe
Hi Chamil, It would be better if we can run another round of perf testing before we come to a conclusion here. *Nadeeshaan Gunasinghe* Software Engineer, WSO2 Inc. http://wso2.com +94770596754 | nadeesh...@wso2.com | Skype: nadeeshaan.gunasinghe <#>

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-07 Thread Chamil Elladeniya
Hi all, As the previous test results were inconsistent, I did the test again using wrk to test the above scenario. Remote environment testing Using wrk Original GW Integrated GW # of threads Connections Requests per second [#/sec] Time per request [ms] # of threads Connections Requests per second

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-07 Thread Isuru Ranawaka
Hi Chamil , Great , Seems there is no impact on performance by integrating carbon-metrics and it may operates in asynchronous manner .Shall we look in to how we can visualize this data and how we can publish those to different Services like DAS . thanks On Mon, Feb 8, 2016 at 7:06 AM, Chamil

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-10 Thread Isuru Perera
Hi, It's great to see that there is not much impact to the performance of Gateway by the Carbon Metrics. The histogram update [1] method is synchronous and it is used by the Timer. (A timer is a histogram of durations). The Timer by default uses ExponentiallyDecayingReservoir [2] and its update m

Re: [Dev] Latency Calculation Feature in WSO2 GW

2016-02-16 Thread Chamil Elladeniya
Hi all, We have integrated metrics Statistic feature to the GW as a separate Handler by implementing the newly introduced MessagingHandler interface. Handler gets invoked through each transaction with carbonMessage and engaged location. Due to the current implementation, GW core is independent of