Re: [Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

Hi Lahiru, My comments below. On Tue, Nov 11, 2014 at 11:30 PM, Lahiru Sandaruwan wrote: > Also this is a good read to learn how Netflix use these algorithms for > scaling. > > http://techblog.netflix.com/search/label/prediction > > On Tue, Nov 11, 2014 at 11:07 PM, Lahiru Sandaruwan > wrote: >

Re: [Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

Also this is a good read to learn how Netflix use these algorithms for scaling. http://techblog.netflix.com/search/label/prediction On Tue, Nov 11, 2014 at 11:07 PM, Lahiru Sandaruwan wrote: > Hi Seshika, > > Thanks for the detailed response, > > On Tue, Nov 11, 2014 at 10:08 PM, Seshika Fernan

Re: [Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

Hi Seshika, Thanks for the detailed response, On Tue, Nov 11, 2014 at 10:08 PM, Seshika Fernando wrote: > Hi all, > > I have 2 comments. > > a. The timeseries extension to CEP which supports uni-variate and > multi-variate linear regression [1] can be used for this. We can use the > multi-varia

Re: [Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

Hi Lahiru, svn location of the decaying window can be found in this jira - https://wso2.org/jira/browse/CEP-968 seshika On Tue, Nov 11, 2014 at 10:10 PM, Lahiru Sandaruwan wrote: > This is cool Lasantha! > > I will definitely evaluate/study this and come back. > > On Tue, Nov 11, 2014 at 8:51

Re: [Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

This is cool Lasantha! I will definitely evaluate/study this and come back. On Tue, Nov 11, 2014 at 8:51 PM, Lasantha Fernando wrote: > Hi Lahiru, > > Would it be possible to use linear regression already available as > Siddhi extensions in [1] or maybe improve on that existing extensions > to

Re: [Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

Hi all, I have 2 comments. a. The timeseries extension to CEP which supports uni-variate and multi-variate linear regression [1] can be used for this. We can use the multi-variate regression to solve the curve fitting stated in Lahiru's email. Basically what we need to do is use *t *and *t^2* as

Re: [Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

Hi Lahiru, Would it be possible to use linear regression already available as Siddhi extensions in [1] or maybe improve on that existing extensions to extend it to fit polynomial curves? The code is available here [2]. I think forecasting is also available which can be useful in this usecase. WDY

[Autoscaling] [Improvement] Introducing "curve fitting" for stat prediction algorithm of Autoscaler

Hi all, This contains the content i already sent to Stratos dev. Idea is to highlight and separate the new improvement. *Current implementation* Currently CEP calculates average, gradient, and second derivative and send those values to Autoscaler. Then Autoscaler predicts the values using S = u*