Re: Can LBFGS be used on streaming data?

2015-03-26 Thread EcoMotto Inc.
for the algorithm. Sincerely, DB Tsai --- Blog: https://www.dbtsai.com On Mon, Mar 16, 2015 at 3:19 PM, EcoMotto Inc. ecomot...@gmail.com wrote: Hello, I am new to spark streaming API. I wanted to ask if I can apply LBFGS

Re: Can LBFGS be used on streaming data?

2015-03-25 Thread EcoMotto Inc.
to the optimizer in the same order? Difference in either could produce small differences in the resulting weights, but that doesn’t mean it’s doing anything wrong. - jeremyfreeman.net @thefreemanlab On Mar 17, 2015, at 6:19 PM, EcoMotto Inc. ecomot...@gmail.com wrote: Hello Jeremy

Re: Can LBFGS be used on streaming data?

2015-03-17 Thread EcoMotto Inc.
optimization routines in this fairly direct way. Other methods (such as KMeans) require a bit more reengineering. — Jeremy - jeremyfreeman.net @thefreemanlab On Mar 16, 2015, at 6:19 PM, EcoMotto Inc. ecomot...@gmail.com wrote: Hello, I am new to spark streaming API

Can LBFGS be used on streaming data?

2015-03-16 Thread EcoMotto Inc.
Hello, I am new to spark streaming API. I wanted to ask if I can apply LBFGS (with LeastSquaresGradient) on streaming data? Currently I am using forecahRDD for parsing through DStream and I am generating a model based on each RDD. Am I doing anything logically wrong here? Thank you. Sample

Re: Getting incorrect weights for LinearRegression

2015-03-13 Thread EcoMotto Inc.
= w.takeRight(1).head() val model = new LinearRegressionModel(Vectors.dense(w.dropRight(1)), intercept) Best, Burak On Wed, Mar 11, 2015 at 11:59 AM, EcoMotto Inc. ecomot...@gmail.com wrote: Hello, I am trying to run LinearRegression on a dummy data set, given below. Here I tried all