Komarek paper is not what the implementation is based off of. I once was chided by Ted on the LinkedIn Mahout forums for quoting the Komarek paper (more than 2 years ago).
Here's the link to leon bottou's paper - http://leon.bottou.org/publications/pdf/compstat-2010.pdf On Monday, January 13, 2014 4:27 PM, Tim Smith <timsmit...@hotmail.com> wrote: There is a link on http://mahout.apache.org/users/classification/logistic-regression.html to the following paper: http://www.autonlab.org/autonweb/14709/version/4/part/5/data/komarek:lr_thesis.pdf?branch=main&language=en > Date: Mon, 13 Jan 2014 20:58:28 +0100 > Subject: Re: Logistic Regression cost function > From: fr...@frankscholten.nl > To: user@mahout.apache.org > > Do you know which paper it is? He has quite a few publications. I don't see > any mention of one of his papers in the code. I only see > www.eecs.tufts.edu/~dsculley/papers/combined-ranking-and-regression.pdf in > MixedGradient but this is something different. > > > > On Mon, Jan 13, 2014 at 1:27 PM, Suneel Marthi <suneel_mar...@yahoo.com>wrote: > > > Mahout's impl is based off of Leon Bottou's paper on this subject. I > > don't gave the link handy but it's referenced in the code or try google > > search > > > > Sent from my iPhone > > > > > On Jan 13, 2014, at 7:14 AM, Frank Scholten <fr...@frankscholten.nl> > > wrote: > > > > > > Hi, > > > > > > I followed the Coursera Machine Learning course quite a while ago and I > > am > > > trying to find out how Mahout implements the Logistic Regression cost > > > function in the code surrounding AbstractOnlineLogisticRegression. > > > > > > I am looking at the train method in AbstractOnlineLogisticRegression and > > I > > > see online gradient descent step where the beta matrix is updated but to > > me > > > its unclear how matches with the cost function described at: > > > http://www.holehouse.org/mlclass/06_Logistic_Regression.html > > > > > > Perhaps Mahout uses an optimized approach for that does not directly map > > > into the formula at that link? > > > > > > Cheers, > > > > > > Frank > >
