Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-27 Thread Andreas Mueller
I don't think you can make any statements about the optimization method wrt the data when you don't specify the loss function you want to minimize. On 04/25/2013 03:10 PM, Ronnie Ghose wrote: I think he means what increases/benefits do you get from rescaling features e.g. minmax or preproces

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-26 Thread Matthieu Brucher
. > >> > > >> >Jaques, I am having some trouble running the example. But yes it will > be > >> >good if we can have gui example. > >> > > >> >On 25-04-2013 19:12,scikit-learn-general-requ...@lists.sourceforge.net > >

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-26 Thread Gael Varoquaux
On Fri, Apr 26, 2013 at 04:17:36PM +0530, Shishir Pandey wrote: > @Jaques Grobler: I ran the libsvm GUI code on the sklearn version 13.1 > it was giving error importing - "from sklearn.externals.six.move import > xrange". Which error? Could you copy/paste it here? G -

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-26 Thread Shishir Pandey
lustrating difference with plots would also be good enough. Thanks a lot to Peter for the link. On 26-04-2013 16:08, scikit-learn-general-requ...@lists.sourceforge.net wrote: > Date: Fri, 26 Apr 2013 12:38:00 +0200 > From: Jaques Grobler > Subject: Re: [Scikit-learn-general] Effects of shif

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-26 Thread Jaques Grobler
ne should rescale >>> > the input data to bring all variables to similar range >>> > ( >>> http://openclassroom.stanford.edu/MainFolder/VideoPage.php?course=MachineLearning&video=03.1-LinearRegressionII-FeatureScaling&speed=100 >>> ) >>>

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-26 Thread Peter Prettenhofer
cost function (say squared loss) on scaling the data would be great. >> >> On 26-04-2013 04:31, scikit-learn-general-requ...@lists.sourceforge.net >> wrote: >> > Date: Fri, 26 Apr 2013 02:37:27 +0530 >> > From: Shishir Pandey >> > Subject: Re: [

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-26 Thread Ronnie Ghose
ve. > > > > We can choose cost function right now to be the squared loss function. > > > > On 26-04-2013 01:56,scikit-learn-general-requ...@lists.sourceforge.net > > wrote: > >> >Date: Thu, 25 Apr 2013 19:15:59 +0100 From: Matthieu Brucher > >> > Subject

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-25 Thread Shishir Pandey
:31, scikit-learn-general-requ...@lists.sourceforge.net wrote: > Date: Fri, 26 Apr 2013 02:37:27 +0530 > From: Shishir Pandey > Subject: Re: [Scikit-learn-general] Effects of shifting and scaling on > Gradient Descent > To:scikit-learn-general@lists.sourceforge.net > Message

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-25 Thread Shishir Pandey
o be the squared loss function. On 26-04-2013 01:56, scikit-learn-general-requ...@lists.sourceforge.net wrote: > Date: Thu, 25 Apr 2013 19:15:59 +0100 From: Matthieu Brucher > Subject: Re: [Scikit-learn-general] > Effects of shifting and scaling on Gradient Descent To: >

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-25 Thread Matthieu Brucher
> > On 25-04-2013 19:12, scikit-learn-general-requ...@lists.sourceforge.net > wrote: > > Date: Thu, 25 Apr 2013 09:10:35 -0400 > > From: Ronnie Ghose > > Subject: Re: [Scikit-learn-general] Effects of shifting and scaling on > > Gradient Descent > > To:sc

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-25 Thread Shishir Pandey
09:10:35 -0400 > From: Ronnie Ghose > Subject: Re: [Scikit-learn-general] Effects of shifting and scaling on > Gradient Descent > To:scikit-learn-general@lists.sourceforge.net > Message-ID: > > Content-Type: text/plain; charset="iso-8859-1" > > I t

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-25 Thread Ronnie Ghose
I think he means what increases/benefits do you get from rescaling features e.g. minmax or preprocessing.scale On Thu, Apr 25, 2013 at 02:09:13PM +0200, Jaques Grobler wrote: > > I also think it will be great to have this example on the website. > Do you mean like an interactive example that works

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-25 Thread Gael Varoquaux
On Thu, Apr 25, 2013 at 02:09:13PM +0200, Jaques Grobler wrote: > > I also think it will be great to have this example on the website. > Do you mean like an interactive example that works similiar to the SVM > Gui example , but for understand the effects shifting and scaling of > data has on the r

Re: [Scikit-learn-general] Effects of shifting and scaling on Gradient Descent

2013-04-25 Thread Jaques Grobler
> I also think it will be great to have this example on the website. Do you mean like an interactive example that works similiar to the SVM Gui example , but for understand the effects shifting and