Are there any thumbrules how to set stepsize with gradient descent. I am using it for Linear Regression but I am sure it applies in general to gradient descent.
I am at present deriving a number which fits closest to training data set response variable values. I am sure there is a better way to do it. Thanks and Regards, Rishi @meditativesoul
