Re: MLlib - Does LogisticRegressionModel.clearThreshold() no longer work?
LBFGS is better. If you data is easily separable, LR might return values very close or equal to either 0.0 or 1.0. It is rare but it may happen. -Xiangrui On Tue, Oct 14, 2014 at 3:18 PM, Aris wrote: > Wow...I just tried LogisticRegressionWithLBFGS, and using clearThreshold() > DOES IN FACT work. It appears the the LogsticRegressionWithSGD returns a > model whose method is broken!! > > On Tue, Oct 14, 2014 at 3:14 PM, Aris wrote: >> >> Hi folks, >> >> When I am predicting Binary 1/0 responses with LogsticRegressionWithSGD, >> it returns a LogisticRegressionModel. In Spark 1.0.X I was using the >> clearThreshold method on the model to get the raw predicted probabilities >> when I ran the predict() method... >> >> It appears now that rather than getting a "realistic" probability that is >> between 0.0 and 1.0, I am only getting back predictions of 0.0 OR >> 1.0...never anything in between. >> >> The API says that clearThreshold is "experimental" ...it was working >> before! Is it broken now? >> >> Thanks! >> >> Aris > > - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
Re: MLlib - Does LogisticRegressionModel.clearThreshold() no longer work?
Wow...I just tried LogisticRegressionWithLBFGS, and using clearThreshold() DOES IN FACT work. It appears the the LogsticRegressionWithSGD returns a model whose method is broken!! On Tue, Oct 14, 2014 at 3:14 PM, Aris wrote: > Hi folks, > > When I am predicting Binary 1/0 responses with LogsticRegressionWithSGD, > it returns a LogisticRegressionModel. In Spark 1.0.X I was using the > clearThreshold method on the model to get the raw predicted probabilities > when I ran the predict() method... > > It appears now that rather than getting a "realistic" probability that is > between 0.0 and 1.0, I am only getting back predictions of 0.0 OR > 1.0...never anything in between. > > The API says that clearThreshold is "experimental" ...it was working > before! Is it broken now? > > Thanks! > > Aris >
MLlib - Does LogisticRegressionModel.clearThreshold() no longer work?
Hi folks, When I am predicting Binary 1/0 responses with LogsticRegressionWithSGD, it returns a LogisticRegressionModel. In Spark 1.0.X I was using the clearThreshold method on the model to get the raw predicted probabilities when I ran the predict() method... It appears now that rather than getting a "realistic" probability that is between 0.0 and 1.0, I am only getting back predictions of 0.0 OR 1.0...never anything in between. The API says that clearThreshold is "experimental" ...it was working before! Is it broken now? Thanks! Aris
