Re: [Scikit-learn-general] Class Weight Random Forest Classifier

2016-03-15 Thread Raghav R V
Hi Mamun, Scikit-learn's RandomForestClassifier has an option to set `class_weight` to "balanced". Have you tried that alone without specifying `sample_weights`? See this documentation - http://scikit-learn.org/stable/modules/generated/sklearn.ensemble.RandomForestClassifier.html#sklearn.ensemble

[Scikit-learn-general] Class Weight Random Forest Classifier

2016-03-15 Thread Mamun Rashid
Hi All, I have asked this question couple of weeks ago on the list. I have a two class problem where my positive class ( Class 1 ) and negative class ( Class 0 ) is imbalanced. Secondly I care much less about the negative class. So, I specified both class weight (to a random forest classifier) a

Re: [Scikit-learn-general] LogisticRegression regularizes intercept

2016-03-15 Thread Tom DLT
Hi David, Indeed the "liblinear" solver does regularize the intercept, which is not entirely correct, and should probably be more detailed in the doc. To lessen this effect, you may want to increase the "intercept_scaling" parameter to a quite large value. Note that if you use a L2 regularization

[Scikit-learn-general] LogisticRegression regularizes intercept

2016-03-15 Thread David Ojeda
Hello scikit-learners, A while back, I used this wonderful library to replicate some work that was done previously on R. I really liked the design of this library; kudos! I mainly used a LogisticRegression with L1 regularization, but I ran into some problems when trying to understand why my result