Re: [scikit-learn] Understanding max_features parameter in RandomForestClassifier

2020-03-10 Thread aditya aggarwal
With all the parameters set to default, (especially bootstrap and max_samples), no of samples passed to each estimator is X.shape[0]. Doesn't it account for all the instances in the dataset with calculated no. of feature? Then how come only a subset is given to the estimator? On Wed, Mar 11, 2020

Re: [scikit-learn] Understanding max_features parameter in RandomForestClassifier

2020-03-10 Thread Brown J.B. via scikit-learn
Regardless of the number of features, each DT estimator is given only a subset of the data. Each DT estimator then uses the features to derive decision rules for the samples it was given. With more trees and few examples, you might get similar or identical trees, but that is not the norm. Pardon b

[scikit-learn] Threshold for roc_curve in binary classification

2020-03-10 Thread aditya aggarwal
Hello I was going through the logic to calculate threshold to plot roc_curve. As far as I could understand, fps, tps and threshold is calculated in slklearn.metrics._binary_clf_curve . How are multiple values of threshold calculated for binary classification? Also what is happening in the followi

[scikit-learn] Understanding max_features parameter in RandomForestClassifier

2020-03-10 Thread aditya aggarwal
For RandomForestClassifier in sklearn max_features parameter gives the max no of features for split in random forest which is sqrt(n_features) as default. If m is sqrt of n, then no of combinations for DT formation is nCm. What if nCm is less than n_estimators (no of decision trees in random fores