Oh, well that's sad! Given that it assigns feature_importances_, is there
any reason it should not incorporate the mixin to provide it with
transform()? (I assumed that transform was available wherever
feature_importances_ was.)
On Wed, Jul 17, 2013 at 3:38 PM, Gael Varoquaux <
[email protected]> wrote:
> Hey Joel,
>
> I am afraid that I think that the GradientBoostingClassifier does not
> implement the transform method.
>
> Gaël
>
> On Wed, Jul 17, 2013 at 07:42:20AM +1000, Joel Nothman wrote:
> > Sorry, I made a mistake: unless the classifier has penalty=l1, its
> default
> > feature selection threshold (as used in a pipeline currently) is the mean
> > feature importance score.
>
>
> > On Wed, Jul 17, 2013 at 7:11 AM, Joel Nothman <
> [email protected]>
> > wrote:
>
> > For your example, Eustache, the following would work (with a dense or
> > sparse X):
>
> > """
> > clf = GradientBoostingClassifier()
> > clf.fit(X, y)
> > clf.fit(clf.transform(threshold=1e-3), y)
> > """
>
> > Alternatively, use a Pipeline:
> > """
> > clf = Pipeline([
> > ('sel', GradientBoostingClassifier()),
> > ('clf', GradientBoostingClassifier())
> > ])
> > clf.fit(X, y)
> > """
> > This will apply the default threshold (1e-5); currently the
> threshold can't
> > be set for use in a pipeline, pending an issue that I can't currently
> > locate, which would move the threshold to the object as with
> randomized
> > l1's selection_threshold parameters.
>
> > The Pipeline examples include feature selectors, if only univariate.
> Is
> > there somewhere in the documentation you think these could be
> clearer? If
> > so, submit a PR.
>
> > - Joel
>
>
> > On Wed, Jul 17, 2013 at 3:49 AM, Olivier Grisel <
> [email protected]>
> > wrote:
>
> > Feature selectors should implement the `Transformer` API so that
> they
> > can be used in a Pipeline and make it possible to cross validate
> them.
>
> > The univariate feature selectors already implement the
> transformer API:
>
> > http://scikit-learn.org/stable/modules/feature_selection.html#
> > univariate-feature-selection
> --
> Gael Varoquaux
> Researcher, INRIA Parietal
> Laboratoire de Neuro-Imagerie Assistee par Ordinateur
> NeuroSpin/CEA Saclay , Bat 145, 91191 Gif-sur-Yvette France
> Phone: ++ 33-1-69-08-79-68
> http://gael-varoquaux.info http://twitter.com/GaelVaroquaux
>
>
> ------------------------------------------------------------------------------
> See everything from the browser to the database with AppDynamics
> Get end-to-end visibility with application monitoring from AppDynamics
> Isolate bottlenecks and diagnose root cause in seconds.
> Start your free trial of AppDynamics Pro today!
> http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
> _______________________________________________
> Scikit-learn-general mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
------------------------------------------------------------------------------
See everything from the browser to the database with AppDynamics
Get end-to-end visibility with application monitoring from AppDynamics
Isolate bottlenecks and diagnose root cause in seconds.
Start your free trial of AppDynamics Pro today!
http://pubads.g.doubleclick.net/gampad/clk?id=48808831&iu=/4140/ostg.clktrk
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
