Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Mathieu Blondel
2012/3/13 Frédéric Bastien : > I would also add that probably ensemble are slower to train then > prunned tree. In academic, this is not a too big problem, but in > industries it can be important in some case. And slower to make predictions too, I guess. Mathieu -

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Frédéric Bastien
I would also add that probably ensemble are slower to train then prunned tree. In academic, this is not a too big problem, but in industries it can be important in some case. Fred On Tue, Mar 13, 2012 at 7:34 AM, Paolo Losi wrote: > On Tue, Mar 13, 2012 at 12:09 PM, Andreas wrote: >> On 03/13/2

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Paolo Losi
On Tue, Mar 13, 2012 at 12:09 PM, Andreas wrote: > On 03/13/2012 12:11 PM, Paolo Losi wrote: >> Since ensemble methods consistently outperform "traditional" tree building >> (where variance is controlled by pruning), what are the advantages of >> implementing >> pruning in sklearn? >> >> > I think

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Peter Prettenhofer
2012/3/13 Andreas > On 03/13/2012 12:11 PM, Paolo Losi wrote: > > Since ensemble methods consistently outperform "traditional" tree > building > > (where variance is controlled by pruning), what are the advantages of > > implementing > > pruning in sklearn? > > > > > I think the idea would be to

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Andreas
On 03/13/2012 12:11 PM, Paolo Losi wrote: > Since ensemble methods consistently outperform "traditional" tree building > (where variance is controlled by pruning), what are the advantages of > implementing > pruning in sklearn? > > I think the idea would be to have an easy to interpret model. T

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Paolo Losi
Since ensemble methods consistently outperform "traditional" tree building (where variance is controlled by pruning), what are the advantages of implementing pruning in sklearn? Paolo N.B. The question is not directed specifically to Brain but to GoS applicants and sklearn contributors. On Tue,

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Charanpal Dhanjal
Hi Andy, Thanks for the information. I read the thread by Vikram, and would gladly share my work with him. My particular interest is in model selection for decision trees and at this stage I would like to test how different prunings can improve generalisation. Best, Charanpal Le 13/03/2012 11:18

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Brian Holt
@lists.sourceforge.net Subject: [Scikit-learn-general] Decision tree pruning I noticed that decision trees are currently unpruned, and wondered if anyone was working on this (or has been)? If not, I might implement pruning myself. Charanpal

Re: [Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Andreas
Hi Charanpal. In the recent GSoC-Thread, Vikram Kamath has proposed this and other improvements as a GSoC project. This idea is still in a pretty early stage, though. In general, this is definitely a useful feature. Cheers, Andy --

[Scikit-learn-general] Decision tree pruning

2012-03-13 Thread Charanpal Dhanjal
I noticed that decision trees are currently unpruned, and wondered if anyone was working on this (or has been)? If not, I might implement pruning myself. Charanpal -- Keep Your Developer Skills Current with LearnDevNow! T