On Mon, Oct 03, 2011 at 07:47:03PM -0400, Satrajit Ghosh wrote:
>    i didn't look at that at all. i just looked at the docstring of
>    permutation_test_score and since i was using mean_square_error to evaluate
>    my models, i simply inserted that and got exactly 1-p. when i plotted the
>    distribution, i realized the problem.

Actually, I hadn't realized, but 'permutation_test_score' is named
'score', and it does not follow the 'bigger is better rule'. So, in
addition to there being a documentation problem, there is a consistency
problem.

I think that I would favor changing it so that it returns -log(p) (yay,
another API breakage :$ ).

What do people think?

Gaƫl

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general

Reply via email to