Well, the PR curves won't be distorted if the scores are transformed this way (certainly not for the binary case where PR makes sense). Nor will the ROC curve be changed.
That said, I still think it is reasonable for any diagnostic to be allowed to call classifyScalarNoLink. But I don't understand how that makes it good to require the noLink option. Defining a default version that throws USOE seems less invasive. On Fri, May 20, 2011 at 6:49 PM, Hector Yee <[email protected]> wrote: > Here's a concrete example. Suppose we make a generic program to load any > abstract vector classifier to plot the precision recall curves for the > binary case. If we use classifyScalar exclusively some classifiers would > have distorted curves due to pushing them through an exponent first. > However > if they all support classifyScalarNoLink we could give the users an option > of picking a threshold for their desired recall in the raw score space, > without the added distortion introduced by forcing the scores in the 0..1 > range. >
