Robert Menschel <[EMAIL PROTECTED]> writes: > One item not mentioned on this page yet is how to score rules going to > either core and rapid distribution such as via sa-update or going to > the extra rule sets.
Current practice is that new rules temporarily get the default score of 1.0. We plan to rescore much more often in the future, though. The new scoring method makes it much easier and once we get the kinks worked out, I think we'll be able to do it much more often than we have in the past. One option to bridge the gap would be to score new rules based on a nightly run using the more limited corpora of a nightly run. This would be done by setting old rules' scores to be immutable and only scoring the new ones. That would not be too hard and would be more accurate than any estimation technique. There is definitely a correlation between hit rates, S/O ratio, RANK, etc. to the ultimate perceptron-generated score, but the correlations are not all that high, unfortunately. > The ideal would be to find some way to incorporate new rules into a > GA/Perceptron-line mechanism, perhaps a Perceptron run which a) > assumes whatever hit frequency applied to the last full scoring run, > b) freezes all scores in all score sets according to the most recent > distribution, and then c) incorporates an sa-update scoring run and > calculates appropriate scores for the new rules. [...] Ah, very good. I should have read your entire message. ;-) -- Daniel Quinlan http://www.pathname.com/~quinlan/
