Re: Luceneutil high variability between runs

2013-08-16 Thread Robert Muir
I think the raw values don't matter so much because there is some randomization involved? And the same random seed is used... Your DefaultSimilarityRuns look pretty stable. its between 0.0% and 1.5% variation which is about as good as it gets for HighTerm LowTerm i am guessing is always noisy

Luceneutil high variability between runs

2013-08-16 Thread Tom Burton-West
Hello, I'm trying to benchmark a change to BM25Similarity (LUCENE-5175 )using luceneutil I'm running this on a lightly loaded machine with a load average (top) of about 0.01 when the benchmark is not running. I made the following changes: 1) localrun.py changed Competition(debug=True) to Competi