> Not sure which test(s) we should use for this ... I guess we'd want a > fixed seed ... and things like concurrent merges could mess up the > numbers if the threads schedule differently / IO gets slower ... hrmm.
Yeah, the benchmarks I was referring to are pretty static (no randomness). But even with a random factor of some sort you see it over time and this easily provides an insight into trends and mean values (you could even plot these by running an averaging window over historical data if you want). Dawid --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
