Andrei Alexandrescu wrote: > Clearly there is noise during normal use as well, but > incorporating it in benchmarks as a matter of course reduces the > usefulness of benchmarks
On the contrary: 1) The "noise during normal use" has to be measured in order to detect the sensibility of the benchmarked program to that noise. 2) The noise the benchmarked program produces has to be measured too, because the running benchmarked program probably increases the noise for all other running programs. In addition: the noise produced by a machine under heavy load might bring the performance of the benchmarked program down to zero. -manfred