On Sep 17, 2009, at 17:53, Ludovic Courtès wrote:
I was thinking we could have a dedicated machine running benchmarks, say, everyday, and publishing plots somewhere.
I'd suggest multiple machines, if possible. Different operating systems (for example, I've seen that mutex performance differs quite a bit between Linux and Mac OS X), maybe different processor families. If some of the benchmarks test multithreaded performance, perhaps multiprocessor vs uniprocessor systems too.
Testing on a single machine is better than not testing at all, but I don't think we want to fine-tune it for one system at the expense of performance on lots of others.
Ken
