Which is great, unless the program wants to measure the cache memory itself, in which case it would use special assembler instructions or large memset()s. (We do such at Facebook.)
I disagree. If a regression suddenly causes a function to become heavily cache-bound, it should show up in benchmarks somehow, regardless of the previous expected behavior of the function.
-- Francois