Carl, have you considered outputting the test suite in the same format as the test anything protocol? [1] I only mention this because it might be a nice way to easily do some reporting (or perhaps even continuous integration) notmuch, with trivial effort.
--
Oliver Charles / aCiD2
[1]: http://en.wikipedia.org/wiki/Test_Anything_Protocol
