Hey James, I've removed the original content for length but I love the ideas you've put together for an overarching testing strategy.
I've begun work on a small ebuild testing framework, etest [1], that I believe fits into your model quite well. It uses docker images for isolation and repeatability. It allows developers to verify the install time and some run time behavior of ebuilds in an automated fashion. It's also extremely alpha and I find new issues every time I use it. That all being said I would love feedback and if anyone is brave enough to use it I would love to start cataloging issues that people find in github. James, if this doesn't fit your vision then I apologize for the tangential reply to your thread. [1] https://github.com/alunduil/etest Thanks, -- Alex Brandt Cloud Evangelist for Rackspace and Developer for Gentoo http://blog.alunduil.com