The tools that come to mind for me are 'stick' and 'snot':
http://archives.neohapsis.com/archives/fulldisclosure/2004-09/0096.html
Folks... I never said they were good tools!
As far as I'm concerned, the only test that matters is a real world one.
Every network is different, sometimes radically, and I don't see much of
a point trying to generalize these kinds of things with a test suite.
Artificial tests give you artificial results.
------------------------------------------------------------------------
Test Your IDS
Is your IDS deployed correctly?
Find out quickly and easily by testing it
with real-world attacks from CORE IMPACT.
Go to http://www.securityfocus.com/sponsor/CoreSecurity_focus-ids_040708
to learn more.
------------------------------------------------------------------------