What about an excrutiatingly large question pool designed for adaptive testing? Integration of free-response/essay questions? A live-distro that requires actual skill to accomplish a real task that can be recorded and graded or automatically analyzed? The key I would think would be to make the testing as multi-faceted as possible with emphasis on skill and knowledge.
A large pool, why not, but who is able to do it ? The problem is first to create questions, then to validate and rate them : every question does not have the same 'power'.
An excrutiatingly large pool, well, it just may be impossible.
free-response/essay : same problem as for check-box. You just have to know the question before taking the test, then to search for the answer, then to go to the test. Another problem here is you need a human to check and rate the answers. Big money in sight.
Same thing for a live distro : I download it, I launch it at home, and I exerce myself to answer the questions (even if this is a so-called lab test).
IMHO there is no way to work around the fact people can learn the answers.
Then --> the only way is to have a test which, when the guy knows the answers, permit to be (nearly) sure he have the correct skills. Even if answers are just memorized.
Maybe a live distro is a nice idea. Or a remote access.
_______________________________________________ BSDCert mailing list [email protected] http://lists.nycbug.org/mailman/listinfo/bsdcert
