Florent Daigni?re wrote: > * Matthew Toseland <toad at amphibian.dyndns.org> [2008-02-28 12:24:12]: > > [CUT] > Well even though the produced code wasn't up to our expectations it was > good for the project on overall. Some of last year students are > still around: > - kryptos gave a talk at FOSS.IN > - sback told me he would try to write some additional regression > tests using some automated tools he is working on > Hi, I get the occasion to tell you something about the reseach I've just ended. In my Master thesis I compared the manual tests I did during my GSoC to tests created last months using automatic test generation tools.
Making a long story short, I've found that the service JUnit Factory [0] generates high quality regression tests in a few minutes. I tried to use it on the same classes I've tested manually and I compared the results using the mutation analysis [1]. This is the comparison http://sback.it/thesis/jesterReport-summary.pdf where MS is the mutation score reached (100 is the maximum). JUnit Factory is not a tool, it is a service: to generate tests you must download an Eclipse plugin. It permits you to specify classes you want to test and upload them on Agitar server. In a few minutes you get the correspondant unit tests back. Those tests are based on JUnit but require a library you can download freely from junit factory site. You can integrate them in you Ant build (I did it successfully). I think it could be really worthy to integrate JUnit Factory tests in Freenet. The service is free (as in beer..) it is a service so you don't see the code they use to generate tests, but beside this there is no licence matters using it. If you agree I could start testing classes in freenet.support which aren't covered by tests yet. Bye, Sback [0] http://www.junitfactory.com/ [1] http://en.wikipedia.org/wiki/Mutation_testing
