Re: Regression Tests ...
On Thu, Sep 14, 2006 at 10:53:27PM -0300, Marc G. Fournier wrote: For the PostgreSQL Project, we have a 'build farm' ... something that I think is similar to the tinderboxes ... but, their point isn't to just build the source tree, but to run its regression tests, and report when something fails: http://www.pgbuildfarm.org/cgi-bin/show_status.pl We do have something similar - Peter Holm's Stress: http://people.freebsd.org/~pho/stress/ He has a presentation at: http://www.linuxforum.dk/2006/slides/peterholm-lf06.pdf David. ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Regression Tests ...
On Fri, 15 Sep 2006, 07:42+0100, David Malone wrote: On Thu, Sep 14, 2006 at 10:53:27PM -0300, Marc G. Fournier wrote: For the PostgreSQL Project, we have a 'build farm' ... something that I think is similar to the tinderboxes ... but, their point isn't to just build the source tree, but to run its regression tests, and report when something fails: http://www.pgbuildfarm.org/cgi-bin/show_status.pl We do have something similar - Peter Holm's Stress: http://people.freebsd.org/~pho/stress/ He has a presentation at: http://www.linuxforum.dk/2006/slides/peterholm-lf06.pdf Actually, stress perfomance tests are a different class of the tests. What we have in tools/regression are regression tests but the main problem we still don't have a unified way to write them and no infrastructure to run and report results. E.g. at the moment you can't cd /usr/src/tools/regression/ make. Perhaps we just need to steal NetBSD's bits until we invent something better. Btw, there is an item in the project ideas list: http://www.freebsd.org/projects/ideas/#p-regression -- Maxim Konovalov ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
Regression Tests ...
With all the talk about -STABLE, and how bad things can get, and how in 'the good old days, this would never have happened' ... instead of griping about what is, could and should be ... why not focus on how to improve the process? For instance, we know that *most* of the time, -STABLE is exactly that, -STABLE ... and there are several of us that feel that -STABLE is more stable then -RELEASE ... not everyone agrees, but, hey, everyone has a right to disagree ... For the PostgreSQL Project, we have a 'build farm' ... something that I think is similar to the tinderboxes ... but, their point isn't to just build the source tree, but to run its regression tests, and report when something fails: http://www.pgbuildfarm.org/cgi-bin/show_status.pl I saw the post from the guy that caused the original thread, talking about how he was working on regression tests as he's developing the code ... is there some way that we can extend the tinderboxes to run these regression tests, and put a report up on freebsd.org reporting things like 'last successful build/test', so that one could use CVSup to upgrade to that date? Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email . [EMAIL PROTECTED] MSN . [EMAIL PROTECTED] Yahoo . yscrappy Skype: hub.orgICQ . 7615664 ___ freebsd-stable@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to [EMAIL PROTECTED]
