> Pierre wrote:
> > I forgot to mention how vicious such changes can be. Most 
> of times the 
> > related tests are "updated" in the same commit (or right after) to 
> > follow the new behavior. Making nearly impossible to know about the 
> > breakages without duplicating core tests in our apps. Also commit 
> > messages or changelog entries are rarely explicit enough to mention 
> > them.
> 
>  Maybe we could set up a testing system that runs the tests 
> from PHP_4_4,  PHP_5_0, PHP_5_1, and HEAD and shows the 
> differences? That way we would  notice that a test that 
> passed with a previous version fails with a  newer one.

Would have to diff the various tests too. 
Perhaps the tests cases should never be removed, but the expected results 
altered so a diff between differing test suite versions
can show what behaviour has changed.

Jared 

-- 
PHP Internals - PHP Runtime Development Mailing List
To unsubscribe, visit: http://www.php.net/unsub.php

Reply via email to