Le 05/11/2015 16:06, Michael Henretty a écrit : > > On Wed, Nov 4, 2015 at 7:27 PM, Gareth Aye <[email protected] > <mailto:[email protected]>> wrote: > > > I'm not sure that it is so bad. From my own experience, > regressions rarely cause intermittent failures. They mostly pop up > as permareds. I think it would make sense to demonstrate that we > are, in fact, masking a lot of real broken functionality before > making our intermittents noisier for sheriffs. > > > > I disagree with this mentality. For one thing, QA files bugs all the > time that are themselves intermittent. They even have a template item > for it, "Repro rate: XX%". With the current retry count of 25x per > test, we simply cannot write an effective Gij test for one of these > bugs since the retries will make the test always pass regardless of if > the fix was effective.
Actually once you know what the bug is, you can always write a test for it. Maybe it will be a unit test and not an integration test, but it's always possible :)
signature.asc
Description: OpenPGP digital signature
_______________________________________________ dev-fxos mailing list [email protected] https://lists.mozilla.org/listinfo/dev-fxos
