On 2017-06-26 13:26, Erik Bray wrote: > I submitted a PR [1] to the sage patchbot to add a feature I would > like to have, that re-runs failed tests one or more times. If > previously failing tests pass on a repeat attempt then the test is > considered "passing". However, I added a new return status called > "TestsPassedOnRetry" to distinguish this condition, so that it might > still stand out if it's happening constantly, which may still indicate > a real problem. > > This will help a lot though with transient failures that occur > sometimes, especially if tests timeout (e.g. due to the system being > under some other load). The addition of the new return status would > require an upgrade to the patchbot server if accepted, which is why > I'm pointing this out.
Would it be possible to only retry if there is a failure due to timeout? If a doctest has a random-like behavior, then it should not be considered a pass on a retry... Best Daniel -- You received this message because you are subscribed to the Google Groups "sage-devel" group. To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+unsubscr...@googlegroups.com. To post to this group, send email to sage-devel@googlegroups.com. Visit this group at https://groups.google.com/group/sage-devel. For more options, visit https://groups.google.com/d/optout.
