Given that these are random number driven tests, they will fail 1 out of N times, and the question is what the tolerated failure rate should be. Apparently, 1 out of 10 is not a happy place. But perhaps 1 out of 1000? 1 out of a million? Failure rates of 1 in a billion push the tests into a corner where they aren't really testing anything meaningful any more.
I guess I can tweak the parameters, unless Bradley is confident about handling this. I need to see if I can even remember how to run the tests 😐 -- linas On Tue, Feb 6, 2024 at 11:23 PM Arthur A. Gleckler <s...@speechcode.com> wrote: > On Tue, Feb 6, 2024 at 9:16 PM Linas Vepstas <linasveps...@gmail.com> > wrote: > > >> How do you want to proceed? >> > > I'm not sure what to do. Automatic tests are always supposed to pass, but > I have no experience with testing this kind of thing. I will rely on the > opinions of our expert SRFI contributors, including you. > -- Patrick: Are they laughing at us? Sponge Bob: No, Patrick, they are laughing next to us.
