Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Status: Accepted Owner: Vinzent.Steinberg Labels: Type-Defect Priority-Medium New issue 1594 by Vinzent.Steinberg: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Currently it only shuffles the test files, not the test functions.

Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #1 on issue 1594 by asmeurer: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 This could be tricky, because most files have things like x, y, z = symbols('x y z') at the top. You would have to make sure that each test ha

Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #2 on issue 1594 by Vinzent.Steinberg: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 I'd only shuffle the tests inside the same file, not among different files. If there are declaration between the functions, it would fa

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Updates: Labels: CodeInCategory-QA CodeInDifficulty-Hard Comment #8 on issue 1594 by vlada.pe...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Someone could manage this for Code-In... -- You received this mes

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #9 on issue 1594 by asmeu...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Just make sure to note that this issue will be much harder to fix than it sounds like, because there are going to be very subtle tes

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #10 on issue 1594 by vlada.pe...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Well, to be fair, I don't consider fixing all the failures as part of this Code-In task. It's like the "-c" option (cache off): we

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Updates: Labels: CodeInMultiple Comment #12 on issue 1594 by asmeu...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 So let's create two tasks. One to just change the behavior (which would be an easy task), a

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Issue 1594: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 This issue is now blocking issue 2812. See http://code.google.com/p/sympy/issues/detail?id=2812 -- You received this message because you are listed in the owner or CC fields

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Updates: Labels: -CodeInDifficulty-Hard -CodeInMultiple CodeInDifficulty-Easy Comment #14 on issue 1594 by vlada.pe...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Ok, I've created a new issue for fixing the

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #18 on issue 1594 by pr...@goodok.ru: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 It seems that we forget update label "easy" for this GCI task, now it is still "hard" labeled: http://www.google-melange.com/gci/task

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Updates: Cc: krastano...@gmail.com Comment #19 on issue 1594 by vlada.pe...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Ok, since we forgot to remark it as easy, lets keep it with the original meaning: add

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Updates: Status: Fixed Comment #20 on issue 1594 by vlada.pe...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Apparently, there weren't so many failures as expected, so this is completed (as part of the GCI

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Updates: Cc: asmeurer Comment #4 on issue 1594 by vlada.pe...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Do we still want this? I know that at least some files declare some helper functions across the who

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #5 on issue 1594 by asmeurer: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 I'm not sure if it's worth it. We would have to do an audit of the test files to see what sort of things we are doing that this would disallo

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #6 on issue 1594 by vlada.pe...@gmail.com: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Ah, right. Well, I also don't think we'd catch many errors this way (though I guess it's possible). The testing situation has cha

Re: Issue 1594 in sympy: bin/test --random should also shuffle tests inside a file

Comment #7 on issue 1594 by asmeurer: bin/test --random should also shuffle tests inside a file http://code.google.com/p/sympy/issues/detail?id=1594 Well, there's also a big history of cache failures (Ondrej can tell you more about this), which only appear in strange situations like running