[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

STINNER Victor added the comment: Finally, I fixed the issue differently: test_regrtest now creates a temporary directory and uses --testdir command line parameter. Before, using --testdir didn't work because regrtest always added "test." prefix to module names (ex: test_os => test.test_os).

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

Roundup Robot added the comment: New changeset e47e00723e5d by Victor Stinner in branch 'default': Issue #26295: Enhanc test_regrtest.test_tools_script_run_tests() https://hg.python.org/cpython/rev/e47e00723e5d -- ___ Python tracker

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

Roundup Robot added the comment: New changeset e29f12ed by Victor Stinner in branch 'default': Issue #26295: Fix test_regrtest.test_tools_buildbot_test() https://hg.python.org/cpython/rev/e29f12ed -- ___ Python tracker

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

Roundup Robot added the comment: New changeset f7ddd72b70ea by Victor Stinner in branch 'default': Issue #26295: When using "python3 -m test --testdir=TESTDIR", regrtest doesn't https://hg.python.org/cpython/rev/f7ddd72b70ea New changeset c83349c129c9 by Victor Stinner in branch 'default':

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

STINNER Victor added the comment: I created the issue #26641 for doctest (test_doctest). -- ___ Python tracker ___

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

STINNER Victor added the comment: Hum, test_doctest, test_zipfile and test_pyclbr fail if test is converted to a package (if Lib/test/__init__.py is removed). Attached patch fixes test_zipfile. I created the issue #26569 for test_pyclbr failure. -- Added file:

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

STINNER Victor added the comment: Oh ok, I found a bug in the setup_tests() function of libregrtest: issue #26538. Attached patch fixes this issue, it requires the patch of the issue issue #26538. -- keywords: +patch Added file:

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

Martin Panter added the comment: Another idea is to make a loader script that loads the “test” module, patches its __path__, and then runs test.__main__ or whatever as usual. -- ___ Python tracker

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

Martin Panter added the comment: You say you couldn’t get the test package to be split into multiple directories. What did you try? As far as I can see, we need a way for test_regrtest to invoke the child process with some flag to say “add this extra directory to test.__path__”. --

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

New submission from STINNER Victor: test_regrtest creates temporary test files called test_regrtest_pid_xxx.py in Lib/test/. The problem is that some tests like test___all__ and test_zipfile haves test relying on the list of Lib/test/test_*.py. When tests are run in parallel, test_regrtest

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

STINNER Victor added the comment: > The directory with test files can be read-only. test_regrtest skips tests which requires to write in Lib/test/ if the write fails. except PermissionError as exc: if not sysconfig.is_python_build(): self.skipTest("cannot

[issue26295] Random failures when running test suite in parallel (-m test -j0) caused by test_regrtest

Serhiy Storchaka added the comment: The directory with test files can be read-only. test_regrtest should use temporary directory. -- nosy: +serhiy.storchaka ___ Python tracker