[issue33725] High Sierra hang when using multi-processing

[Ronald Oussoren]

Ronald Oussoren  added the comment:

A better solution is to avoid using fork mode for multiprocessing. The spawn 
and fork server modes should work fine. 

The underlying problem is that macOS system frameworks (basically anything 
higher level than libc) are not save wrt fork(2) and fixing that appears to 
have no priority at all at Apple.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33727] Server.wait_closed() doesn't always wait for its transports to fihish

[Yury Selivanov]

New submission from Yury Selivanov :

Server.wait_closed() currently does two checks:

1. if _sockets is None -- means that Server.close() was called
2. if self._waiters is None -- means that Server._wakeup() was called

if (1) *or* (2) is true, wait_closed() just returns without waiting on anything.

However, when Server.close() is called there might be still active transports 
serving requests.  Server.wait_closed() should wait until all of them are 
detached, even if Server._sockets is already reset.

So the below implementation:

async def wait_closed(self):
if self._sockets is None or self._waiters is None:
return
waiter = self._loop.create_future()
self._waiters.append(waiter)
await waiter

should be changed to:

async def wait_closed(self):
if self._waiters is None:
assert self._active_count == 0
return
waiter = self._loop.create_future()
self._waiters.append(waiter)
await waiter

--
components: asyncio
messages: 318360
nosy: asvetlov, yselivanov
priority: normal
severity: normal
status: open
title: Server.wait_closed() doesn't always wait for its transports to fihish
versions: Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33726] Add short descriptions to PEP references in seealso

[Andrés Delfino]

Change by Andrés Delfino :


--
keywords: +patch
pull_requests: +6922
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33726] Add short descriptions to PEP references in seealso

[Andrés Delfino]

New submission from Andrés Delfino :

There are a couple of PEP references with no description in Simple/Compound 
Statements.

Attached PR fixes this.

--
assignee: docs@python
components: Documentation
messages: 318359
nosy: adelfino, docs@python
priority: normal
severity: normal
status: open
title: Add short descriptions to PEP references in seealso
type: enhancement
versions: Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33610] IDLE: Make multiple improvements to CodeContext

[Terry J. Reedy]

Terry J. Reedy  added the comment:

19. idle.rst doc change
20. What's New for 3.6.6 and 3.7.0
These could be patches on this issue.
21. idlelib/NEWS.txt entries

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33610] IDLE: Make multiple improvements to CodeContext

[Terry J. Reedy]

Terry J. Reedy  added the comment:

18. Error or bounds checking for maxlines entry.  I believe this really a 
config dialog issue that applies to everything, but maxlines should be at least 
1, with some reasonable max.  In the meanwhile, we could check whether crazy 
entries (text, negatives, super high) can crash IDLE.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28657] cmd.Cmd.get_help() implementation can't see do_*() methods added dynamically by setattr()

[Raymond Hettinger]

Raymond Hettinger  added the comment:

ISTM the only way dir(self) would make a difference would be if functions we 
being assigned to instances rather than the class.   Also, it's uncleaar why 
setattr() is at issue -- it works the same way as regular attribute assignment 
using the dot operator.

--
nosy: +rhettinger

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33610] IDLE: Make multiple improvements to CodeContext

[Terry J. Reedy]

Terry J. Reedy  added the comment:

5, reformulated. Now that 'Code Context' on the Options menu only toggles a 
feature for the current window, like 'Zoom Height' on the Window menu, both 
should appear together on the same menu.  My current inclination is to move 
'Code Context' to Window because a) it is the feature be that will be changed 
and discussed in What's New, and b) 'Window' otherwise lists individual windows 
so it more clearly implies that toggles are for the current window without 
adding a fake menu entry.  Agree?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33597] Compact PyGC_Head

[INADA Naoki]

INADA Naoki  added the comment:

https://github.com/python/cpython/pull/7043/commits/053111f321d792fb26f8be10abba24a980f3590f

I added one micro optimization.
Although it is not relating to two-word-gc directly, it makes gc_collect faster 
than master on the microbench (without importing tkinter.tix, because no GUI on 
my Linux environment).

$ ./python -m perf timeit --compare-to ./python-master -s "import gc, doctest, 
ftplib, asyncio, email, http.client, pydoc, pdb, fractions, decimal, difflib, 
textwrap, statistics, shutil, shelve, lzma, concurrent.futures, telnetlib, 
smtpd, trace, distutils, pkgutil, tabnanny, pickletools, dis, argparse" 
"gc.collect()"
python-master: . 1.66 ms +- 0.08 ms
python: . 1.58 ms +- 0.00 ms

Mean +- std dev: [python-master] 1.66 ms +- 0.08 ms -> [python] 1.58 ms +- 0.00 
ms: 1.05x faster (-5%)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33642] IDLE: Use variable number of lines in CodeContext

[Terry J. Reedy]

Terry J. Reedy  added the comment:

On Windows, I observe the following behaviors.

1. When Code Context is enabled on a windows still at its initial height, 
context lines are added to code lines to increase the window height.

2. When the window height is changed with a mouse, that becomes the fixed 
height, which is partitioned between context and code lines.  In other words, 
context lines are taken from and given back to code lines.

3. When height is maximized either with ZoomHeight or WindowMaximize, the 
behavior is as with 2.  When height is un-maximized, behavior reverts to what 
it was, either 1 or 2.

What do you see on Linux?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33725] High Sierra hang when using multi-processing

[Kapil Thangavelu]

New submission from Kapil Thangavelu :

This issue seems to be reported a few times on various githubs projects. I've 
also reproduced using a brew install of python 2.7.15. I haven't been able to 
reproduce with python 3.6. Note this requires a framework build of python.

Background on the underlying issue cause due to a change in high Sierra 
http://sealiesoftware.com/blog/archive/2017/6/5/Objective-C_and_fork_in_macOS_1013.html
A ruby perspective on the same issue exhibiting for some apps
https://blog.phusion.nl/2017/10/13/why-ruby-app-servers-break-on-macos-high-sierra-and-what-can-be-done-about-it/


The work around seems to be setting an environment variable 
OBJC_DISABLE_INITIALIZE_FORK_SAFETY prior to executing python.

Other reports

https://bugs.python.org/issue30837
https://github.com/ansible/ansible/issues/32499
https://github.com/imWildCat/scylla/issues/22
https://github.com/elastic/beats-tester/pull/73
https://github.com/jhaals/ansible-vault/issues/60

--
components: macOS
messages: 318352
nosy: kapilt, ned.deily, ronaldoussoren
priority: normal
severity: normal
status: open
title: High Sierra hang when using multi-processing
versions: Python 2.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33610] IDLE: Make multiple improvements to CodeContext

[Terry J. Reedy]

Terry J. Reedy  added the comment:

The release candidate has been re-scheduled for June 11.  So we should be able 
to merge the minimal upgrade before that and get it in 3.7.0 and 3.6.6.  (The 
latter will come out at the same time as the former.)

Variable lines is about ready.  Colors looks like it should be, with a final 
test needed after variable lines is merged (or maybe I will reverse the order). 
 That leaves line alignment.  If you are working on it, but don't have a PR 
ready yet, please say so.

--
dependencies:  -IDLE: Configurable color on code context

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33692] Chinese characters issue with input() function

[STINNER Victor]

Change by STINNER Victor :


--
pull_requests: +6920

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33692] Chinese characters issue with input() function

[STINNER Victor]

Change by STINNER Victor :


--
pull_requests: +6920, 6921

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33718] Enhance regrtest: meta-ticket for multiple changes

[STINNER Victor]

Change by STINNER Victor :


--
pull_requests: +6919

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33718] Enhance regrtest: meta-ticket for multiple changes

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 9e24930dfdc28e16dabbfd7dd1ead1336b7b0d6c by Victor Stinner in 
branch 'master':
bpo-33718: regrtest keeps filters to re-run fails (GH-7291)
https://github.com/python/cpython/commit/9e24930dfdc28e16dabbfd7dd1ead1336b7b0d6c


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33615] test__xxsubinterpreters crashed on x86 Gentoo Refleaks 3.x

[Eric Snow]

Eric Snow  added the comment:

FYI, I plan on closing this issue only *after* I've re-enabled the crashing 
test and it passes. :)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33724] test__xxsubinterpreters failed on ARMv7 Ubuntu 3.x

[Eric Snow]

Eric Snow  added the comment:

Thanks, Victor.  I'll take a look.  FYI, it seems that the same 3 buildbots 
from bpo-33615 are seeing these same test failures.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33717] Enhance test.pythoninfo: meta-ticket for multiple changes

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 56013218864d5eb81baab4665fcae13400934078 by Victor Stinner in 
branch 'master':
bpo-33717: pythoninfo: add CC --version (#7290)
https://github.com/python/cpython/commit/56013218864d5eb81baab4665fcae13400934078


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33718] Enhance regrtest: meta-ticket for multiple changes

[STINNER Victor]

Change by STINNER Victor :


--
keywords: +patch
pull_requests: +6918
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33717] Enhance test.pythoninfo: meta-ticket for multiple changes

[STINNER Victor]

Change by STINNER Victor :


--
keywords: +patch
pull_requests: +6917
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33615] test__xxsubinterpreters crashed on x86 Gentoo Refleaks 3.x

[STINNER Victor]

STINNER Victor  added the comment:

Now the test runs but doesn't crash anymore: bpo-33724.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33724] test__xxsubinterpreters failed on ARMv7 Ubuntu 3.x

[STINNER Victor]

New submission from STINNER Victor :

Follow-up of bpo-33615.

ARMv7 Ubuntu 3.x:

http://buildbot.python.org/all/#/builders/106/builds/1118

Re-running test 'test__xxsubinterpreters' in verbose mode
test_bad_id (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_bad_kwargs (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_coerce_id (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_default_kwargs (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_does_not_exist (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_equality (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_repr (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_str (test.test__xxsubinterpreters.ChannelIDTests) ... FAIL
test_with_kwargs (test.test__xxsubinterpreters.ChannelIDTests) ... ok
test_by_unassociated_interp (test.test__xxsubinterpreters.ChannelReleaseTests) 
... ERROR
test_close_if_unassociated (test.test__xxsubinterpreters.ChannelReleaseTests) 
... ERROR
test_multiple_times (test.test__xxsubinterpreters.ChannelReleaseTests) ... ok
test_multiple_users (test.test__xxsubinterpreters.ChannelReleaseTests) ... ERROR
test_never_used (test.test__xxsubinterpreters.ChannelReleaseTests) ... ok
test_no_kwargs (test.test__xxsubinterpreters.ChannelReleaseTests) ... ok
test_partially (test.test__xxsubinterpreters.ChannelReleaseTests) ... ok
test_single_user (test.test__xxsubinterpreters.ChannelReleaseTests) ... ok
test_used_multiple_times_by_single_user 
(test.test__xxsubinterpreters.ChannelReleaseTests) ... ok
test_with_unused_items (test.test__xxsubinterpreters.ChannelReleaseTests) ... ok
test_close_both_with_unused_items_forced 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_both_with_unused_items_unforced 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_by_unassociated_interp (test.test__xxsubinterpreters.ChannelTests) 
... ERROR
test_close_defaults_with_unused_items 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_empty (test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_multiple_times (test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_multiple_users (test.test__xxsubinterpreters.ChannelTests) ... ERROR
test_close_never_used (test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_recv_with_unused_items_forced 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_recv_with_unused_items_unforced 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_send_with_unused_items_forced 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_send_with_unused_items_unforced 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_single_user (test.test__xxsubinterpreters.ChannelTests) ... ok
test_close_used_multiple_times_by_single_user 
(test.test__xxsubinterpreters.ChannelTests) ... ok
test_create_cid (test.test__xxsubinterpreters.ChannelTests) ... ok
test_ids_global (test.test__xxsubinterpreters.ChannelTests) ... FAIL
test_recv_empty (test.test__xxsubinterpreters.ChannelTests) ... ok
test_recv_not_found (test.test__xxsubinterpreters.ChannelTests) ... ok
test_run_string_arg_resolved (test.test__xxsubinterpreters.ChannelTests) ... 
skipped 'bpo-33615: triggering crashes so temporarily disabled'
test_run_string_arg_unresolved (test.test__xxsubinterpreters.ChannelTests) ... 
ok
test_send_not_found (test.test__xxsubinterpreters.ChannelTests) ... ok
test_send_recv_different_interpreters 
(test.test__xxsubinterpreters.ChannelTests) ... ERROR
Exception in thread Thread-9:
Traceback (most recent call last):
  File 
"/ssd/buildbot/buildarea/3.x.gps-ubuntu-exynos5-armv7l/build/Lib/threading.py", 
line 917, in _bootstrap_inner
self.run()
  File 
"/ssd/buildbot/buildarea/3.x.gps-ubuntu-exynos5-armv7l/build/Lib/threading.py", 
line 865, in run
self._target(*self._args, **self._kwargs)
  File 
"/ssd/buildbot/buildarea/3.x.gps-ubuntu-exynos5-armv7l/build/Lib/test/test__xxsubinterpreters.py",
 line 1280, in f
"""))
  File 
"/ssd/buildbot/buildarea/3.x.gps-ubuntu-exynos5-armv7l/build/Lib/test/test__xxsubinterpreters.py",
 line 42, in _run_output
interpreters.run_string(interp, script, shared)
_xxsubinterpreters.RunFailedError: : channel 1103095676 not found

test_send_recv_different_interpreters_and_threads 
(test.test__xxsubinterpreters.ChannelTests) ... FAIL
test_send_recv_different_threads (test.test__xxsubinterpreters.ChannelTests) 
... ok
test_send_recv_main (test.test__xxsubinterpreters.ChannelTests) ... ok
test_send_recv_same_interpreter (test.test__xxsubinterpreters.ChannelTests) ... 
ok
test_sequential_ids (test.test__xxsubinterpreters.ChannelTests) ... ok
test_after_destroy_all (test.test__xxsubinterpreters.CreateTests) ... ok
test_after_destroy_some (test.test__xxsubinterpreters.CreateTests) ... ok
test_in_main (test.test__xxsubinterpreters.CreateTests) ... ok
test_in_subinterpreter (test.test__xxsubinterpreters.CreateTests) ... FAIL
test_in_thread (test.test__xxsubinterpreters.CreateTests) 

[issue33723] test_time.test_thread_time() failed on AMD64 Debian root 3.x

[STINNER Victor]

New submission from STINNER Victor :

AMD64 Debian root 3.x:

http://buildbot.python.org/all/#/builders/27/builds/1067

==
FAIL: test_thread_time (test.test_time.TimeTestCase)
--
Traceback (most recent call last):
  File "/root/buildarea/3.x.angelico-debian-amd64/build/Lib/test/test_time.py", 
line 536, in test_thread_time
self.assertGreaterEqual(stop - start, 0.020)  # machine busy?
AssertionError: 0.01994311399984 not greater than or equal to 0.02

--
components: Tests
messages: 318344
nosy: pitrou, vstinner
priority: normal
severity: normal
status: open
title: test_time.test_thread_time() failed on AMD64 Debian root 3.x
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33470] Changes from GH-1638 (GH-3575, bpo-28411) are not documented in Porting to Python 3.7

[Ned Deily]

Change by Ned Deily :


--
nosy:  -ned.deily
priority: release blocker -> 
versions:  -Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33710] Deprecate gettext.lgettext()

[Barry A. Warsaw]

Barry A. Warsaw  added the comment:

+1 - I'm actually surprise it's still there. ;)  Given that the docs have a big 
red warning to avoid these in Python 3, let's start the process of removal.

Don't forget to also deprecate ldgettext(), lngettext(), and ldngettext()

https://docs.python.org/3/library/gettext.html#gettext.lgettext

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33701] test_datetime crashed (SIGSEGV) on Travis CI

[Stefan Krah]

Stefan Krah  added the comment:

A wild theory: Because of the new pervasive includes 
(-I/home/travis/multissl/openssl/1.1.0h/include -O3 
-I/home/travis/multissl/openssl/1.1.0h/include) some module picks up a wrong 
header.


But I just rebuilt https://travis-ci.org/python/cpython/jobs/385458840 and a 
different random seed is fine.


If the includes are responsible, I'd expect the crash to be independent of the 
random seed.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33470] Changes from GH-1638 (GH-3575, bpo-28411) are not documented in Porting to Python 3.7

[Paul Koning]

Paul Koning  added the comment:

FYI, I'm the one who created this problem back in 2012.  I just submitted a GDB 
patch for this, using PyImport_AppendInittab to define the built-in module at 
startup.  I'm not sure how I missed this originally; perhaps the documentation 
was not as clear back then or maybe I just overlooked the information.  The 
patch eliminates the call to _PyImport_FixBuiltins.

--
nosy: +pkoning

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32392] subprocess.run documentation does not have **kwargs

[Tobias Kunze]

Change by Tobias Kunze :


--
keywords: +patch
pull_requests: +6916
stage: needs patch -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33701] test_datetime crashed (SIGSEGV) on Travis CI

[STINNER Victor]

STINNER Victor  added the comment:

> test_datetime passes here with nearly identical conditions as on the CI 
> (Ubuntu 14.04, clang, same random seed):

I tried to reproduce the issue on a Ubuntu Trusty *VM* using clang 5.0, using 
the same random seed: I failed to reproduce the bug.

I ran test_numeric_tower with GCC USBAN, but there is no warning (I'm not sure 
that I enabled correctly USBAN!).

I tested test_numeric_tower in Valgrind: no obvious memory error.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33701] test_datetime crashed (SIGSEGV) on Travis CI

[Stefan Krah]

Stefan Krah  added the comment:

test_datetime passes here with nearly identical conditions as on the CI (Ubuntu 
14.04, clang, same random seed):

Using random seed 987845
Run tests in parallel using 4 child processes
0:00:01 load avg: 1.70 [  1/415] test_html passed
0:00:01 load avg: 1.88 [  2/415] test_unicode_file_functions passed
0:00:02 load avg: 1.88 [  3/415] test_rlcompleter passed
0:00:03 load avg: 1.88 [  4/415] test_xml_etree passed
0:00:03 load avg: 1.88 [  5/415] test_codecencodings_kr passed
0:00:03 load avg: 1.88 [  6/415] test_dummy_thread passed
0:00:04 load avg: 1.88 [  7/415] test_source_encoding passed
0:00:05 load avg: 1.88 [  8/415] test_code passed
0:00:05 load avg: 1.88 [  9/415] test_curses passed
0:00:06 load avg: 1.88 [ 10/415] test_sys_setprofile passed
0:00:07 load avg: 2.05 [ 11/415] test_getopt passed
0:00:08 load avg: 2.05 [ 12/415] test_atexit passed
0:00:09 load avg: 2.05 [ 13/415] test_shlex passed
0:00:13 load avg: 2.13 [ 14/415] test_epoll passed
0:00:14 load avg: 2.13 [ 15/415] test_fileinput passed
0:00:26 load avg: 2.42 [ 16/415] test_embed passed
0:00:30 load avg: 2.54 [ 17/415] test_resource passed
0:00:31 load avg: 2.54 [ 18/415] test_augassign passed
0:00:36 load avg: 2.77 [ 19/415] test_gc passed -- running: test_io (33 sec)
0:00:38 load avg: 2.77 [ 20/415] test_multibytecodec passed -- running: test_io 
(35 sec)
0:00:38 load avg: 2.77 [ 21/415] test_contextlib passed -- running: test_io (35 
sec)
0:00:39 load avg: 2.77 [ 22/415] test_code_module passed -- running: test_io 
(36 sec)
0:00:50 load avg: 2.80 [ 23/415] test_select passed -- running: 
test_unicodedata (36 sec), test_io (47 sec)
0:00:51 load avg: 2.90 [ 24/415] test_posixpath passed -- running: 
test_unicodedata (37 sec), test_io (48 sec)
0:01:05 load avg: 3.07 [ 25/415] test_capi passed -- running: test_unicodedata 
(50 sec), test_io (62 sec)
0:01:06 load avg: 3.07 [ 26/415] test_string passed -- running: 
test_unicodedata (52 sec), test_io (63 sec)
0:01:08 load avg: 3.06 [ 27/415] test_unicodedata passed (52 sec) -- running: 
test_io (65 sec)
0:01:09 load avg: 3.06 [ 28/415] test_iter passed -- running: test_io (66 sec)
0:01:09 load avg: 3.06 [ 29/415] test_largefile passed -- running: test_io (66 
sec)
0:01:10 load avg: 3.06 [ 30/415] test_xxtestfuzz passed -- running: test_io (67 
sec), test_datetime (30 sec)
0:01:10 load avg: 3.06 [ 31/415] test_pkg passed -- running: test_io (67 sec), 
test_datetime (31 sec)
0:01:11 load avg: 3.06 [ 32/415] test_datetime passed (30 sec) -- running: 
test_io (67 sec)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33721] os.path.exists() ought to return False if pathname contains NUL

[Matthew Barnett]

Matthew Barnett  added the comment:

It also raises a ValueError on Windows. For other invalid paths on Windows it 
returns False.

--
nosy: +mrabarnett

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33722] Document builtins in mock_open

[Jay Crotts]

New submission from Jay Crotts :

The examples on using mock_open only include instances where objects are mocked 
in the REPL, so '__main__'.open is replaced. Commonly objects are mocked for 
use in other test modules, so builtins.open would be used instead.

A note about this in the documentation would be useful not familiar with python 
internals. I'm happy to do a PR for it.

--
assignee: docs@python
components: Documentation
messages: 318337
nosy: docs@python, jcrotts
priority: normal
severity: normal
status: open
title: Document builtins in mock_open
type: enhancement
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33668] Wrong behavior of help function on module

[Ivan Levkivskyi]

Ivan Levkivskyi  added the comment:

Adding Yury as an inspect expert. I don't think this is something urgent, we 
can probably postpone this to 3.7.1.

--
nosy: +yselivanov

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33668] Wrong behavior of help function on module

[Ivan Levkivskyi]

Ivan Levkivskyi  added the comment:

Hm, replacing the return with a random string, this leads to another crash:

Traceback (most recent call last):
  File "", line 1, in 
  File "/Users/ilevkivskyi/src/cpython/Lib/_sitebuiltins.py", line 103, in 
__call__
return pydoc.help(*args, **kwds)
  File "/Users/ilevkivskyi/src/cpython/Lib/pydoc.py", line 1895, in __call__
self.help(request)
  File "/Users/ilevkivskyi/src/cpython/Lib/pydoc.py", line 1954, in help
else: doc(request, 'Help on %s:', output=self._output)
  File "/Users/ilevkivskyi/src/cpython/Lib/pydoc.py", line 1674, in doc
pager(render_doc(thing, title, forceload))
  File "/Users/ilevkivskyi/src/cpython/Lib/pydoc.py", line 1667, in render_doc
return title % desc + '\n\n' + renderer.document(object, name)
  File "/Users/ilevkivskyi/src/cpython/Lib/pydoc.py", line 385, in document
if inspect.ismodule(object): return self.docmodule(*args)
  File "/Users/ilevkivskyi/src/cpython/Lib/pydoc.py", line 1157, in docmodule
for importer, modname, ispkg in pkgutil.iter_modules(object.__path__):
  File "/Users/ilevkivskyi/src/cpython/Lib/pkgutil.py", line 123, in 
iter_modules
raise ValueError("path must be None or list of paths to look for "
ValueError: path must be None or list of paths to look for modules in

The reason is that `__getattr__` is also triggered when a special attribute is 
looked up. I am not sure what to do with this. This is a bit inconsistent with 
how classes behave, where e.g. `__len__` is never searched on an instance. But 
modules are special in many other ways, so maybe we can just fix pydoc (and 
other tools like inspect) to expect some ill-typed values in special module 
attributes and fail gracefully?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33721] os.path.exists() ought to return False if pathname contains NUL

[pacujo]

New submission from pacujo :

os.path.exists() returns True or False for all imaginable string arguments 
except for one that contains NUL ("\0") (Linux). This behavior is not 
documented in the library. Moreover, it can easily lead to accidents if  an 
externally supplied pathname were to contain a NUL because most test suites 
would not try to cover such a pathname.

I propose os.path.exists() should return False even in this case.

--
components: Library (Lib)
messages: 318334
nosy: pacujo
priority: normal
severity: normal
status: open
title: os.path.exists() ought to return False if pathname contains NUL
type: behavior
versions: Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33668] Wrong behavior of help function on module

[Serhiy Storchaka]

Change by Serhiy Storchaka :


--
nosy: +levkivskyi

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33711] Could not find externals/db-* in msi.py on license generation

[Ned Deily]

Change by Ned Deily :


--
nosy: +steve.dower, zach.ware

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32604] Expose the subinterpreters C-API in Python for testing use.

[Eric Snow]

Eric Snow  added the comment:


New changeset 110bc01407ac8c75545d0386577c6e17254d97d9 by Eric Snow in branch 
'master':
bpo-33615: Temporarily disable a test that is triggering crashes on a few 
buildbots. (gh-7288)
https://github.com/python/cpython/commit/110bc01407ac8c75545d0386577c6e17254d97d9


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33615] test__xxsubinterpreters crashed on x86 Gentoo Refleaks 3.x

[Eric Snow]

Eric Snow  added the comment:


New changeset 110bc01407ac8c75545d0386577c6e17254d97d9 by Eric Snow in branch 
'master':
bpo-33615: Temporarily disable a test that is triggering crashes on a few 
buildbots. (gh-7288)
https://github.com/python/cpython/commit/110bc01407ac8c75545d0386577c6e17254d97d9


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30618] readlink for pathlib paths

[Timo Furrer]

Change by Timo Furrer :


--
nosy: +tuxtimo

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33668] Wrong behavior of help function on module

[Timo Furrer]

Change by Timo Furrer :


--
nosy: +tuxtimo

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue28657] cmd.Cmd.get_help() implementation can't see do_*() methods added dynamically by setattr()

[Timo Furrer]

Change by Timo Furrer :


--
nosy: +tuxtimo

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[Steve Dower]

Steve Dower  added the comment:

I need to stop working on this right now, but here's the locals layout in a 
normal release build in r_object:

@rdi  @rdip = 0x0034`655ea3d0
0034`65403f60 @rsp+0x0080 v = 0x`
0034`65403fc0 @rsp+0x00e0   buf = char [256] ""
0034`654040c0 @rsp+0x01e0   buf = char [256] ""

In the PGO build, it looks like this:
00be`1e003b50 @rsp+0x0080 v = 0x`
00be`1e003b58 @rsp+0x0088   is_interned = 0n0
00be`1e003ef0 @rsp+0x0420   buf = char [256] ""
00be`1e003ff0 @rsp+0x0520   buf = char [256] ""

I need to ping the team and figure out why the buffers are so far removed from 
the rest of the stack, and figure out what's in the gap. That seems to be the 
core of the problem.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[Steve Dower]

Steve Dower  added the comment:

A crash in the test suite should be fixed, especially since we have protection 
against this crash (and a test that validates it).

In this case, apparently the stack allocation for each frame of r_object grew 
and now there isn't room for 2000 calls (the value of MAX_MARSHAL_STACK_DEPTH). 
This isn't really a robust way of handling it anyway, so I'll check out whether 
there's an easy way to safely probe the stack before recursing, otherwise we'll 
just have to cut the number a bit further.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[STINNER Victor]

STINNER Victor  added the comment:

> priority: normal -> release blocker

I don't think that it's a release blocker. test_marshal does only crash on 
corner cases which should not occur on usual "valid" data.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[Steve Dower]

Steve Dower  added the comment:

Ned, FYI

--
nosy: +ned.deily
priority: normal -> release blocker
versions: +Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[Steve Dower]

Steve Dower  added the comment:

The uploaded binary is compiled with PGO enabled (and trained on most of the 
test suite). I'll check it out - hopefully we don't need to do anything drastic 
and can get away with either a compiler update or disabling optimizations on a 
single function.

--
assignee:  -> steve.dower

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[STINNER Victor]

STINNER Victor  added the comment:

> I compiled the master branch of Python in release mode using VS2015 (MSC 
> v.1912 64 bit) and I failed to reproduce the crash

I also failed to reproduce the crash in the 3.7 branch.

I guess that the python.org binary has been compiled differently.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[STINNER Victor]

Change by STINNER Victor :


--
versions: +Python 3.7 -Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[STINNER Victor]

Change by STINNER Victor :


--
type:  -> crash

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[STINNER Victor]

STINNER Victor  added the comment:

I compiled the master branch of Python in release mode using VS2015 (MSC v.1912 
64 bit) and I failed to reproduce the crash:

* PCbuild/build.bat -e -p x64
* python -m test -v test_marshal
* no crash

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33719] Test failures on Python 3.7 beta 5 and Windows 10

[STINNER Victor]

STINNER Victor  added the comment:

> test_marshal.test_loads_2x_code(): Windows fatal exception: stack overflow

I created bpo-33720: "test_marshal: crash in Python 3.7b5 on Windows 10".

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33720] test_marshal: crash in Python 3.7b5 on Windows 10

[STINNER Victor]

New submission from STINNER Victor :

Follow-up of bpo-33719.

C:\Users\vstinner\AppData\Local\Programs\Python\Python37>python.exe -m test 
test_marshal -v
== CPython 3.7.0b5 (v3.7.0b5:abb8802389, May 31 2018, 01:54:01) [MSC v.1913 64 
bit (AMD64)]
== Windows-10-10.0.16299-SP0 little-endian
== cwd: C:\Users\vstinner\AppData\Local\Temp\test_python_3836
== CPU count: 2
== encodings: locale=cp1252, FS=utf-8
Run tests sequentially
0:00:00 [1/1] test_marshal
(...)
test_loads_2x_code (test.test_marshal.BugsTestCase) ... Windows fatal 
exception: stack overflow

Current thread 0x03a0 (most recent call first):
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\unittest\case.py",
 line 178 in handle
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\unittest\case.py",
 line 743 in assertRaises
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\test\test_marshal.py",
 line 215 in test_loads_2x_code
  (...)

Crashes in test_marshal is on old topic:

* bpo-1050
* bpo-2286
* bpo-25264
* bpo-22734
* bpo-27019

Current stack size: 2 million bytes (1.9 MiB)

PCbuild/python.vcxproj:  200
PCbuild/pythonw.vcxproj:  200

--
components: Tests, Windows
messages: 318323
nosy: paul.moore, steve.dower, tim.golden, vstinner, zach.ware
priority: normal
severity: normal
status: open
title: test_marshal: crash in Python 3.7b5 on Windows 10
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue12029] Allow catching virtual subclasses in except clauses

[Eric Snow]

Change by Eric Snow :


--
nosy: +eric.snow

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue32604] Expose the subinterpreters C-API in Python for testing use.

[Eric Snow]

Change by Eric Snow :


--
pull_requests: +6915

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33615] test__xxsubinterpreters crashed on x86 Gentoo Refleaks 3.x

[Eric Snow]

Change by Eric Snow :


--
pull_requests: +6914

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33479] Document tkinter and threads

[Mark Roseman]

Change by Mark Roseman :


--
pull_requests: +6913

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33719] Test failures on Python 3.7 beta 5 and Windows 10

[STINNER Victor]

New submission from STINNER Victor :

I ran the test suite on an installed Python 3.7 beta5 on Windows 10. The 
following tests fail:

* test_marshal.test_loads_2x_code(): Windows fatal exception: stack overflow
* test_pkg: failures when run with -X utf8
* test.test_tools.test_sundry.TestSundryScripts.test_sundry(): 
"optparse.BadOptionError: no such option: -m"

== test_marshal ==

C:\Users\vstinner\AppData\Local\Programs\Python\Python37>python.exe -m test 
test_marshal -v
== CPython 3.7.0b5 (v3.7.0b5:abb8802389, May 31 2018, 01:54:01) [MSC v.1913 64 
bit (AMD64)]
== Windows-10-10.0.16299-SP0 little-endian
== cwd: C:\Users\vstinner\AppData\Local\Temp\test_python_3836
== CPU count: 2
== encodings: locale=cp1252, FS=utf-8
Run tests sequentially
0:00:00 [1/1] test_marshal
(...)
test_loads_2x_code (test.test_marshal.BugsTestCase) ... Windows fatal 
exception: stack overflow

Current thread 0x03a0 (most recent call first):
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\unittest\case.py",
 line 178 in handle
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\unittest\case.py",
 line 743 in assertRaises
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\test\test_marshal.py",
 line 215 in test_loads_2x_code
  (...)

== test_pkg ==

C:\Users\vstinner\AppData\Local\Programs\Python\Python37>python.exe -X utf8 -m 
test -v test_pkg
== CPython 3.7.0b5 (v3.7.0b5:abb8802389, May 31 2018, 01:54:01) [MSC v.1913 64 
bit (AMD64)]
== Windows-10-10.0.16299-SP0 little-endian
== cwd: C:\Users\vstinner\AppData\Local\Temp\test_python_6984
== CPU count: 2
== encodings: locale=UTF-8, FS=utf-8
Run tests sequentially
0:00:00 [1/1] test_pkg
test_1 (test.test_pkg.TestPkg) ... ok
test_2 (test.test_pkg.TestPkg) ... ok
test_3 (test.test_pkg.TestPkg) ... ok
test_4 (test.test_pkg.TestPkg) ... ERROR
test_5 (test.test_pkg.TestPkg) ... ok
test_6 (test.test_pkg.TestPkg) ... ok
test_7 (test.test_pkg.TestPkg) ... FAIL
test_8 (test.test_pkg.TestPkg) ... ok

==
ERROR: test_4 (test.test_pkg.TestPkg)
--
Traceback (most recent call last):
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\test\test_pkg.py",
 line 180, in test_4
self.run_code(s)
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\test\test_pkg.py",
 line 69, in run_code
exec(textwrap.dedent(code), globals(), {"self": self})
  File "", line 2, in 
  File "C:\Users\vstinner\AppData\Local\Temp\tmpeeb0h5ra\t4.py", line 1, in 

RuntimeError: Shouldnt load t4.py

==
FAIL: test_7 (test.test_pkg.TestPkg)
--
Traceback (most recent call last):
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\test\test_pkg.py",
 line 260, in test_7
'__name__', '__package__', '__path__', '__spec__'])
AssertionError: Lists differ: ['__c[34 chars]__loader__', '__name__', 
'__package__', '__spec__'] != ['__c[34 chars]__loader__', '__name__', 
'__package__', '__path__', '__spec__']

First differing element 6:
'__spec__'
'__path__'

Second list contains 1 additional elements.
First extra element 7:
'__spec__'

  ['__cached__',
   '__doc__',
   '__file__',
   '__loader__',
   '__name__',
   '__package__',
+  '__path__',
   '__spec__']

--
Ran 8 tests in 0.156s

FAILED (failures=1, errors=1)
test test_pkg failed
test_pkg failed

1 test failed:
test_pkg

Total duration: 187 ms
Tests result: FAILURE

== test_tools ==


C:\Users\vstinner\AppData\Local\Programs\Python\Python37>python.exe -m test -v 
test_tools -m test_sundry
== CPython 3.7.0b5 (v3.7.0b5:abb8802389, May 31 2018, 01:54:01) [MSC v.1913 64 
bit (AMD64)]
== Windows-10-10.0.16299-SP0 little-endian
== cwd: C:\Users\vstinner\AppData\Local\Temp\test_python_7472
== CPU count: 2
== encodings: locale=cp1252, FS=utf-8
Run tests sequentially
0:00:00 [1/1] test_tools
test_analyze_dxp_import (test.test_tools.test_sundry.TestSundryScripts) ... ok
test_sundry (test.test_tools.test_sundry.TestSundryScripts) ... Usage: 2to3 
[options] file|dir ...

__main__.py: error: no such option: -m
ERROR
test_sundry_windows (test.test_tools.test_sundry.TestSundryScripts) ... ok

==
ERROR: test_sundry (test.test_tools.test_sundry.TestSundryScripts)
--
Traceback (most recent call last):
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\optparse.py", 
line 1387, in parse_args
stop = self._process_args(largs, rargs, values)
  File 
"C:\Users\vstinner\AppData\Local\Programs\Python\Python37\lib\optparse.py", 
line 1431, in _process_args

[issue33597] Compact PyGC_Head

[Antoine Pitrou]

Antoine Pitrou  added the comment:

Here is a micro-benchmark of GC overhead:

* before:

$ ./python -m timeit -s "import gc, doctest, ftplib, asyncio, email, 
http.client, pydoc, pdb, fractions, decimal, difflib, textwrap, statistics, 
shutil, shelve, lzma, concurrent.futures, telnetlib, smtpd, tkinter.tix, trace, 
distutils, pkgutil, tabnanny, pickletools, dis, argparse" "gc.collect()"
100 loops, best of 5: 2.41 msec per loop

* after:

$ ./python -m timeit -s "import gc, doctest, ftplib, asyncio, email, 
http.client, pydoc, pdb, fractions, decimal, difflib, textwrap, statistics, 
shutil, shelve, lzma, concurrent.futures, telnetlib, smtpd, tkinter.tix, trace, 
distutils, pkgutil, tabnanny, pickletools, dis, argparse" "gc.collect()"
100 loops, best of 5: 2.52 msec per loop

So it's a 4% slowdown, but GC runs themselves are a minor fraction of usual 
programs' runtime, so I'm not sure that matters.  Though it would be better to 
test on an actual GC-heavy application.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33684] parse failed for mutibytes characters, encode will show in \xxx

[Roundup Robot]

Change by Roundup Robot :


--
pull_requests: +6912

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Antoine Pitrou]

Antoine Pitrou  added the comment:

Yes, tp_clear can be called with refcount > 0.  It's exactly why it's
separate from tp_dealloc, actually :-)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Stefan Krah]

Stefan Krah  added the comment:

Well yes, I still want to understand tp_clear(). :)

The docs are a bit vague.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33714] module can set an exception in tp_clear

[STINNER Victor]

Change by STINNER Victor :


--
nosy: +petr.viktorin

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[STINNER Victor]

STINNER Victor  added the comment:

If the bug cannot occur, just add "assert(!PyErr_Occurred());" no?

--
nosy: +vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33714] module can set an exception in tp_clear

[STINNER Victor]

Change by STINNER Victor :


--
nosy: +vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33712] OrderedDict can set an exception in tp_clear

[STINNER Victor]

STINNER Victor  added the comment:

> The tp_clear handler of OrderedDict can set an exception when fail to 
> allocate a nodes cache for an empty dict. An exception in tp_clear is not 
> expected and caused a crash in the garbage collector.

If it's a cache, it would be better to cancel the caching, and just destroy the 
dictionary, no?

--
nosy: +vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Stefan Krah]

Stefan Krah  added the comment:

Well, the example would need exports:

>>> a = [bytes()]
>>> a.append(memoryview(a[0]))
>>> a.append(memoryview(a[1]))
>>> a.append(a)
>>> a
[b'', , , [...]]


The first memoryview has one export, so its refcount > 0.

Do I fundamentally misunderstand tp_clear() and tp_clear() can be called on 
objects with refcount > 0?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33706] Segfault in command line processing due to buffer over-read

[STINNER Victor]

STINNER Victor  added the comment:

Thank you Christoph Gohlke for your bug report and your fix! I fixed 3.7 and 
master branches.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33718] Enhance regrtest: meta-ticket for multiple changes

[STINNER Victor]

New submission from STINNER Victor :

Lib/test/libregrtest/ (python3 -m test) is the test runner used to run the 
Python test suite.

I create this issue to have a bpo number for future enhancements.

Example of recent enhancements:

* https://github.com/python/cpython/pull/7105
* https://github.com/python/cpython/pull/7159

This issue should also help me to make sure that I backport enhancements from 
master to 2.7, 3.6 and 3.7 branches.

--
messages: 318314
nosy: vstinner
priority: normal
severity: normal
status: open
title: Enhance regrtest: meta-ticket for multiple changes
type: enhancement
versions: Python 2.7, Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33717] Enhance test.pythoninfo: meta-ticket for multiple changes

[STINNER Victor]

Change by STINNER Victor :


--
title: Enhance test.pythinfo: meta-ticket for multiple changes -> Enhance 
test.pythoninfo: meta-ticket for multiple changes

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue30849] test_stress_delivery_dependent() of test_signal randomly fails on AMD64 Debian root 3.6/3.x

[STINNER Victor]

STINNER Victor  added the comment:

Recent failure on AMD64 Debian root 3.7:

http://buildbot.python.org/all/#/builders/127/builds/361

0:03:33 load avg: 1.38 [140/415/1] test_signal failed

==
FAIL: test_stress_delivery_dependent (test.test_signal.StressTest)
--
Traceback (most recent call last):
  File 
"/root/buildarea/3.7.angelico-debian-amd64/build/Lib/test/test_signal.py", line 
1116, in test_stress_delivery_dependent
self.assertEqual(len(sigs), N, "Some signals were lost")
AssertionError: 3586 != 1 : Some signals were lost

==
FAIL: test_stress_delivery_simultaneous (test.test_signal.StressTest)
--
Traceback (most recent call last):
  File 
"/root/buildarea/3.7.angelico-debian-amd64/build/Lib/test/test_signal.py", line 
1149, in test_stress_delivery_simultaneous
self.assertEqual(len(sigs), N, "Some signals were lost")
AssertionError: 8884 != 1 : Some signals were lost

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33701] test_datetime crashed (SIGSEGV) on Travis CI

[STINNER Victor]

STINNER Victor  added the comment:

> https://travis-ci.org/python/cpython/jobs/385458840

$ clang --version
clang version 5.0.0 (tags/RELEASE_500/final)
Target: x86_64-unknown-linux-gnu
Thread model: posix
InstalledDir: /usr/local/clang-5.0.0/bin

./configure --with-pydebug

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33701] test_datetime crashed (SIGSEGV) on Travis CI

[STINNER Victor]

STINNER Victor  added the comment:

> https://travis-ci.org/python/cpython/jobs/385458840

pythoninfo:

Py_DEBUG: Yes (sys.gettotalrefcount() present)
_decimal.__libmpdec_version__: 2.4.2
builtins.float.double_format: IEEE, little-endian
builtins.float.float_format: IEEE, little-endian
os.cpu_count: 48
os.environ[CC]: clang -pthread
os.uname: posix.uname_result(sysname='Linux', 
nodename='travis-job-python-cpython-385458840.travisci.net', 
release='4.4.0-112-generic', version='#135-Ubuntu SMP Fri Jan 19 11:48:36 UTC 
2018', machine='x86_64')
platform.architecture: 64bit ELF
platform.platform: Linux-4.4.0-112-generic-x86_64-with-debian-jessie-sid
sys.version: 3.7.0b4+ (heads/3.7:4f53e2a, May 30 2018, 00:26:26)  [Clang 5.0.0 
(tags/RELEASE_500/final)]

sysconfig[CCSHARED]: -fPIC
sysconfig[CC]: clang -pthread
sysconfig[CFLAGS]: -Wno-unused-result -Wsign-compare -g -O0 -Wall 
-Wstrict-prototypes -I/home/travis/multissl/openssl/1.1.0h/include -O3 
-I/home/travis/multissl/openssl/1.1.0h/include -O3
sysconfig[CONFIG_ARGS]: '--with-pydebug' 'CC=clang' 
'CFLAGS=-I/home/travis/multissl/openssl/1.1.0h/include -O3' 
'LDFLAGS=-L/home/travis/multissl/openssl/1.1.0h/lib'
sysconfig[HOST_GNU_TYPE]: x86_64-pc-linux-gnu
sysconfig[OPT]: -g -O0 -Wall -Wstrict-prototypes
sysconfig[PY_CFLAGS]: -Wno-unused-result -Wsign-compare -g -O0 -Wall 
-Wstrict-prototypes -I/home/travis/multissl/openssl/1.1.0h/include -O3 
-I/home/travis/multissl/openssl/1.1.0h/include -O3
sysconfig[PY_CFLAGS_NODIST]: -std=c99 -Wextra -Wno-unused-result 
-Wno-unused-parameter -Wno-missing-field-initializers 
-Werror=implicit-function-declaration
sysconfig[PY_LDFLAGS]: -L/home/travis/multissl/openssl/1.1.0h/lib 
-L/home/travis/multissl/openssl/1.1.0h/lib
sysconfig[Py_DEBUG]: 1
sysconfig[Py_ENABLE_SHARED]: 0

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33717] Enhance test.pythinfo: meta-ticket for multiple changes

[STINNER Victor]

New submission from STINNER Victor :

Lib/test/pythoninfo.py is a tool to dump informations to help to debug test 
failures.

I create this issue to have a bpo number for future enhancements. For example, 
I now would like to get the version of the C compiler.

--
components: Tests
messages: 318309
nosy: vstinner
priority: normal
severity: normal
status: open
title: Enhance test.pythinfo: meta-ticket for multiple changes
type: enhancement
versions: Python 2.7, Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33706] Segfault in command line processing due to buffer over-read

[miss-islington]

miss-islington  added the comment:


New changeset c6de46e180e81508a3b43341791b56418bd811f9 by Miss Islington (bot) 
in branch '3.7':
bpo-33706: Fix pymain_parse_cmdline_impl() (GH-7283)
https://github.com/python/cpython/commit/c6de46e180e81508a3b43341791b56418bd811f9


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33709] test.support.FS_NONASCII returns incorrect result in Windows with non-US locale

[STINNER Victor]

STINNER Victor  added the comment:

> FAIL: test_expandvars_nonascii (__main__.NtCommonTest)

What is your Python version?

Python uses UTF-8 to encode paths on Windows since Python 3.6:
https://vstinner.github.io/python36-utf8-windows.html

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33701] test_datetime crashed (SIGSEGV) on Travis CI

[STINNER Victor]

STINNER Victor  added the comment:

> How would #33627 support the theory that this is a bug in _decimal?  As I 
> read it, #33627 is in test_complex, which supports the "unrelated random" 
> theory.

I'm not sure of anything. It's just a bet. I asked you to have a look, just in 
case you see something "obvious". My theory for bpo-33627:
https://bugs.python.org/issue33627#msg318304

None of these bugs make any sense :-)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33627] test-complex of test_numeric_tower.test_complex() crashes intermittently on Ubuntu buildbots

[Stefan Krah]

Stefan Krah  added the comment:

Good luck finding it then, Victor.

--
nosy: +skrah

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Antoine Pitrou]

Antoine Pitrou  added the comment:

Serhiy is right about the theoretical concern here.  However, it's probably 
quite difficult to find a concrete situation where this occurs, because we're 
talking about mbuf_clear and the managerbuffer object can't really get involved 
in a reference cycle by itself (not in normal use anyway): the memoryview 
object does, but it's a different thing.

By the way: PyBuffer_Release() returns void, so IMO it's a bug if it can return 
with an exception set.  We should fix that rather than focus on mbuf_clear().

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33627] test-complex of test_numeric_tower.test_complex() crashes intermittently on Ubuntu buildbots

[STINNER Victor]

STINNER Victor  added the comment:

I bet that the bug comes from _decimal. Fraction is implemented in pure Python, 
and complex type is supposed to be simpler than the _decimal.Decimal type.

The whole mystery is why the bug only occurs in 
test_numeric_tower.test_complex() and why not in test_complex, test_fractions 
or test_decimal!? And why the bug is random.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33606] Improve logging performance when logger disabled

[Timo Furrer]

Change by Timo Furrer :


--
keywords: +patch
pull_requests: +6911
stage: needs patch -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33627] test-complex of test_numeric_tower.test_complex() crashes intermittently on Ubuntu buildbots

[STINNER Victor]

STINNER Victor  added the comment:

> Lib/test/test_numeric_tower.py:184 in test_complex

The crash occurs at:

def test_complex(self):
# comparisons with complex are special:  equality and inequality
# comparisons should always succeed, but order comparisons should
# raise TypeError.
z = 1.0 + 0j
w = -3.14 + 2.7j

for v in 1, 1.0, F(1), D(1), complex(1):  # <~~ HERE
self.assertEqual(z, v)
self.assertEqual(v, z)

where F = fractions.Fraction and D = decimal.Decimal

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33706] Segfault in command line processing due to buffer over-read

[miss-islington]

Change by miss-islington :


--
pull_requests: +6910

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33706] Segfault in command line processing due to buffer over-read

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 58d1683255abb0df4fc70960da6121aeaa41e1d1 by Victor Stinner in 
branch 'master':
bpo-33706: Fix pymain_parse_cmdline_impl() (GH-7283)
https://github.com/python/cpython/commit/58d1683255abb0df4fc70960da6121aeaa41e1d1


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33532] test_multiprocessing_forkserver: TestIgnoreEINTR.test_ignore() fails on Travis CI

[STINNER Victor]

Change by STINNER Victor :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 2.7, Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Stefan Krah]

Stefan Krah  added the comment:

The point is that *no garbage collection is triggered* if self->exports > 0.

It would be a major bug if it were and I suspect it would be reported within a 
week.  Fortunately, no such bug has been reported in 6 years.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33532] test_multiprocessing_forkserver: TestIgnoreEINTR.test_ignore() fails on Travis CI

[STINNER Victor]

STINNER Victor  added the comment:

> Did your PR fix the issue?

The bug was that *sometimes* on Travis CI, and only on Travis CI (!?), writing 
1 MiB into the multiprocessing pipe didn't block. The bug is really strange 
because it is only reproduced on the clang Linux job of Travis CI which runs 
tests in parallel. Not on the Linux gcc which runs tests sequentially in 
coverage. Moreover, the failure only occurs for a specific order of tests.

You can easily reproduce the issue if you reduce the size of the data written 
into the pipe at the end of _test_ignore(). If the write (send_bytes) doesn't 
block, you get the same error.

I'm confident that writing 4 MiB instead of 1 MiB will fix the issue. I saw the 
test passing with 4 MiB whereas it failed with 1 MiB, when I fixed the test 
order.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

The GC calls tp_clear() if the memoryview is a part of the reference loop.

a = [memoryview(...)]
a.append(a)
del a

The GC will call tp_clear() of the list or the memoryview. What will be called 
first is not specified.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33706] Segfault in command line processing due to buffer over-read

[STINNER Victor]

Change by STINNER Victor :


--
pull_requests: +6909
stage:  -> patch review

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Stefan Krah]

Stefan Krah  added the comment:

Yes, but who calls tp_clear() if the memoryview is not being deallocated?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Stefan Krah]

Stefan Krah  added the comment:

This looks the same as #25525.  I think it cannot happen, and no one has ever 
reported an actual issue for 6 years now.

You *really* need to show a reproducer if you assert that something can crash.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

See the delete_garbage() function line 770 in Modules/gcmodule.c for changes in 
the master branch relevant to this issue. See Py_FatalError() in the collect() 
function at line 974 for a crash.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

I don't know how to reproduce a failure in tp_clear(). I just can't prove that 
it never fails. Maybe it is needed a bug in the implementation of the buffer 
protocol in third-party extension.

If it should not happen then we can just add

assert(!PyErr_Occurred());

or

if (PyErr_Occurred()) {
PyErr_WriteUnraisable(NULL);
}

It is better to crash in memoryview.c than in the garbage collector if this 
crash is caused by incorrect buffer protocol implementation.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33716] test_concurrent_futures.test_crash() failed on x86 Windows7 3.7

[STINNER Victor]

New submission from STINNER Victor :

x86 Windows7 3.7:
http://buildbot.python.org/all/#/builders/111/builds/299

test_crash (test.test_concurrent_futures.ProcessPoolSpawnExecutorDeadlockTest) 
... 26.57s ok
...
test_crash (test.test_concurrent_futures.ProcessPoolSpawnExecutorDeadlockTest) 
... 90.96s FAIL
...

==
FAIL: test_crash 
(test.test_concurrent_futures.ProcessPoolSpawnExecutorDeadlockTest)
--
Traceback (most recent call last):
  File 
"D:\cygwin\home\db3l\buildarea\3.7.bolen-windows7\build\lib\test\test_concurrent_futures.py",
 line 131, in tearDown
self.assertLess(dt, 60, "synchronization issue: test lasted too long")
AssertionError: 90.95560574531555 not less than 60 : synchronization issue: 
test lasted too long


This buildbot is known to be slow.

See also bpo-33715.

--
components: Tests, Windows
messages: 318294
nosy: paul.moore, steve.dower, tim.golden, vstinner, zach.ware
priority: normal
severity: normal
status: open
title: test_concurrent_futures.test_crash() failed on x86 Windows7 3.7
versions: Python 3.7

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33687] uu.py calls os.path.chmod which doesn't exist

[Timo Furrer]

Timo Furrer  added the comment:

I've added a test and updated the PR.

--
nosy: +tuxtimo

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33715] test_multiprocessing_spawn.test_wait_result() failed on x86 Windows7 3.x

[STINNER Victor]

New submission from STINNER Victor :

http://buildbot.python.org/all/#/builders/58/builds/932

==
FAIL: test_wait_result 
(test.test_multiprocessing_spawn.WithManagerTestCondition)
--
Traceback (most recent call last):
  File 
"D:\cygwin\home\db3l\buildarea\3.x.bolen-windows7\build\lib\test\_test_multiprocessing.py",
 line 1485, in test_wait_result
self.assertTrue(c.wait(10))
AssertionError: False is not true

Note: this buildbot is known to be slow.

See also bpo-30317 and bpo-30356. (And maybe also bpo-31687.)

--
components: Tests, Windows
messages: 318292
nosy: davin, paul.moore, pitrou, steve.dower, tim.golden, vstinner, zach.ware
priority: normal
severity: normal
status: open
title: test_multiprocessing_spawn.test_wait_result() failed on x86 Windows7 3.x
versions: Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33713] memoryview can set an exception in tp_clear

[Stefan Krah]

Stefan Krah  added the comment:

Could you please show how tp_clear() can be called when self->exports > 0? It 
should not happen.

#33622 is a big issue with many commits.  Would it be possible to extract the 
relevant part?

--
nosy: +pitrou

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33622] Fix and improve errors handling in the garbage collector

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

See issue33712, issue33713 and issue33714 for three cases in the stdlib where 
an exception can be set in the tp_clear handler. This caused a crash in the 
garbage collector, or can be just silenced if failed at the shutdown stage. In 
the master branch it will cause writing a traceback to the stderr. It would be 
better to handle exceptions locally in the tp_clear handlers. But perhaps it 
may be worth to handle leaked exceptions in the garbage collector too. I'm just 
not sure about a solution. Writing a traceback to the stderr can cause a 
regression if it was just silenced before. But silencing it can hide bugs.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue33714] module can set an exception in tp_clear

[Serhiy Storchaka]

New submission from Serhiy Storchaka :

The tp_clear handler of the module object calls a custom clear function if the 
PyModuleDef.m_clear field is set. This function can set an exception which will 
be leaked to the garbage collector. An exception in tp_clear is not expected 
and caused a crash in the garbage collector. In the master branch it will cause 
just writing a traceback to stderr (see issue33622), but in any case it would 
be better to handle the failure locally in the module's tp_clear.

--
components: Interpreter Core
messages: 318289
nosy: serhiy.storchaka
priority: normal
severity: normal
status: open
title: module can set an exception in tp_clear
type: crash
versions: Python 2.7, Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com