[issue45357] Idle does not check user config for extention configuration

[Terry J. Reedy]

Terry J. Reedy  added the comment:

I am puzzled by your report. As explained in the top of 
idlelib/confix-extensions.def, the options for four features are still defined 
there for compatibility reasons and user changes to those option *are* stored 
in ~/.idlerc/config-extensions.cfg and read on startup.  At least on Windows 
with 3.9 and 3.11. I also tested changing options for test extension zzdummy 
and that works also.  For instance, click enable, exit dialog, exit IDLE, 
reload, edit something, select Format, and the z options are listed.  The 
default config is not changed.  What tests did you run?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45405] Python does not configure on darwin using public llvm / clang version 13.0.0

[debohman]

debohman  added the comment:

Okay, I see from the developer guide, that the generated files should be 
included. Is it permissible to use the current version of autoconf?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45405] Python does not configure on darwin using public llvm / clang version 13.0.0

[debohman]

Change by debohman :


--
title: Python 3.10.0 does not configure on darwin using public llvm / clang -> 
Python does not configure on darwin using public llvm / clang version 13.0.0
versions:  -Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45405] Python 3.10.0 does not configure on darwin using public llvm / clang

[debohman]

debohman  added the comment:

Also, what branch should the PR be on, 3.10 or main?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45405] Python 3.10.0 does not configure on darwin using public llvm / clang

[debohman]

debohman  added the comment:

I can put together a pull request to fix this. The fix is in configure.ac.

Should I include the mods from the autoreconf in the PR?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45407] Support buffer protocol for _struct.Struct format argument

[Dong-hee Na]

Change by Dong-hee Na :


--
nosy: +corona10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45351] List all sockets in TCP echo server using streams

[Eric V. Smith]

Eric V. Smith  added the comment:

I'm not clear why you're suggesting this change. Is this additional 
functionality, or is the current example broken? Is the text wrong, or just the 
code?

--
nosy: +eric.smith

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45382] platform() is not able to detect windows 11

[Eryk Sun]

Eryk Sun  added the comment:

> use the build number as reference instead of the major.minor

It could check the (major, minor, build) tuple, which allows reporting 10.1+ as 
"post11" and minimizes hard coding of build numbers. For example, given 
win32_ver() iterates by (major, minor, build) thresholds:

_WIN32_CLIENT_RELEASES = [
((10, 1, 0), "post11"),
((10, 0, 22000), "11"),
((6, 4, 0), "10"),
((6, 3, 0), "8.1"),
((6, 2, 0), "8"),
((6, 1, 0), "7"),
((6, 0, 0), "Vista"),
((5, 2, 3790), "XP64"),
((5, 2, 0), "XPMedia"),
((5, 1, 0), "XP"),
((5, 0, 0), "2000"),
]

_WIN32_SERVER_RELEASES = [
((10, 1, 0), "post2022Server"),
((10, 0, 20348), "2022Server"),
((10, 0, 17763), "2019Server"),
((6, 4, 0), "2016Server"),
((6, 3, 0), "2012ServerR2"),
((6, 2, 0), "2012Server"),
((6, 1, 0), "2008ServerR2"),
((6, 0, 0), "2008Server"),
((5, 2, 0), "2003Server"),
((5, 0, 0), "2000Server"),
]

In win32_ver():

if major >= 5: # NT systems
if getattr(winver, 'product_type', None) == 3: # VER_NT_SERVER
release_list = _WIN32_SERVER_RELEASES
else:
release_list = _WIN32_CLIENT_RELEASES
ver = major, minor, build
for release_ver, release_name in release_list:
if ver >= release_ver:
release = release_name
break

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45409] Support non-standard executables in venv

[Steve Dower]

Steve Dower  added the comment:

Pushed the branch so the changes are out there, but I still need to check (and 
probably fix) some handling of the Store package layout. The changes now will 
probably create some executables that won't work (pip.exe and idle.exe), so we 
might have to go back to the fixed list of executables.

I think the change to launcher.c is worth keeping though.

--
stage: patch review -> needs patch

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45409] Support non-standard executables in venv

[Steve Dower]

Change by Steve Dower :


--
keywords: +patch
pull_requests: +27135
stage: needs patch -> patch review
pull_request: https://github.com/python/cpython/pull/28817

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45409] Support non-standard executables in venv

[Steve Dower]

New submission from Steve Dower :

Currently the venv redirector on Windows is hardcoded for "python.exe" and 
"pythonw.exe". There is no good reason for this, and it's fairly easy to make 
the redirector able to invoke any executable in the base environment by 
inspecting its own name.

This would help support non-standard environments that include other entry 
points.

--
assignee: steve.dower
components: Windows
messages: 403450
nosy: paul.moore, steve.dower, tim.golden, vinay.sajip, zach.ware
priority: normal
severity: normal
stage: needs patch
status: open
title: Support non-standard executables in venv
type: enhancement
versions: Python 3.11

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Pablo Galindo Salgado]

Pablo Galindo Salgado  added the comment:


New changeset 4ce55a2353e07962280181df40af0135aef1cf51 by Pablo Galindo Salgado 
in branch '3.10':
[3.10] bpo-45408: Don't override previous tokenizer errors in the second parser 
pass (GH-28812). (GH-28813)
https://github.com/python/cpython/commit/4ce55a2353e07962280181df40af0135aef1cf51


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Pablo Galindo Salgado]

Change by Pablo Galindo Salgado :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45337] Create venv with pip fails when target dir is under userappdata using Microsoft Store python

[Steve Dower]

Change by Steve Dower :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45262] crash if asyncio is used before and after re-initialization if using python embedded in an application

[miss-islington]

miss-islington  added the comment:


New changeset 87f0156a229e4cda92ad8e50645c5a71030caf7c by Miss Islington (bot) 
in branch '3.9':
bpo-45262, asyncio: Fix cache of the running loop holder (GH-28796)
https://github.com/python/cpython/commit/87f0156a229e4cda92ad8e50645c5a71030caf7c


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45337] Create venv with pip fails when target dir is under userappdata using Microsoft Store python

[miss-islington]

miss-islington  added the comment:


New changeset 06935bd68e3d89a4cc3f08c1d15eaa651b79a523 by Miss Islington (bot) 
in branch '3.9':
bpo-45337: Use the realpath of the new executable when creating a venv on 
Windows (GH-28663)
https://github.com/python/cpython/commit/06935bd68e3d89a4cc3f08c1d15eaa651b79a523


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45337] Create venv with pip fails when target dir is under userappdata using Microsoft Store python

[miss-islington]

miss-islington  added the comment:


New changeset eabca6e593269301a0b7a36c4dc3525f04f5bb36 by Miss Islington (bot) 
in branch '3.10':
bpo-45337: Use the realpath of the new executable when creating a venv on 
Windows (GH-28663)
https://github.com/python/cpython/commit/eabca6e593269301a0b7a36c4dc3525f04f5bb36


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45262] crash if asyncio is used before and after re-initialization if using python embedded in an application

[miss-islington]

Change by miss-islington :


--
pull_requests: +27134
pull_request: https://github.com/python/cpython/pull/28816

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45262] crash if asyncio is used before and after re-initialization if using python embedded in an application

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +27133
pull_request: https://github.com/python/cpython/pull/28815

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45262] crash if asyncio is used before and after re-initialization if using python embedded in an application

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 392a89835371baa0fc4bf79ae479abb80661f57d by Matthias Reichl in 
branch 'main':
 bpo-45262, asyncio: Fix cache of the running loop holder (GH-28796)
https://github.com/python/cpython/commit/392a89835371baa0fc4bf79ae479abb80661f57d


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Pablo Galindo Salgado]

Change by Pablo Galindo Salgado :


--
pull_requests: +27132
pull_request: https://github.com/python/cpython/pull/28813

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Pablo Galindo Salgado]

Pablo Galindo Salgado  added the comment:


New changeset 0219017df7ec41839fd0d56a3076b5f09c58d313 by Pablo Galindo Salgado 
in branch 'main':
bpo-45408: Don't override previous tokenizer errors in the second parser pass 
(GH-28812)
https://github.com/python/cpython/commit/0219017df7ec41839fd0d56a3076b5f09c58d313


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45405] Python 3.10.0 does not configure on darwin using public llvm / clang

[debohman]

debohman  added the comment:

By "public llvm / clang", I mean the toolchain version released by the llvm 
project.

They just released version 13.0.0 last week.

The problem is that version 12 of llvm / clang did not implement 
--print-multiarch, so this logic in configure was not exercised due to:

if test x$PLATFORM_TRIPLET != x && test x$MULTIARCH != x; then

failing. In that case, $MULTIARCH would be a null string, so test x$MULTIARCH 
!= x would fail. It seems that the logic in configure needs to be updated so 
that it functions correctly on darwin where --print-multiarch is implemented.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Pablo Galindo Salgado]

Change by Pablo Galindo Salgado :


--
keywords: +patch
pull_requests: +27131
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/28812

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45337] Create venv with pip fails when target dir is under userappdata using Microsoft Store python

[miss-islington]

Change by miss-islington :


--
pull_requests: +27130
pull_request: https://github.com/python/cpython/pull/28811

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45337] Create venv with pip fails when target dir is under userappdata using Microsoft Store python

[Steve Dower]

Steve Dower  added the comment:


New changeset 6811fdaec825bd6ab64e358a4b480108f5634d2d by Steve Dower in branch 
'main':
bpo-45337: Use the realpath of the new executable when creating a venv on 
Windows (GH-28663)
https://github.com/python/cpython/commit/6811fdaec825bd6ab64e358a4b480108f5634d2d


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45337] Create venv with pip fails when target dir is under userappdata using Microsoft Store python

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 5.0 -> 6.0
pull_requests: +27129
pull_request: https://github.com/python/cpython/pull/28810

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Gregory P. Smith]

Gregory P. Smith  added the comment:

Marking release blocker as a crash is bad for a function that is documented as 
safe for use on untrusted input so long as it isn't large enough to overflow 
the stack.

https://docs.python.org/3/library/ast.html#ast.literal_eval

--
priority: normal -> release blocker

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16379] SQLite error code not exposed to python

[miss-islington]

miss-islington  added the comment:


New changeset 8deb7afbd847656842375119f8dbef8aea54 by Erlend Egeberg 
Aasland in branch 'main':
bpo-16379: Fix SQLite version checks in test_module_constants() (GH-28809)
https://github.com/python/cpython/commit/8deb7afbd847656842375119f8dbef8aea54


--
nosy: +miss-islington

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Łukasz Langa]

Łukasz Langa  added the comment:

Confirmed in 3.10 and 3.11:

>>> ast.literal_eval(r'''\
... \
... (\
... \ ''')
fish: Job 1, 'python' terminated by signal SIGSEGV (Address boundary error)

3.9 raises SyntaxError:

>>> ast.literal_eval(r'''
... \
... (\
... \ ''')
Traceback (most recent call last):
  File "", line 1, in 
  File "ast.py", line 62, in literal_eval
node_or_string = parse(node_or_string, mode='eval')
  File "ast.py", line 50, in parse
return compile(source, filename, mode, flags,
  File "", line 4
\
^
SyntaxError: unexpected character after line continuation character

--
nosy: +lukasz.langa

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue16379] SQLite error code not exposed to python

[Erlend E. Aasland]

Change by Erlend E. Aasland :


--
pull_requests: +27128
pull_request: https://github.com/python/cpython/pull/28809

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37157] shutil: add reflink=False to file copy functions to control clone/CoW copies (use copy_file_range)

[STINNER Victor]

Change by STINNER Victor :


--
nosy:  -vstinner

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45403] test_sys: test_stdlib_dir() fails when Python is built outside the source tree

[STINNER Victor]

Change by STINNER Victor :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45403] test_sys: test_stdlib_dir() fails when Python is built outside the source tree

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 768aaf6c433e6a13b82c7bdebd0062c7472c1fc7 by Victor Stinner in 
branch 'main':
bpo-45403: Fix test_sys.test_stdlib_dir() (GH-28785)
https://github.com/python/cpython/commit/768aaf6c433e6a13b82c7bdebd0062c7472c1fc7


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45407] Support buffer protocol for _struct.Struct format argument

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

I prefer to remove the comment. The format string is a text by its nature, 
there is no reason to support arbitrary binary data. Bytes objects are only 
supported for compatibility (with Python 2 strings).

--
nosy: +serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45402] ERROR: test_sundry (test.test_tools.test_sundry.TestSundryScripts): SystemExit: ERROR: missing _freeze_module

[STINNER Victor]

STINNER Victor  added the comment:

Thanks Miro for the bug report, it's now fixed.

--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45402] ERROR: test_sundry (test.test_tools.test_sundry.TestSundryScripts): SystemExit: ERROR: missing _freeze_module

[STINNER Victor]

STINNER Victor  added the comment:


New changeset ff8859d965815e8b5af346bd90299cfa5568c855 by Victor Stinner in 
branch 'main':
bpo-45402: Fix test_tools.test_sundry() (GH-28786)
https://github.com/python/cpython/commit/ff8859d965815e8b5af346bd90299cfa5568c855


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Batuhan Taskaya]

Change by Batuhan Taskaya :


--
nosy: +BTaskaya

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45393] help() on operator precedence has confusing entries "await" "x" and "not" "x"

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

In past we could backport some simple documentation fixes to security-only 
branches. But currently only the release manager of the corresponded version 
has permission to commit to these branches, and we do not want to disturb them 
for such minor cause.

I concur with analysis of Zachary. All options look good to me.

--
nosy: +serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45401] logging TimedRotatingFileHandler must not rename devices like /dev/null

[Vinay Sajip]

Vinay Sajip  added the comment:

RotatingFileHandler is also affected by the same issue.

Both RotatingFileHandler and TimedRotatingFileHandler have a shouldRollover 
method which, if it returns False, should prevent rollover.

I would think that putting something like

if not os.path.isfile(self.baseFilename):
return False

at the top of each of these methods should avoid rolling over any thing that 
isn't a regular file - devices, pipes etc. Would you agree? Can you see any 
drawbacks?

I'm not sure this would cover sockets, but there are separate handlers for 
using sockets so there would be no reason for people to use sockets with file 
handlers. And of course sockets are a completely different sort of beast on 
Windows.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45116] Performance regression 3.10b1 and later on Windows: Py_DECREF() not inlined in PGO build

[Steve Dower]

Steve Dower  added the comment:

If we know which parts of the function are critical, perhaps we should 
be designing a PGO profile that actually hits them all? The current 
profile is very arbitrary, basically just waiting for someone motivated 
enough to figure out a better one.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27580] CSV Null Byte Error

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

It looks to me that rejecting the null character is just an implementation 
artifact. 0 is used both as signalling value for "not set" character parameter 
and as the end-of-line character in the state automata. We can use different 
values outside of the range of Unicode characters (0-0x10). It will 
automatically enable support of null characters.

--
versions: +Python 3.11 -Python 3.6, Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue27580] CSV Null Byte Error

[Serhiy Storchaka]

Change by Serhiy Storchaka :


--
keywords: +patch
pull_requests: +27127
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/28808

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45116] Performance regression 3.10b1 and later on Windows: Py_DECREF() not inlined in PGO build

[Steve Dower]

Steve Dower  added the comment:

I would very much appreciate any new compiler be compatible with the 
standard Windows debuggers (windbg primarily, but I imagine most 
contributors would like it to keep working from VS).

Last I heard, clang is fine as a compiler for debugging if you use the 
MSVC linker to generate debug info, though it still isn't as complete as 
MSVC (ultimately by definition, since MSVC is the 
standard-by-implementation for this stuff). And I've got no idea 
how/whether link-time optimisation works when you mix tools, but I'd 
have to assume it doesn't.

Switching compiler may prevent me from being able to analyse crash 
reports (and by me, I mean the automated internal tools that do it for 
me), and certainly parts of the Windows build rely on MSVC-specific 
functionality right now (not in the main DLL) so we'd end up needing 
both for a full build.

Also, just to put it out there, I'm not volunteering to rewrite the 
build system :) If the steering council signs off on switching, I won't 
block it, but I have more interesting things to work on.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Gregory P. Smith]

Gregory P. Smith  added the comment:

(unable to reproduce on 3.9)

--
nosy: +gregory.p.smith
versions:  -Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45393] help() on operator precedence has confusing entries "await" "x" and "not" "x"

[Max]

Max  added the comment:

option 1 looks most attractive to me (and will also look most attractive in the 
rendering, IMHO -- certainly better than "await" "x", in any case).

P.S.: OK, thanks for explanations concerning 3.6 - 3.8. I do understand that it 
won't be fixed for these versions (not certain why not if possible at no cost), 
but I do not understand why these labels must be removed. The bug does exist 
but should simply be considered as "nofix" for these versions (or not), given 
that it's not in the "security" category. The fact that it won't be fixed, for 
whatever reason, should not mean that it should not be listed as existing, 
there.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Gregory P. Smith]

Change by Gregory P. Smith :


--
versions: +Python 3.10, Python 3.9

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45408] [fuzzer] Weird input with continuation and newlines causes null deref in parser

[Ammar Askar]

New submission from Ammar Askar :

>From the newly added ast.literal_eval(x) fuzzer, the following string fed to 
>ast.literal_eval will cause a null pointer in get_error_line:

\
(\
\

This can be recreated with:

❯ ./python  
Python 3.11.0a1+ (heads/fuzz_ast-dirty:6c942a86a4, Oct  6 2021, 16:27:52) [GCC 
8.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import ast
>>> ast.literal_eval(r'''\
... \
... (\
... \ ''')
[1]15464 segmentation fault  ./python


---
Raw ASAN report
---

==85015==ERROR: AddressSanitizer: SEGV on unknown address 
0x0001 (pc 0x7f987730e08c bp 0x7fff7f8e8080 sp 0x7fff7f8e7838 T0)
==85015==The signal is caused by a READ memory access.
==85015==Hint: address points to the zero page.
#0 0x7f987730e08c in strchr-avx2.S:57 
/build/glibc-eX1tMB/glibc-2.31/sysdeps/x86_64/multiarch/strchr-avx2.S:57
#1 0x4d7a58 in strchr 
/src/llvm-project/compiler-rt/lib/sanitizer_common/sanitizer_common_interceptors.inc:0
#2 0x9f9d95 in get_error_line cpython3/Parser/pegen.c:406:25
#3 0x9f9d95 in _PyPegen_raise_error_known_location 
cpython3/Parser/pegen.c:497:26
#4 0x9fd492 in RAISE_ERROR_KNOWN_LOCATION cpython3/Parser/pegen.h:169:5
#5 0xa00528 in raise_unclosed_parentheses_error 
cpython3/Parser/pegen.c:267:8
#6 0xa00528 in _PyPegen_check_tokenizer_errors 
cpython3/Parser/pegen.c:1314:25
#7 0x9ff9e3 in _PyPegen_run_parser cpython3/Parser/pegen.c:1352:17
#8 0xa015c5 in _PyPegen_run_parser_from_string 
cpython3/Parser/pegen.c:1479:14
#9 0xa805e9 in _PyParser_ASTFromString cpython3/Parser/peg_api.c:14:21
#10 0x85f01a in Py_CompileStringObject cpython3/Python/pythonrun.c:1371:11
#11 0xc0785f in builtin_compile_impl cpython3/Python/bltinmodule.c:841:14
#12 0xc0785f in builtin_compile 
cpython3/Python/clinic/bltinmodule.c.h:249:20
#13 0xb7b28e in cfunction_vectorcall_FASTCALL_KEYWORDS 
cpython3/Objects/methodobject.c:446:24
#14 0x764f22 in call_function cpython3/Python/ceval.c:0
#15 0x7482e6 in _PyEval_EvalFrameDefault cpython3/Python/ceval.c:4614:19
#16 0x741225 in _PyEval_EvalFrame 
cpython3/Include/internal/pycore_ceval.h:46:12
#17 0x741225 in _PyEval_Vector cpython3/Python/ceval.c:5636:24
#18 0x57c510 in _PyFunction_Vectorcall cpython3/Objects/call.c:0
#19 0x764f22 in call_function cpython3/Python/ceval.c:0
#20 0x7482e6 in _PyEval_EvalFrameDefault cpython3/Python/ceval.c:4614:19
#21 0x741225 in _PyEval_EvalFrame 
cpython3/Include/internal/pycore_ceval.h:46:12
#22 0x741225 in _PyEval_Vector cpython3/Python/ceval.c:5636:24
#23 0x57c510 in _PyFunction_Vectorcall cpython3/Objects/call.c:0
#24 0x579def in _PyObject_VectorcallTstate 
/workspace/out/libfuzzer-address-x86_64/include/python3.11/cpython/abstract.h:114:11
#25 0x579def in PyObject_CallOneArg 
/workspace/out/libfuzzer-address-x86_64/include/python3.11/cpython/abstract.h:184:12
#26 0x579def in fuzz_ast_literal_eval 
cpython3/Modules/_xxtestfuzz/fuzzer.c:425:25
#27 0x579def in _run_fuzz cpython3/Modules/_xxtestfuzz/fuzzer.c:443:14
#28 0x579def in LLVMFuzzerTestOneInput 
cpython3/Modules/_xxtestfuzz/fuzzer.c:565:11
#29 0x4725e3 in fuzzer::Fuzzer::ExecuteCallback(unsigned char const*, 
unsigned long) cxa_noexception.cpp:0
#30 0x45deb2 in fuzzer::RunOneTest(fuzzer::Fuzzer*, char const*, unsigned 
long) /src/llvm-project/compiler-rt/lib/fuzzer/FuzzerDriver.cpp:324:6
#31 0x463965 in fuzzer::FuzzerDriver(int*, char***, int (*)(unsigned char 
const*, unsigned long)) cxa_noexception.cpp:0
#32 0x48c6b2 in main 
/src/llvm-project/compiler-rt/lib/fuzzer/FuzzerMain.cpp:20:10
#33 0x7f98771aa0b2 in __libc_start_main 
/build/glibc-eX1tMB/glibc-2.31/csu/libc-start.c:308:16
#34 0x43b16d in _start
AddressSanitizer can not provide additional info.
SUMMARY: AddressSanitizer: SEGV (/lib/x86_64-linux-gnu/libc.so.6+0x18b08c)
==85015==ABORTING

--
components: Parser
messages: 403427
nosy: ammar2, lys.nikolaou, pablogsal
priority: normal
severity: normal
status: open
title: [fuzzer] Weird input with continuation and newlines causes null deref in 
parser
type: crash
versions: Python 3.11

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45407] Support buffer protocol for _struct.Struct format argument

[youknowone]

New submission from youknowone :

This feature is commented as `XXX` for years.

https://github.com/python/cpython/blob/4e605666b08b8f863cbbbdaa34bb06988e648d26/Modules/_struct.c#L1478

Giving a bug tracker id or removing the comment will clarify the problem.

--
components: Library (Lib)
messages: 403426
nosy: youknowone
priority: normal
pull_requests: 27126
severity: normal
status: open
title: Support buffer protocol for _struct.Struct format argument
type: enhancement
versions: Python 3.11

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Guido van Rossum]

Guido van Rossum  added the comment:

Victor:
> I expect even more interesting speedup with bytes string longer than 6k 
> bytes. And I'm quite sure that it's common that people manipulates long 
> strings in Python :-)

But do they use them as dict keys? AFAIK strings aren't hashed until hash() is 
called on them.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45405] Python 3.10.0 does not configure on darwin using public llvm / clang

[Ned Deily]

Ned Deily  added the comment:

On what platform and OS version are you building? When you say "public llvm / 
clang", do you mean from Apple for macOS or from some other source? Be aware 
that we only officially test and support building Python for macOS on macOS 
itself using the Apple build tools (Xcode or Command Line Tools).

--
nosy: +ned.deily

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45398] Bugs in set operations in 3.8.10 (detected in Win7)

[Alexey]

Change by Alexey :


--
stage:  -> resolved
status: open -> closed

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue42066] CookieJar cookies should not be sorted

[Patrick Decat]

Change by Patrick Decat :


--
nosy: +Patrick Decat

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37157] shutil: add reflink=False to file copy functions to control clone/CoW copies (use copy_file_range)

[Albert Zeyer]

Albert Zeyer  added the comment:

> How is CoW copy supposed to be done by using copy_file_range() exactly?

I think copy_file_range() will just always use copy-on-write and/or 
server-side-copy when available. You cannot even turn that off.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45103] IDLE: make configdialog font page survive font failures

[Terry J. Reedy]

Terry J. Reedy  added the comment:

Thanks.  Did the FiraCode font work for you or merely not work without crashing?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45395] Frozen stdlib modules are discarded if custom frozen modules added.

[Marc-Andre Lemburg]

Marc-Andre Lemburg  added the comment:

On 07.10.2021 16:40, Eric Snow wrote:
> 
> On Thu, Oct 7, 2021 at 1:17 AM Marc-Andre Lemburg
>  wrote:
>> I'm not sure I follow, but in any case, please make sure that
>> the freeze tool in Tools/ continues to work with the new mechanism.
>>
>> The freeze tool would also need to know which modules are already
>> frozen via the new script, so that modules don't get included twice.
> 
> Will do.

Great, thanks, Eric.
 --
Marc-Andre Lemburg
eGenix.com

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45395] Frozen stdlib modules are discarded if custom frozen modules added.

[Eric Snow]

Eric Snow  added the comment:

On Thu, Oct 7, 2021 at 1:17 AM Marc-Andre Lemburg
 wrote:
> I'm not sure I follow, but in any case, please make sure that
> the freeze tool in Tools/ continues to work with the new mechanism.
>
> The freeze tool would also need to know which modules are already
> frozen via the new script, so that modules don't get included twice.

Will do.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

Do Rust and Ruby cache the hash of the string in the string object? If they do 
not then the hashing speed is more important to them.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37157] shutil: add reflink=False to file copy functions to control clone/CoW copies (use copy_file_range)

[Giampaolo Rodola']

Giampaolo Rodola'  added the comment:

> So using copy_file_range (if available) should be the most generic solution, 
> which includes copy-on-write support, and server-side copy support.

Doesn't this imply to pass some flag to copy_file_range()? "man 
copy_file_range" says:

> The flags argument is provided to allow for future extensions and currently 
> must be set to 0.

How is CoW copy supposed to be done by using copy_file_range() exactly?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45340] Lazily create dictionaries for plain Python objects

[Mark Shannon]

Change by Mark Shannon :


--
keywords: +patch
pull_requests: +27125
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/28802

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Christian Heimes]

Christian Heimes  added the comment:

I suggest that you write a new PEP that discusses possible improvement for str 
and bytes hashing. This BPO is just about SipHash-1-3. As the author and 
implementer of PEP 456, I only approve SipHash-1-3 as new default algorithm.

All other change proposals need at least separate BPOs, preferable a PEP. I 
don't want to have this simple feature proposal turned into a major design epic.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45397] Doc for turtle.write missing the tuple part of the font param in 3.10+

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

I tested with Sphinx 1.5.4, and this issue is gone. It introduces a regression 
with some smart quotes (see https://github.com/sphinx-doc/sphinx/issues/9713), 
but it is less severe than incorrect rendering of tuples as parameter defaults.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45397] Doc for turtle.write missing the tuple part of the font param in 3.10+

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

jg, please remove the copy of other message when answer. It makes painfully 
difficult reading the discussion for visually impaired people.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue37157] shutil: add reflink=False to file copy functions to control clone/CoW copies (use copy_file_range)

[Dulanic]

Dulanic  added the comment:

As a note, coreutils 9.0 cp defaults now to reflink=auto.

https://www.phoronix.com/scan.php?page=news_item=GNU-Coreutils-9.0

--
nosy: +dulanic

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45397] Doc for turtle.write missing the tuple part of the font param in 3.10+

[jg]

jg  added the comment:

I forgot to mention I'm on Windows 10 PC and see the same thing under Edge and 
FireFox.

John G. Gammon -.  ..    ..  .-..  .-  -..  --  ..  .-.  .-  .-.  ..
This message and any attachments hereto may contain confidential and/or 
privileged information. If you are not the intended recipient or authorized to 
receive this for the intended recipient, please advise the sender immediately 
by reply e-mail and delete this message; you must not use, copy, disclose or 
take any other action based on this message or any information herein. Thank 
you for your cooperation.


From: report=bugs.python@roundup.psfhosted.org 
 on behalf of Serhiy Storchaka 

Sent: Thursday, October 7, 2021 01:47
To: jggam...@hotmail.com 
Subject: [issue45397] Doc for turtle.write missing the tuple part of the font 
param in 3.10+

Serhiy Storchaka  added the comment:

This looks like some Sphinx bug.

In Python 3.8, using Sphinx:

>>> from sphinx.pycode import ast
>>> ast.unparse(ast.parse("('Arial', 8, 'normal')", 'eval').body)
"'Arial', 8, 'normal'"

For comparison, using builtin ast module in Python 3.9:

>>> import ast
>>> ast.unparse(ast.parse("('Arial', 8, 'normal')", 'eval').body)
"('Arial', 8, 'normal')"

--
nosy: +georg.brandl, serhiy.storchaka
type:  -> behavior
versions: +Python 3.11

___
Python tracker 

___

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45393] help() on operator precedence has confusing entries "await" "x" and "not" "x"

[Zachary Ware]

Zachary Ware  added the comment:

Correct; 3.7 and 3.8 are both in security-fix-only maintenance mode; their 
documentation is no longer updated unless a security-related fix causes a 
significant change in behavior that needs to be documented.

As far as fixing this issue, we have a few options.  The cause is that the 
source for these rows looks like ':keyword:`await` ``x``', which basically 
produces two inline code blocks with a non-code space between, which the 
pydoc-topics renderer renders as two separately quoted words.

Option 1: Replace ':keyword:`await` ``x``' with `:keyword:`await x `.  
This keeps the link to the `await` anchor, but extends it across the ' x' bit.  
The pydoc rendering is '"await x"'.

Option 2: Replace ':keyword:`await` ``x``' with '``await x``.  This also gives 
the pydoc rendering of '"await x"', but loses the link to the `await` anchor, 
which I would rather not do.

Option 3: As option 2, but also replace 'Await' in the description column with 
a link to the `await` anchor.  This breaks from how other keywords in the table 
are linked.

Option 4: Adjust the pydoc-topics renderer to smush together consecutive inline 
code blocks.  This might cause some issues elsewhere.

--
nosy: +zach.ware
versions:  -Python 3.7, Python 3.8

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Marc-Andre Lemburg]

Marc-Andre Lemburg  added the comment:

On 07.10.2021 15:29, Christian Heimes wrote:
> 
> Christian Heimes  added the comment:
> 
> JP got back to me
> 
> On 07/10/2021 14.34, Jean-Philippe Aumasson wrote:
>> xxHash is much faster indeed, but collisions seem trivial to find, which 
>> might allow hash-flood DoS again (see for example 
>> https://github.com/Cyan4973/xxHash/issues/180 
>> ). It's however unclear 
>> whether exploitable multicollisions can also be trivially found.
>>
>> If collisions don't matter and if the ~10x speed-up makes a difference, 
>> then probably a good option, but guess you'll need to keep SipHash (or 
>> some other safe hash) when DoS resistance is needed?
> 
> This information disqualifies xxHash for our use case.

The quoted issue was for an early version of XXH3.

Please see
https://github.com/Cyan4973/xxHash/wiki/Collision-ratio-comparison
as reference for collision analysis of the current xxHash versions.

The numbers are close to the expected case, meaning that
collisions are not more frequent than statistically to be
expected given the hash and the test sample size.

Looking at this older comparison, it would also make sense to
revisit the hybrid approach, e.g. use FNV for strings
up to 16 bytes, XXH128 for longer strings:

https://cglab.ca/~abeinges/blah/hash-rs/

Given that dictionaries often use relatively short string keys,
this should have a significant effect on applications where the
dictionaries don't just use interned strings.

It would also have an effect on Python startup time, since all
those interned strings need to have their hash calculated
during startup.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45406] inspect.getouterframes() tracebacks when $CWD does not exists

[Miroslav Suchý]

Change by Miroslav Suchý :


--
type:  -> crash

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45406] inspect.getouterframes() tracebacks when $CWD does not exists

[Miroslav Suchý]

New submission from Miroslav Suchý :

When you exec inspect.getouterframes() in directory, which no longer exists, 
then you get traceback, because the code traverse to os.getcwd() which fails.

Reproducer:

$ mkdir /tmp/bar
$ cd /tmp/bar
$ rmdir /tmp/bar
$ python3
Python 3.10.0rc2 (default, Sep  8 2021, 00:00:00) [GCC 11.2.1 20210728 (Red Hat 
11.2.1-1)] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import inspect
>>> inspect.getouterframes(inspect.currentframe())
Traceback (most recent call last):
  File "", line 1, in 
  File "/usr/lib64/python3.10/inspect.py", line 1653, in getouterframes
frameinfo = (frame,) + getframeinfo(frame, context)
  File "/usr/lib64/python3.10/inspect.py", line 1623, in getframeinfo
filename = getsourcefile(frame) or getfile(frame)
  File "/usr/lib64/python3.10/inspect.py", line 829, in getsourcefile
module = getmodule(object, filename)
  File "/usr/lib64/python3.10/inspect.py", line 861, in getmodule
file = getabsfile(object, _filename)
  File "/usr/lib64/python3.10/inspect.py", line 845, in getabsfile
return os.path.normcase(os.path.abspath(_filename))
  File "/usr/lib64/python3.10/posixpath.py", line 383, in abspath
cwd = os.getcwd()
FileNotFoundError: [Errno 2] No such file or directory

--
components: Library (Lib)
messages: 403410
nosy: msu...@redhat.com
priority: normal
severity: normal
status: open
title: inspect.getouterframes() tracebacks when $CWD does not exists
versions: Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45116] Performance regression 3.10b1 and later on Windows: Py_DECREF() not inlined in PGO build

[STINNER Victor]

STINNER Victor  added the comment:

> How feasible would it be to use Clang or GCC on Windows?

clang seems to have a good Windows support and tries to the ABI compatible with 
MSC which is a must have to keep wheel package support (especially for the 
stable ABI, used by PyQt on Windows for example).

Moreover, there are ways to cross-build Python from another platform to Windows 
which can be convenient ;-)

I don't know the Windows ecosystem. Do people want to get VS debugger for 
example? Is clang compatible with the VS debugger?

See the discussion of 2014: "Status of C compilers for Python on Windows"
https://mail.python.org/archives/list/python-...@python.org/thread/SYWDJ23AQDPWQN7HD6M6YCSGXERCHWA2/

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[STINNER Victor]

Change by STINNER Victor :


--
resolution:  -> fixed
stage: patch review -> resolved
status: open -> closed
versions: +Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue17659] no way to determine First weekday (based on locale)

[Cédric Krier]

Cédric Krier  added the comment:

I have updated the PR to be included in 3.11

--
versions: +Python 3.11 -Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45262] crash if asyncio is used before and after re-initialization if using python embedded in an application

[Matthias Reichl]

Matthias Reichl  added the comment:

We were hitting the same issue in kodi, which uses embedded sub-interpreters to 
run python addons, after one of the addons was switched to asyncio.

The immediate cause of the assertion failure is a use-after-free issue from the 
running loop holder cache:

When the running loop holder is deallocated (which happens eg on interpreter 
shutdown) cached_running_holder holds a dangling pointer.

A subsequent call to get_running_loop() may then pick that up and boom.

While probably not a full fix for this issue I think it would be good to fix 
the use-after-free problem - there could be other code paths that lead to this 
situation. I've created a github pull request for that

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Christian Heimes]

Christian Heimes  added the comment:

JP got back to me

On 07/10/2021 14.34, Jean-Philippe Aumasson wrote:
> xxHash is much faster indeed, but collisions seem trivial to find, which 
> might allow hash-flood DoS again (see for example 
> https://github.com/Cyan4973/xxHash/issues/180 
> ). It's however unclear 
> whether exploitable multicollisions can also be trivially found.
> 
> If collisions don't matter and if the ~10x speed-up makes a difference, 
> then probably a good option, but guess you'll need to keep SipHash (or 
> some other safe hash) when DoS resistance is needed?

This information disqualifies xxHash for our use case.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45262] crash if asyncio is used before and after re-initialization if using python embedded in an application

[Matthias Reichl]

Change by Matthias Reichl :


--
keywords: +patch
nosy: +HiassofT
nosy_count: 4.0 -> 5.0
pull_requests: +27124
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/28796

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45404] Undefined I_* macros when building 3.10 on Ubuntu?

[Serhiy Storchaka]

Serhiy Storchaka  added the comment:

What is the output of the following command?

./python -m sysconfig | grep HAVE_STROPTS_H

Also, is there the stropts.h file on your system and where?

dlocate stropts.h
locate stropts.h

--
nosy: +serhiy.storchaka

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue41105] Add some extra content check in configure process for some empty header file who has been deprecated by glibc

[Diego Alonso]

Diego Alonso  added the comment:

Yes, I have the same problem. The empty file is needed to avoid compilation 
errors in certain builds, but in this case it creates an error...

--
nosy: +etale-cohomology

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45116] Performance regression 3.10b1 and later on Windows: Py_DECREF() not inlined in PGO build

[Mark Shannon]

Mark Shannon  added the comment:

Sadly the MSVC team are claiming that this isn't a bug in their compiler.
Not sure how we convince them that it is. The website rejects any attempt to 
reopen the issue.

How feasible would it be to use Clang or GCC on Windows?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45398] Bugs in set operations in 3.8.10 (detected in Win7)

[Alexey]

Alexey  added the comment:

Is interesting, that in win10 the bug is not reproduced too !
(only in win7!!!)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45405] Python 3.10.0 does not configure on darwin using public llvm / clang

[debohman]

New submission from debohman :

% CC=clang CXX=clang++ ./configure --enable-optimizations --with-lto
checking build system type... x86_64-apple-darwin16.7.0
checking host system type... x86_64-apple-darwin16.7.0
checking for python3.10... no
checking for python3... python3
checking for --enable-universalsdk... no
checking for --with-universal-archs... no
checking MACHDEP... "darwin"
checking for gcc... clang
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables... 
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether clang accepts -g... yes
checking for clang option to accept ISO C89... none needed
checking how to run the C preprocessor... clang -E
checking for grep that handles long lines and -e... /usr/bin/grep
checking for a sed that does not truncate output... /usr/local/bin/sed
checking for --with-cxx-main=... no
checking for the platform triplet based on compiler characteristics... darwin
configure: error: internal configure error for the platform triplet, please 
file a bug report

The problem occurs here at line 5382 of configure:

if test x$PLATFORM_TRIPLET != x && test x$MULTIARCH != x; then
  if test x$PLATFORM_TRIPLET != x$MULTIARCH; then
as_fn_error $? "internal configure error for the platform triplet, please 
file a bug report" "$LINENO" 5
  fi

The problem is that $PLATFORM_TRIPLET is set to darwin (which appears to be 
correct) and $MULTIARCH is set thus:

MULTIARCH=$($CC --print-multiarch 2>/dev/null)

which evaluates to x86_64-apple-darwin16.7.0.

This is with the public llvm / clang version 13.0.0.

If you set MULTIARCH=darwin in configure, python configures, builds and runs.

--
components: Build
messages: 403401
nosy: debohman
priority: normal
severity: normal
status: open
title: Python 3.10.0 does not configure on darwin using public llvm / clang
type: compile error
versions: Python 3.10

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45243] [sqlite3] add support for changing connection limits

[Erlend E. Aasland]

Change by Erlend E. Aasland :


--
pull_requests: +27123
pull_request: https://github.com/python/cpython/pull/28790

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Christian Heimes]

Christian Heimes  added the comment:

SipHash is a cryptographically secure PRF, not a cryptographic hashing 
algorithm, https://www.python.org/dev/peps/pep-0456/#siphash

I'm strongly against using a different algorithm when the rest of the world is 
using either SipHash-2-4 or SipHash-1-3. A minuscule performance gain is not 
worth the risk.

If users like to use an alternative algorithm, then they are free to do so. PEP 
456 gives them a hook point to override the algorithm on build time of CPython.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[miss-islington]

miss-islington  added the comment:


New changeset d55bf81c4ee2dcdd5dfa3b5a9905a0b32ca8d38b by Miss Islington (bot) 
in branch '3.10':
bpo-45400: Fix suggestion test of test_exceptions (GH-28783)
https://github.com/python/cpython/commit/d55bf81c4ee2dcdd5dfa3b5a9905a0b32ca8d38b


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[STINNER Victor]

STINNER Victor  added the comment:

> I am working on a fix

Or, I missed your message. You wrote it 4 minutes before I created my PR :-)

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue10716] Modernize pydoc to use better HTML and separate CSS

[Julien Palard]

Julien Palard  added the comment:

Does someone want to review https://github.com/python/cpython/pull/28651?

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45404] Undefined I_* macros when building 3.10 on Ubuntu?

[Diego Alonso]

New submission from Diego Alonso :

Trying to build Python 3.10 on Ubuntu 20.04. It builds everything but the fcntl 
module; ie. at the end it says:

Failed to build these modules:
fcntl.

Here are the compilation errors. It's trying to use certain macros that are 
undefined: I_PUSH, I_POP, I_LOOK, I_FLUSH, I_FLUSHBAND, I_SETSIG, I_GETSIG, 
I_FIND, I_PEEK, I_SRDOPT, I_GRDOPT, I_NREAD, I_FDINSERT, I_STR, I_SWROPT, 
I_SENDFD, I_RECVFD, I_LIST, I_ATMARK, I_CKBAND, I_GETBAND, I_CANPUT, 
I_SETCLTIME, I_LINK, I_UNLINK, I_PLINK, I_PUNLINK


Modules/_xxsubinterpretersmodule.o
In file included from ./Include/Python.h:140,
 from /home/da/git/Python-3.10.0/Modules/fcntlmodule.c:6:
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c: In function ‘all_ins’:
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:614:33: error: ‘I_PUSH’ 
undeclared (first use in this function)
  614 | if (PyModule_AddIntMacro(m, I_PUSH)) return -1;
  | ^~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:614:33: note: each undeclared 
identifier is reported only once for each function it appears in
  614 | if (PyModule_AddIntMacro(m, I_PUSH)) return -1;
  | ^~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:615:33: error: ‘I_POP’ 
undeclared (first use in this function)
  615 | if (PyModule_AddIntMacro(m, I_POP)) return -1;
  | ^
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:616:33: error: ‘I_LOOK’ 
undeclared (first use in this function); did you mean ‘F_LOCK’?
  616 | if (PyModule_AddIntMacro(m, I_LOOK)) return -1;
  | ^~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:617:33: error: ‘I_FLUSH’ 
undeclared (first use in this function); did you mean ‘CFLUSH’?
  617 | if (PyModule_AddIntMacro(m, I_FLUSH)) return -1;
  | ^~~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:618:33: error: ‘I_FLUSHBAND’ 
undeclared (first use in this function)
  618 | if (PyModule_AddIntMacro(m, I_FLUSHBAND)) return -1;
  | ^~~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:619:33: error: ‘I_SETSIG’ 
undeclared (first use in this function); did you mean ‘F_SETSIG’?
  619 | if (PyModule_AddIntMacro(m, I_SETSIG)) return -1;
  | ^~~~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:620:33: error: ‘I_GETSIG’ 
undeclared (first use in this function); did you mean ‘F_GETSIG’?
  620 | if (PyModule_AddIntMacro(m, I_GETSIG)) return -1;
  | ^~~~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define PyModule_AddIntMacro(m, c) PyModule_AddIntConstant(m, #c, c)
  |   ^
/home/da/git/Python-3.10.0/Modules/fcntlmodule.c:621:33: error: ‘I_FIND’ 
undeclared (first use in this function)
  621 | if (PyModule_AddIntMacro(m, I_FIND)) return -1;
  | ^~
./Include/modsupport.h:154:67: note: in definition of macro 
‘PyModule_AddIntMacro’
  154 | #define 

[issue45103] IDLE: make configdialog font page survive font failures

[E. Paine]

E. Paine  added the comment:

I am unable to reproduce on either Python 3.9.6 (Tk 8.6.9) or 3.10.0 (Tk 
8.6.10).

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[STINNER Victor]

STINNER Victor  added the comment:


New changeset 4e605666b08b8f863cbbbdaa34bb06988e648d26 by Victor Stinner in 
branch 'main':
bpo-45400: Fix suggestion test of test_exceptions (GH-28783)
https://github.com/python/cpython/commit/4e605666b08b8f863cbbbdaa34bb06988e648d26


--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[miss-islington]

Change by miss-islington :


--
nosy: +miss-islington
nosy_count: 3.0 -> 4.0
pull_requests: +27122
pull_request: https://github.com/python/cpython/pull/28787

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45402] ERROR: test_sundry (test.test_tools.test_sundry.TestSundryScripts): SystemExit: ERROR: missing _freeze_module

[STINNER Victor]

Change by STINNER Victor :


--
keywords: +patch
pull_requests: +27121
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/28786

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Marc-Andre Lemburg]

Marc-Andre Lemburg  added the comment:

On 07.10.2021 12:48, Christian Heimes wrote:
> 
>> I don't quite follow. Why is it fine that you discuss DoS, but it's not
> fine when others discuss DoS ?
> 
> But this BPO is not about discussing mitigations against DoS attacks in 
> general. It's about adding SipHash1-3- and following the example of Rust and 
> Ruby.
> 
> If you like to discuss DoS attacks on hashing of numeric types or other 
> mitigations, then please do this in a dedicated ticket. I like to keep this 
> BPO focused on a single topic.

The point that both Victor and I wanted to make is that we have
different views on the relevance of DoS attack mitigations
on selecting the default hash algorithm to use with Python strings
(and other objects which use pyhash.c).

The motivation for moving to siphash 1-3 is performance and we can
potentially get even better performance by looking at today's hash
algorithms and revisiting the decision to go with siphash.

This broadens the discussion, yes, but that can easily be addressed
by changing the title to e.g. "Revisiting the default hash algorithm
for strings".

Since siphash is a crypto hash function, whereas xxhash (and other
faster hash algorithms) are non-crypto hash functions, the topic of
hash collisions which can be used for DoS becomes relevant, so I
don't see why such discussions are off-topic.

With non-crypto hash algorithms available which exhibit good
collision stats and taking into account that DoS can be mitigated
using other ways (which is essential anyway, since Python doesn't
protect again hash based DoS in all cases), we get to a better Python.

More details on xxhash collision stats:
https://github.com/Cyan4973/xxHash/wiki/Collision-ratio-comparison#collision-study

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45402] ERROR: test_sundry (test.test_tools.test_sundry.TestSundryScripts): SystemExit: ERROR: missing _freeze_module

[STINNER Victor]

STINNER Victor  added the comment:

My fix for bpo-45020 no longer works, I'm not sure why:

commit 41551ee7e24fb6c58846836d3655dbb212281206
Author: Victor Stinner 
Date:   Fri Sep 17 20:20:43 2021 +0200

bpo-45020: Fix build out of source tree (GH-28410)

* Makefile.pre.in: Add $(srcdir) when needed, remove it when it was
  used by mistake.
* freeze_modules.py tool uses ./Programs/_freeze_module if the
  executable doesn't exist in the source tree.

I'm working on a new fix.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45403] test_sys: test_stdlib_dir() fails when Python is built outside the source tree

[STINNER Victor]

STINNER Victor  added the comment:

Python 3.10 is not affected: sys._stdlib_dir was added to Python 3.11.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45403] test_sys: test_stdlib_dir() fails when Python is built outside the source tree

[STINNER Victor]

Change by STINNER Victor :


--
keywords: +patch
pull_requests: +27120
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/28785

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue29410] Moving to SipHash-1-3

[Marc-Andre Lemburg]

Marc-Andre Lemburg  added the comment:

BTW: We already use (a slight variant of) xxHash for tuples: 
https://bugs.python.org/issue34751

The issues is an interesting read, in particular on how xxHash was eventually 
chosen, with a whole set of other hash algorithms in between.

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45403] test_sys: test_stdlib_dir() fails when Python is built outside the source tree

[STINNER Victor]

New submission from STINNER Victor :

Reproduce the issue:
---
# go to Python source tree
mkdir build
cd build
../configure
make
./python -m test test_sys
---

Output:

==
FAIL: test_stdlib_dir (test.test_sys.SysModuleTest)
--
Traceback (most recent call last):
  File "/home/vstinner/python/main/Lib/test/test_sys.py", line 1005, in 
test_stdlib_dir
self.assertEqual(actual, expected)
^^
AssertionError: '/home/vstinner/python/main/build/../Lib' != 
'/home/vstinner/python/main/Lib'
- /home/vstinner/python/main/build/../Lib
?-
+ /home/vstinner/python/main/Lib


Attached PR fix the issue.

--
components: Tests
messages: 403389
nosy: vstinner
priority: normal
severity: normal
status: open
title: test_sys: test_stdlib_dir() fails when Python is built outside the 
source tree
versions: Python 3.11

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[Miro Hrončok]

Change by Miro Hrončok :


--
pull_requests: +27119
pull_request: https://github.com/python/cpython/pull/28784

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue26651] Deprecate register_adapter() and register_converter() in sqlite3

[Erlend E. Aasland]

Change by Erlend E. Aasland :


--
versions: +Python 3.11 -Python 3.6

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[STINNER Victor]

Change by STINNER Victor :


--
keywords: +patch
pull_requests: +27118
stage:  -> patch review
pull_request: https://github.com/python/cpython/pull/28783

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com

[issue45400] test_name_error_suggestions_do_not_trigger_for_too_many_locals: AssertionError: 'a1' unexpectedly found in Traceback

[Miro Hrončok]

Miro Hrončok  added the comment:

I am working on a fix

--

___
Python tracker 

___
___
Python-bugs-list mailing list
Unsubscribe: 
https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com