[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

Change by Irit Katriel : -- resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python tracker ___ ___

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

STINNER Victor added the comment: New changeset 3b6e61ee0812359029cac176042d9c835c60f185 by Miss Islington (bot) in branch '3.8': bpo-35883: Py_DecodeLocale() escapes invalid Unicode characters (GH-24843) (GH-24906)

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

miss-islington added the comment: New changeset aa967ec4d4c2fc844f8f16b339140b050ae4d5e2 by Miss Islington (bot) in branch '3.9': bpo-35883: Py_DecodeLocale() escapes invalid Unicode characters (GH-24843) https://github.com/python/cpython/commit/aa967ec4d4c2fc844f8f16b339140b050ae4d5e2

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

Change by miss-islington : -- pull_requests: +23668 pull_request: https://github.com/python/cpython/pull/24906 ___ Python tracker ___

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

Change by miss-islington : -- nosy: +miss-islington nosy_count: 7.0 -> 8.0 pull_requests: +23667 pull_request: https://github.com/python/cpython/pull/24905 ___ Python tracker

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

STINNER Victor added the comment: New changeset 9976834f807ea63ca51bc4f89be457d734148682 by Victor Stinner in branch 'master': bpo-35883: Py_DecodeLocale() escapes invalid Unicode characters (GH-24843) https://github.com/python/cpython/commit/9976834f807ea63ca51bc4f89be457d734148682

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

STINNER Victor added the comment: > Right, enabling explicitly the Python UTF-8 Mode works around the issue When the Python UTF-8 Mode is used, on macOS or on Android, Python uses its own UTF-8 decoder which respects the RFC 3629: it rejects characters outside [U+; U+10].

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

STINNER Victor added the comment: > This shouldn't be an issue in 3.7, at least not with the default UTF-8 mode > configuration. With this mode, Py_DecodeLocale calls _Py_DecodeUTF8Ex using > the surrogateescape error handler [1]. Right, enabling explicitly the Python UTF-8 Mode works

[issue35883] Python startup fails with a fatal error if a command line argument contains an invalid Unicode character

Change by STINNER Victor : -- title: Change invalid unicode characters to replacement characters in argv -> Python startup fails with a fatal error if a command line argument contains an invalid Unicode character ___ Python tracker