[issue34347] AIX: test_utf8_mode.test_cmd_line fails

STINNER Victor added the comment: New changeset 15e7d2432294ec46f1ad84ce958fdeb9d4ca78b1 by Victor Stinner (Michael Felt) in branch '3.7': [3.7] bpo-34347: Fix test_utf8_mode.test_cmd_line for AIX (GH-8923) (GH-14233)

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Change by Michael Felt : -- pull_requests: +14069 pull_request: https://github.com/python/cpython/pull/14233 ___ Python tracker ___

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: Could this be backported to version 3.7? -- ___ Python tracker ___ ___ Python-bugs-list mailing

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

STINNER Victor added the comment: > The buildbots seem happy. This may be closed. Cool, thank you for checking, and thanks for your fix! I close the issue. -- resolution: -> fixed stage: patch review -> resolved status: open -> closed ___ Python

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: The buildbots seem happy. This may be closed. -- ___ Python tracker ___ ___ Python-bugs-list

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Osipov <1983-01...@gmx.net> added the comment: Interesting is that the very same approach does not work for HP-UX even if I swap out the params for HP-UX: $ ./python -m test test_utf8_mode Run tests sequentially 0:00:00 [1/1] test_utf8_mode test test_utf8_mode failed -- Traceback

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

STINNER Victor added the comment: New changeset 7ef1697be54a74314d5214d9ba0580d4e620694c by Victor Stinner (Michael Felt) in branch 'master': bpo-34347: Fix test_utf8_mode.test_cmd_line for AIX (GH-8923) https://github.com/python/cpython/commit/7ef1697be54a74314d5214d9ba0580d4e620694c

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Osipov <1983-01...@gmx.net> added the comment: This is a very thorough analysis. Kudos to that. -- nosy: +michael-o ___ Python tracker ___

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: Solution much simpler than I thought: not arg.decode('ascii', 'surrogateescape'), but arg.decode('iso-8859-1') -- ___ Python tracker ___

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Change by Michael Felt : -- keywords: +patch pull_requests: +8396 stage: -> patch review ___ Python tracker ___ ___

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: On 23/08/2018 19:14, Michael Felt wrote: > Michael Felt added the comment: > > On 23/08/2018 12:51, STINNER Victor wrote: >> STINNER Victor added the comment: >> >> Your issue is about decoding command line argument which is done from main() >> function. It

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: On 23/08/2018 12:51, STINNER Victor wrote: > STINNER Victor added the comment: > > Your issue is about decoding command line argument which is done from main() > function. It doesn't use Python codecs, but functions like Py_DecodeLocale(). This is beyond my

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

STINNER Victor added the comment: Your issue is about decoding command line argument which is done from main() function. It doesn't use Python codecs, but functions like Py_DecodeLocale(). > Question 1: why is windows excluded? Because it does not use UTF-8 as it's > default (it's default

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

STINNER Victor added the comment: I fixed bpo-34207. -- nosy: +vstinner ___ Python tracker ___ ___ Python-bugs-list mailing list

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Change by Łukasz Langa : -- keywords: +3.7regression ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Change by Łukasz Langa : -- dependencies: +test_cmd_line test_utf8_mode test_warnings fail in all FreeBSD 3.x (3.8) buildbots ___ Python tracker ___

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Łukasz Langa added the comment: I have no idea what's going on here yet but just wanted to report that we are seeing this issue on one FreeBSD buildbot, too: https://buildbot.python.org/all/#/builders/124/builds/508/steps/4/logs/stdio I can also reproduce on CentOS 7. Could this be related

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: Starting this discussion again. Please take time to read. I have spent hours trying to understand what is failing. Please spend a few minutes reading. Sadly, there is a lot of text - but I do not know what I could leave out without damaging the process of

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: Common "experts" - feedback needed! Original test test_utf8_mode failed -- Traceback (most recent call last): File "/data/prj/python/git/python3-3.8/Lib/test/test_utf8_mode.py", line 225, in test_cmd_line check('utf8=0', [c_arg], LC_ALL='C') File

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: On 8/6/2018 10:10 PM, Michael Felt wrote: > Michael Felt added the comment: > > In short, I do not understand how this passes on Linux. > > This is python3-3.4.6 on sles12: > 'h\xe9\u20ac'.encode('utf-8') > b'h\xc3\xa9\xe2\x82\xac'

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

Michael Felt added the comment: In short, I do not understand how this passes on Linux. This is python3-3.4.6 on sles12: >>> 'h\xe9\u20ac'.encode('utf-8') b'h\xc3\xa9\xe2\x82\xac' >>> ascii('h\xe9\u20ac'.encode('utf-8')) "b'h\\xc3\\xa9\\xe2\\x82\\xac'" >>>

[issue34347] AIX: test_utf8_mode.test_cmd_line fails

New submission from Michael Felt : The test fails because byte_str.decode('ascii', 'surragateescape') is not what ascii(byte_str) - returns when called from the commandline. Assumption: since " check('utf8', [arg_utf8])" succeeds I assume the parsing of the command-line is correct. DETAILS