[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Roundup Robot added the comment: New changeset cc5cfeaa4a8d by Victor Stinner in branch 'default': Issue #10419, issue #6011: port 6ad356525381 fix from distutils to packaging http://hg.python.org/cpython/rev/cc5cfeaa4a8d -- ___ Python tracker

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Arfrever Frehtes Taifersar Arahesis added the comment: I have committed the fix for Distribute: https://bitbucket.org/tarek/distribute/changeset/97f12f8f6bf1 (However Distribute would fail to create entry points scripts if sys.executable contained unencodable characters.) --

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

STINNER Victor added the comment: Issue fixed in Python 3.1, 3.2, 3.3. Thanks to Arfrever, I realized that this issue not only concerns the compilation of Python itself with a non-ASCII prefix (issue #6011), but the installation of any Python script containing a non-ASCII character. So I also

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Roundup Robot added the comment: New changeset fd7d4639dae2 by Victor Stinner in branch '3.1': Issue #10419: Fix build_scripts command of distutils to handle correctly http://hg.python.org/cpython/rev/fd7d4639dae2 -- ___ Python tracker

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Roundup Robot added the comment: New changeset 47236a0cfb15 by Victor Stinner in branch '3.2': Close #10419, issue #6011: build_scripts command of distutils handles correctly http://hg.python.org/cpython/rev/47236a0cfb15 -- ___ Python tracker

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Roundup Robot added the comment: New changeset 6ad356525381 by Victor Stinner in branch 'default': Close #10419, issue #6011: build_scripts command of distutils handles correctly http://hg.python.org/cpython/rev/6ad356525381 -- nosy: +python-dev resolution: -> fixed stage: -> committe

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Changes by STINNER Victor : -- nosy: +benjamin.peterson, georg.brandl priority: normal -> release blocker ___ Python tracker ___ ___ P

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Arfrever Frehtes Taifersar Arahesis added the comment: Please commit any patch before releases of Python 3.1.4 and 3.2.1. (3.2.1 rc1 is planned on 2011-05-14.) -- ___ Python tracker __

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

STINNER Victor added the comment: > copy_script-2.patch uses os.fsencode(), which doesn't exist in Python 3.1. Correct, with Python 3.1, you can use filename.encode(sys.getfilesystemencoding(), 'surrogateescape'). But you must use os.fsencode() with Python >= 3.2 because on Windows, you canno

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Arfrever Frehtes Taifersar Arahesis added the comment: copy_script-2.patch uses os.fsencode(), which doesn't exist in Python 3.1. -- ___ Python tracker ___ _

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Éric Araujo added the comment: is not commited yet, > and we have now a duplicate issue (and 3 patches for a single bug) :-) Feel free to close duplicate issues. Looks like you’re not following PyCon reports, or Tarek’s mails to python-dev. distutils2 has been ported to 3.3 under the name “pac

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Éric Araujo added the comment: > Apparently setuptools.command.easy_install.get_script_header() imports > distutils.command.build_scripts.first_line_re and checks if this regex > matches a str object, which results in TypeError. If breaking > compatibility is not acceptable, then the surrogatees

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

STINNER Victor added the comment: Hey, I had already this bug and I also wrote a patch: copy_script-2.patch attached to #6011. It is very similar to build_scripts-binary_mode.patch (read the file in binary mode to avoid the encode/decode dance). But it checks also that the path to Python prog

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Arfrever Frehtes Taifersar Arahesis added the comment: Apparently setuptools.command.easy_install.get_script_header() imports distutils.command.build_scripts.first_line_re and checks if this regex matches a str object, which results in TypeError. If breaking compatibility is not acceptable, t

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Éric Araujo added the comment: Indeed, I missed those two lines. -- ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscr

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Arfrever Frehtes Taifersar Arahesis added the comment: Which patch do you mean? (My patch already changes first_line_re to bytes. My patch was tested only with 3.2. Lib/distutils/command/build_scripts.py is currently identical in 3.1, 3.2 and 3.3.) --

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Éric Araujo added the comment: Was the patch tested in 2.7 only? I think the first_line_re needs to be changed to bytes too. (3.x would have disallowed mixing bytes and str for a regex.) -- ___ Python tracker

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Arfrever Frehtes Taifersar Arahesis added the comment: Alternatively it's possible to use binary mode. I'm attaching the patch, which shows this possibility. -- title: distutils command build_scripts fails with UnicodeDecodeError -> distutils command build_scripts fails with Uni

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Marc-Andre Lemburg added the comment: Éric Araujo wrote: > > Éric Araujo added the comment: > > I’m not sure how I feel about using surrogateescape. The distutils source is > very similar across 2.7, 3.1, 3.2 and default, especially after the Great > Revert and freeze last year to restore

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Éric Araujo added the comment: I’m not sure how I feel about using surrogateescape. The distutils source is very similar across 2.7, 3.1, 3.2 and default, especially after the Great Revert and freeze last year to restore buggy-but-known behavior while the distutils2 project was created and a

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Changes by Arfrever Frehtes Taifersar Arahesis : -- nosy: +Arfrever, haypo versions: +Python 3.3 ___ Python tracker ___ ___ Python-bug

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Changes by Alexander Belopolsky : -- type: crash -> behavior ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: ht

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

Changes by Michał Górny : -- nosy: +mgorny ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe: http://mail.python.o

[issue10419] distutils command build_scripts fails with UnicodeDecodeError

New submission from Hagen Fürstenau : As suggested in issue 9561, I'm creating a new bug for the encoding problem in build_scripts: If a script file can't be decoded with the (locale dependent) standard encoding, then "build_scripts" fails with UnicodeDecodeError. Reproducable e.g. with LANG=C