#24500: Django runtests - 3 tests fail on windows due to encoding troubles
-------------------------------------+-------------------------------------
Reporter: pakal | Owner: nobody
Type: Bug | Status: new
Component: | Version: 1.7
Internationalization |
Severity: Normal | Resolution:
Keywords: | Triage Stage:
| Unreviewed
Has patch: 0 | Needs documentation: 0
Needs tests: 0 | Patch needs improvement: 0
Easy pickings: 0 | UI/UX: 0
-------------------------------------+-------------------------------------
Changes (by pakal):
* needs_better_patch: => 0
* needs_tests: => 0
* needs_docs: => 0
Old description:
> On a my python2.7.3 install (32 bits), a today's checkout of django's
> master doesn't pass all tests - three i18n tests fails due to
> UnicodeDecodeError.
>
> I'm aware it might be due to locales
> (https://docs.djangoproject.com/en/dev/internals/contributing/writing-
> code/unit-tests/#many-test-failures-with-unicodeencodeerror), but windows
> doesn't have such packages that I'm aware of.
>
> My win32 "xgettext --version" is "xgettext (GNU gettext-tools) 0.17"
>
> I've followed the bug down to the xgettext invocation, where it seems the
> test expects utf8 output, whereas my xgettext-win32 version of course
> outputs ANSI (french locale) text.
>
> {{{
> UnicodeDecodeError('utf8', "xgettext (GNU gettext-tools) 0.17\nCopyright
> (C) 1995-1998, 2000-2007 Free Software Foundation, Inc.\nLicence GPLv3+ :
> GNU GPL version 3 ou ult\xe9rieure
> <http://gnu.org/licenses/gpl.html>\nCeci est un logiciel libre : vous
> pouvez le modifier et le redistribuer.\nIl n'y a PAS DE GARANTIE, dans la
> mesure de ce que permet la loi.\n\xc9crit par Ulrich
> Drepper.\n", 141, 142, 'invalid continuation byte')
> }}}
>
> Are these tests supposed to pass on windows as well as on *nix systems ?
> Are there specific requirements regarding xgettext or third-party
> packages ?
>
> {{{
>
> examining files with the extensions: .js
> ignoring file code.sample in .
> ignoring file not_utf8.sample in .
> ignoring file __init__.py in .
> ignoring file ignored.html in .\ignore_dir
> ignoring file media_ignored.html in .\media_root
> ignoring file static_ignored.html in .\static
> ignoring file comments.thtml in .\templates
> ignoring file empty.html in .\templates
> ignoring file plural.djtpl in .\templates
> ignoring file template_with_error.tpl in .\templates
> ignoring file test.html in .\templates
> ignoring file xxx_ignored.html in .\templates
> ignoring file ignored.html in .\templates\subdir
> processing file javascript.js in .
> UnicodeDecodeError: skipped file javascript.js in .
> processing file javascript.js in .\someapp\static
> UnicodeDecodeError: skipped file javascript.js in .\someapp\static
> processing file javascript_ignored.js in .\static
> UnicodeDecodeError: skipped file javascript_ignored.js in .\static
> processing locale de
>
> ======================================================================
> FAIL: test_default_root_settings
> (i18n.test_extraction.JavascriptExtractorTests)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "P:\Websites\django\django\test\utils.py", line 180, in inner
> return test_func(*args, **kwargs)
> File "P:\Websites\django\tests\i18n\test_extraction.py", line 454, in
> test_default_root_settings
> _, po_contents = self._run_makemessages(domain='djangojs')
> File "P:\Websites\django\tests\i18n\test_extraction.py", line 67, in
> _run_makemessages
> self.assertTrue(os.path.exists(self.PO_FILE))
> AssertionError: False is not true
>
> ======================================================================
> FAIL: test_javascript_literals
> (i18n.test_extraction.JavascriptExtractorTests)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "P:\Websites\django\tests\i18n\test_extraction.py", line 422, in
> test_javascript_literals
> _, po_contents = self._run_makemessages(domain='djangojs')
> File "P:\Websites\django\tests\i18n\test_extraction.py", line 67, in
> _run_makemessages
> self.assertTrue(os.path.exists(self.PO_FILE))
> AssertionError: False is not true
>
> ======================================================================
> FAIL: test_media_static_dirs_ignored
> (i18n.test_extraction.JavascriptExtractorTests)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "P:\Websites\django\django\test\utils.py", line 180, in inner
> return test_func(*args, **kwargs)
> File "P:\Websites\django\tests\i18n\test_extraction.py", line 445, in
> test_media_static_dirs_ignored
> _, po_contents = self._run_makemessages(domain='djangojs')
> File "P:\Websites\django\tests\i18n\test_extraction.py", line 67, in
> _run_makemessages
> self.assertTrue(os.path.exists(self.PO_FILE))
> AssertionError: False is not true
>
> }}}
New description:
On a my python2.7.3 install (32 bits), a today's checkout of django's
master doesn't pass all tests - three i18n tests fails due to
UnicodeDecodeError (I'm on windows 7 64 bits).
I'm aware it might be due to locales
(https://docs.djangoproject.com/en/dev/internals/contributing/writing-code
/unit-tests/#many-test-failures-with-unicodeencodeerror), but windows
doesn't have such packages that I'm aware of.
My win32 "xgettext --version" is "xgettext (GNU gettext-tools) 0.17"
I've followed the bug down to the xgettext invocation, where it seems the
test expects utf8 output, whereas my xgettext-win32 version of course
outputs ANSI (french locale) text.
{{{
UnicodeDecodeError('utf8', "xgettext (GNU gettext-tools) 0.17\nCopyright
(C) 1995-1998, 2000-2007 Free Software Foundation, Inc.\nLicence GPLv3+ :
GNU GPL version 3 ou ult\xe9rieure
<http://gnu.org/licenses/gpl.html>\nCeci est un logiciel libre : vous
pouvez le modifier et le redistribuer.\nIl n'y a PAS DE GARANTIE, dans la
mesure de ce que permet la loi.\n\xc9crit par Ulrich
Drepper.\n", 141, 142, 'invalid continuation byte')
}}}
Are these tests supposed to pass on windows as well as on *nix systems ?
Are there specific requirements regarding xgettext or third-party packages
?
{{{
examining files with the extensions: .js
ignoring file code.sample in .
ignoring file not_utf8.sample in .
ignoring file __init__.py in .
ignoring file ignored.html in .\ignore_dir
ignoring file media_ignored.html in .\media_root
ignoring file static_ignored.html in .\static
ignoring file comments.thtml in .\templates
ignoring file empty.html in .\templates
ignoring file plural.djtpl in .\templates
ignoring file template_with_error.tpl in .\templates
ignoring file test.html in .\templates
ignoring file xxx_ignored.html in .\templates
ignoring file ignored.html in .\templates\subdir
processing file javascript.js in .
UnicodeDecodeError: skipped file javascript.js in .
processing file javascript.js in .\someapp\static
UnicodeDecodeError: skipped file javascript.js in .\someapp\static
processing file javascript_ignored.js in .\static
UnicodeDecodeError: skipped file javascript_ignored.js in .\static
processing locale de
======================================================================
FAIL: test_default_root_settings
(i18n.test_extraction.JavascriptExtractorTests)
----------------------------------------------------------------------
Traceback (most recent call last):
File "P:\Websites\django\django\test\utils.py", line 180, in inner
return test_func(*args, **kwargs)
File "P:\Websites\django\tests\i18n\test_extraction.py", line 454, in
test_default_root_settings
_, po_contents = self._run_makemessages(domain='djangojs')
File "P:\Websites\django\tests\i18n\test_extraction.py", line 67, in
_run_makemessages
self.assertTrue(os.path.exists(self.PO_FILE))
AssertionError: False is not true
======================================================================
FAIL: test_javascript_literals
(i18n.test_extraction.JavascriptExtractorTests)
----------------------------------------------------------------------
Traceback (most recent call last):
File "P:\Websites\django\tests\i18n\test_extraction.py", line 422, in
test_javascript_literals
_, po_contents = self._run_makemessages(domain='djangojs')
File "P:\Websites\django\tests\i18n\test_extraction.py", line 67, in
_run_makemessages
self.assertTrue(os.path.exists(self.PO_FILE))
AssertionError: False is not true
======================================================================
FAIL: test_media_static_dirs_ignored
(i18n.test_extraction.JavascriptExtractorTests)
----------------------------------------------------------------------
Traceback (most recent call last):
File "P:\Websites\django\django\test\utils.py", line 180, in inner
return test_func(*args, **kwargs)
File "P:\Websites\django\tests\i18n\test_extraction.py", line 445, in
test_media_static_dirs_ignored
_, po_contents = self._run_makemessages(domain='djangojs')
File "P:\Websites\django\tests\i18n\test_extraction.py", line 67, in
_run_makemessages
self.assertTrue(os.path.exists(self.PO_FILE))
AssertionError: False is not true
}}}
--
--
Ticket URL: <https://code.djangoproject.com/ticket/24500#comment:1>
Django <https://code.djangoproject.com/>
The Web framework for perfectionists with deadlines.
--
You received this message because you are subscribed to the Google Groups
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/django-updates/063.7f799385cb28753455f41de4f37bfb84%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.
