#29789: practracker.py codec exception in some locales -------------------------------+------------------------------ Reporter: catalyst | Owner: (none) Type: defect | Status: new Priority: Medium | Milestone: Tor: unspecified Component: Core Tor/Tor | Version: Severity: Normal | Keywords: Actual Points: | Parent ID: Points: | Reviewer: Sponsor: Sponsor31-can | -------------------------------+------------------------------ practracker.py, implemented in #29221, seems to have a locale dependency when python3 is being used. If the locale isn't a UTF-8 locale, UTF-8 characters in sources can result in an exception:
{{{ $ LANG=en_US.US-ASCII make check-best-practices PYTHON=python python ../scripts/maint/practracker/practracker.py .. mirkwood:build-norust tlyu$ LANG=en_US.US-ASCII make check-best-practices python3 ../scripts/maint/practracker/practracker.py .. Traceback (most recent call last): File "../scripts/maint/practracker/practracker.py", line 151, in <module> main() File "../scripts/maint/practracker/practracker.py", line 134, in main found_new_issues = consider_all_metrics(files_list) File "../scripts/maint/practracker/practracker.py", line 89, in consider_all_metrics found_new_issues |= consider_metrics_for_file(fname, f) File "../scripts/maint/practracker/practracker.py", line 104, in consider_metrics_for_file found_new_issues |= consider_file_size(fname, f) File "../scripts/maint/practracker/practracker.py", line 51, in consider_file_size file_size = metrics.get_file_len(f) File "/Users/tlyu/src/tor/scripts/maint/practracker/metrics.py", line 11, in get_file_len for i, l in enumerate(f): File "/Users/tlyu/src/brew/Cellar/python/3.7.2_2/Frameworks/Python.framework/Versions/3.7/lib/python3.7/encodings/ascii.py", line 26, in decode return codecs.ascii_decode(input, self.errors)[0] UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 14: ordinal not in range(128) make: *** [check-best-practices] Error 1 }}} I'm also seeing this on gitlab.com CI, but I don't know offhand what its locale environment variables are. We might want to use the `encoding=` keyword parameter to `open()`, but I think that would no longer be python2 compatible. -- Ticket URL: <https://trac.torproject.org/projects/tor/ticket/29789> Tor Bug Tracker & Wiki <https://trac.torproject.org/> The Tor Project: anonymity online
_______________________________________________ tor-bugs mailing list tor-bugs@lists.torproject.org https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs