[issue20559] urllib/http fail to sanitize a non-ascii url

Change by STINNER Victor : -- nosy: -vstinner ___ Python tracker ___ ___ Python-bugs-list mailing list Unsubscribe:

[issue20559] urllib/http fail to sanitize a non-ascii url

Irit Katriel added the comment: Reproduced on 3.11. -- nosy: +iritkatriel versions: +Python 3.10, Python 3.11, Python 3.9 -Python 3.3 ___ Python tracker ___

[issue20559] urllib/http fail to sanitize a non-ascii url

Martin Panter added the comment: See also Issue 3991 with proposals for handling non-ASCII as new features. -- nosy: +martin.panter ___ Python tracker

[issue20559] urllib/http fail to sanitize a non-ascii url

Éric Araujo added the comment: Even if Python 3’s text model is based on Unicode, some data formats have their own rules. There’s a long debate about whether URIs should be bytes or text; it looks like unlike web browsers, urllib/httplib don’t try to be smart with the URIs they are given but

[issue20559] urllib/http fail to sanitize a non-ascii url

New submission from Bill Winslow: The following code will produce a UnicodeEncodeError about a character being non-ascii: from urllib import request, parse, error url = 'http://en.wikipedia.org/wiki/Antonio Vallejo-Nájera' req = request.Request(url) response =

[issue20559] urllib/http fail to sanitize a non-ascii url

Bill Winslow added the comment: Follow up -- I need to use urllib.parse.quote to safely encode a url -- though if I may be so bold, I submit that since much of the goal of Python 3 was to make unicode just work, I the (stupid) user shouldn't have to remember to safely encode unicode urls...