New submission from wats0ns <quentin.ma...@protonmail.ch>:
RobotsParser parse a "Disallow: ?" rule as a deny all, but this is a valid rule that should be interpreted as "Disallow: /?*" or "Disallow: /*?*" ---------- components: Library (Lib) messages: 337285 nosy: quentin-maire priority: normal severity: normal status: open title: robotsparser deny all with some rules type: behavior versions: Python 3.5 _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue36207> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
