Arnaud LIPERINI-DIAZ <cont...@vauros.com> added the comment:
Do you have documentation about robotParser ? The robot.txt of this website works fine : https://vauros.com/ ---------- nosy: +Arnaud LIPERINI-DIAZ _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue36207> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
