[issue20719] testPythonOrg() of test_robotparser fails with the new www.python.org website
STINNER Victor added the comment: This issue has been worked around. -- resolution: - out of date status: open - closed ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue20719 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue20719] testPythonOrg() of test_robotparser fails with the new www.python.org website
Roundup Robot added the comment: New changeset 540ce9bb19e8 by Georg Brandl in branch '3.3': #20719: Disable the robotparser python.org test until the gzip encoding issue can be sorted. http://hg.python.org/cpython/rev/540ce9bb19e8 -- nosy: +python-dev ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue20719 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue20719] testPythonOrg() of test_robotparser fails with the new www.python.org website
Changes by Jesús Cea Avión j...@jcea.es: -- nosy: +jcea title: testPythonOrg() of test_robotparser fails with the new ww.python.org website - testPythonOrg() of test_robotparser fails with the new www.python.org website ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue20719 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
[issue20719] testPythonOrg() of test_robotparser fails with the new www.python.org website
Ned Deily added the comment: Interesting. As of last night, I'm no longer seeing 'gzip' encoding and the test passes for me. But I see some of the buildbots intermittently failing. Looking at the headers for www.python.org/robots.txt, it appears that the file is being served from a varnish cache and from a CDN so there may be different responses depending on which server responds. r1.getheaders() [('Server', 'nginx'), ('Content-Type', 'text/plain'), ('X-Frame-Options', 'SAMEORIGIN'), ('Content-Length', '690'), ('Accept-Ranges', 'bytes'), ('Date', 'Fri, 21 Feb 2014 23:53:23 GMT'), ('Via', '1.1 varnish'), ('Age', '2858'), ('Connection', 'keep-alive'), ('X-Served-By', 'cache-sv62-SJC3'), ('X-Cache', 'HIT'), ('X-Cache-Hits', '1')] In any case, supporting gzip would be a good idea but tests will need to have a more repeatable URL. -- ___ Python tracker rep...@bugs.python.org http://bugs.python.org/issue20719 ___ ___ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com