Emily Zhao added the comment: I don't know too much about robots.txt but how about
Disallow: */rev/* Disallow: */shortlog/* Allow: Are there any other directories we'd like to exclude? ---------- nosy: +emily.zhao _______________________________________ Python tracker <rep...@bugs.python.org> <http://bugs.python.org/issue13924> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
