Hi, despite sending a proper User-Agent, dosage fails to comply with robots.txt exclusion protocol, which could be done with [1]. [1] http://docs.python.org/library/robotparser.html
This is the reason sites like UserFriendly resort to IP address blocking instead of adding a simple line in their robots.txt file. I retitled the bug accordingly, and set the severity to normal (since robots.txt is important for screen scrapers). Regards, Bastian
signature.asc
Description: This is a digitally signed message part.
