Hi, as Daniël states, it would be nice if websec behaved like a proper web robot. Baruch, are you aware that the change is basically a two-liner?
LWP, the web library you're using, provides a subclass of UserAgent that respects the robots.txt protocol, see here: http://search.cpan.org/dist/libwww-perl/lib/LWP/RobotUA.pm So you just replace two lines, and you've got a version of websec that respects the robots.txt protocol (I just did that on my websec install). The only design issue is that a robot UA requires a 'from' email address and I'm not quite sure how to supply that. I'd use the destination address(es) for the reports, but that's probably not a good idea with respect to privacy. What do you think? ciao, -- [*Thomas Themel*] "That which is novice-friendly is too frequently [extended contact] expert-hostile, and vice versa." [info provided in] - Tom Christiansen, crossposting [*message header*] "GUIs considered harmful" to eight groups -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
