On Aug 6, 2004, at 6:14 AM, Ted Zlatanov wrote:
Advertising based news sites will probably be even less appreciative of mirroring and caching as more and more of them turn into registration based sites.
You misunderstand. If registration is required, a crawler will fail anyway,
Unless the crawler is itself registered. If I wrote a crawler, I'd keep a
database of usernames and passwords for this purpose.
_______________________________________________ Boston-pm mailing list [EMAIL PROTECTED] http://mail.pm.org/mailman/listinfo/boston-pm
