Wget (as far as I know) is very well-behaved in that it will follow any restirctions imposed by a webserver's robots.txt file.
Sorry. I meant "restrictions". I hate it when I forget to use spell-check >_<
-- () The ASCII Ribbon Campaign - against HTML Email, /\ vCards, and proprietary formats. --------------------------------------------------- Peter A. Gordon (codergeek42) E-Mail: [EMAIL PROTECTED] GPG Public Key ID: 0x109DBECE GPG Key Fingerprint (SHA1): E485 E2F7 11CE F9B2 E3D9 C95D 208F B732 109D BECE Encrypted and/or Signed correspondence preffered. GPG Public Key available upon request or from pgp.mit.edu's public key server. ---------------------------------------------------
signature.asc
Description: OpenPGP digital signature