Isn't it a good idea to have an option to forbid wget to download files with the tag: <meta name="robots" content="noindex">
-----Original Message----- From: Jens Roesner [mailto:[EMAIL PROTECTED]] Sent: 23 November 2001 04:09 To: Tomas Hjelmberg Cc: Wget List Subject: Re: bug? Hi Tomas! > I see, but then, how to exclude from being downloaded per file-basis? First, let me be a smartass: Go to http://www.acronymfinder.com and lokk up RTFM Then, proceed to the docs of wget. wget offers download restrictions on host, directory and file name. Search in the docs for -H -D --exclude-domains `-A ACCLIST' `--accept ACCLIST' `accept = ACCLIST' `-R REJLIST' `--reject REJLIST' `reject = REJLIST' `-I LIST' `--include LIST' `include_directories = LIST' `-X LIST' `--exclude LIST' `exclude_directories = LIST' CU Jens http://www.jensroesner.de/wgetgui
