I'm using wget
GNU Wget 1.9.1
intensivly for mirroring ftp data for scientific applications
(e.g. satellite data from NASA) but often the data are in an rolling
archive using symbolic links. I mentioned that in this case wget
retrieve all data in the rolling archive instead of only the new once.
This cause a lot of internet traffic ftp the most huge data sets more
than once. I'm using the following line in a script called within a cron
job.
wget --passive-ftp --retr-symlinks --dont-remove-listing --cut-dirs=4
--mirror ftp://$SITE$RSDIR -o $LLOG --directory-prefix=$LTDIR
This runs on a Solaris 8 box.
Is this a bug or is just my command invoking wget wrong a somethins
missing. I couldn't find any other options within the help.
Thank you very much in advance.
Anton
