Hi all,

I'm using wget version 1.10.2 under windows and I want wget to avoid
downloading/saving all files called "robots.txt". I'm using the following
command line:

wget -T 1 -t 1 -r --reject="robots.*" http://150.158.230.231:1500

I would expect this not to download the robots.txt file, but still it does.
When I look at the directory where the files are stored once the command has
executed, the robots.txt file is still present.
Can anybody help me out with this one, because I'm probably missing
something trivial here.

Kind regards,

Glenn.

Reply via email to