At http://space.tin.it/computer/hherold/ you can find some examples in the
minihowto section, get the wgetbatch.zip, although those are windows batch
files the wget syntax is the same - in this case gettree.cmd should do the
trick.
That would be something like
wget -vkKrp -l0 -np
although at least
I recently upgraded to wget 1.8.2 from an unknown earlier version. In
doing recursive http retrievals, I have noticed inconsistent behavior.
If I specifiy a directory without the trailing slash in the url, the
"--no-parent" option is ignored, but if the trailing slash is present,
it works as expec
hi to everybody,
i have just imported into the deepspace6.net CVS repository a
modified version of wget 1.9 beta:
http://cvs.deepspace6.net/view/wget/
i have fixed a bug in the parsing of urls with embedded ipv6 addresses
(the previous check was not exaustive, the new code is taken from
If you run wget with -d you get a lot of (sometimes) usefull debug info.
In this case you'll see something like
Not following http://club.foto.ru/images/dot.gif because robots.txt forbids
it.
an so on.
As a matter of fact you'll notice a robots.txt which has been downloaded,
containing
User-agent
