nocfed wrote:
On 3/25/06, Jorrit Kronjee <[EMAIL PROTECTED]> wrote:
nocfed wrote:
You have failed to understand the 'hint' part. It was a hint at ONE
of the switches to use..
As you apparently have not read the manpage for wget, here is the full command.
wget -e robots=off -Hr -nd -np --domains=72.14.203.104 -U Mozilla
http://www.elsenot.com/frsirt-google.html
At the risk of stating the obvious and hopefully putting an end to this
thread, http://www.frsirt.com/robots.txt doesn't contain /exploits/ ? So
what's your point?
- Jorrit
wget is not crawling nor attempting to request anything form frsirt.
google on the other hand DOES use robots which wget will honor by
default.
Agreed, sorry for the confusion.
- Jorrit
_______________________________________________
Full-Disclosure - We believe in it.
Charter: http://lists.grok.org.uk/full-disclosure-charter.html
Hosted and sponsored by Secunia - http://secunia.com/
