First of all I don't use w-get so I don't know much of it, however it does behave in a non-polite manner.
I have a web page that refers to a different web site via an image map: <img src="http://www.niesens.com/logo.gif" ALT="Niesen's Logo" USEMAP="#logo_map" BORDER="0"> <map name="logo_map"> <area shape="POLYGON" coords="0,0,72,0,42,29,0,29" href="http://www.niesens.com/index.en.html"> <area shape="POLYGON" coords="73,0,115,0,115,29,43,29" href="http://www.niesens.com/index.de.html"> </map> Wget drops the site address and uses the address it's currently at. In this case it's http://aldireview.niesens.com/index.en.html . Quite annoying is that Wget is trying this address continuously without even politely delaying the retry. A small sample from the log files: 2002-03-12 09:53:23 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:24 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:24 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:24 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:25 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:26 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:26 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:27 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:27 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:28 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:28 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:29 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:30 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:30 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:30 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:31 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:32 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:32 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:33 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:33 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:34 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:34 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:35 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:35 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:36 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:36 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:37 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:37 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:38 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:39 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:39 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:40 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:40 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:41 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:41 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:42 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:43 2 80.128.229.62 aldireview.niesens.com 80 "GET /logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:43 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:43 2 80.128.229.62 aldireview.niesens.com 80 "GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/" "Wget/1.7" 2002-03-12 09:53:44 2 80.128.229.62 aldireview.niesens.com 80 "GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/" "Wget/1.7"
