First of all I don't use w-get so I don't know much of it, however it does 
behave in a non-polite manner.

I have a web page that refers to a different web site via an image map:
   <img src="http://www.niesens.com/logo.gif"; ALT="Niesen's Logo" 
USEMAP="#logo_map" BORDER="0">
   <map name="logo_map">
   <area shape="POLYGON" coords="0,0,72,0,42,29,0,29"
     href="http://www.niesens.com/index.en.html";>
     <area shape="POLYGON" coords="73,0,115,0,115,29,43,29"
     href="http://www.niesens.com/index.de.html";>
   </map>
Wget drops the site address and uses the address it's currently at.  In 
this case it's http://aldireview.niesens.com/index.en.html . Quite annoying 
is that Wget is trying this address continuously without even politely 
delaying the retry.

A small sample from the log files:

2002-03-12 09:53:23 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:24 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:24 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:24 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:25 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:26 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:26 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:27 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:27 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:28 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:28 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:29 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:30 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:30 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:30 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:31 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:32 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:32 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:33 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:33 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:34 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:34 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:35 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:35 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:36 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:36 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:37 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:37 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:38 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:39 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:39 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:40 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:40 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:41 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:41 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:42 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:43 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/logo.gif HTTP/1.0" 404 0 202 "http://aldireview.niesens.com/"; "Wget/1.7" 
2002-03-12 09:53:43 2 80.128.229.62 aldireview.niesens.com 80 "GET 
/index.en.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:43 2 80.128.229.62 aldireview.niesens.com 80 
"GET /index.de.html HTTP/1.0" 404 0 207 "http://aldireview.niesens.com/"; 
"Wget/1.7" 2002-03-12 09:53:44 2 80.128.229.62 aldireview.niesens.com 80 
"GET / HTTP/1.0" 200 0 5977 "http://aldireview.niesens.com/"; "Wget/1.7"


Reply via email to