For several days now a Nutch robot from IP 174.36.195.29 has been hitting our run-time Web servers. I noticed because our event logs are showing many ASP.NET warnings about "illegal characters in path". Your Web page at http://nutch.apache.org/bot.htm says that you would "like to hear about any bad behavior." I have attached today's log entries from that IP address on one of our servers. Ric Chrislip Senior Programmer/Analyst, E-mail Administrator Clark Hall 111 Hartwick College Oneonta, New York, USA 607-431-4189
#Software: Microsoft Internet Information Services 6.0 #Version: 1.0 #Date: 2010-12-13 05:00:08 #Fields: date time cs-method cs-uri-stem cs-uri-query s-port cs-username c-ip cs(User-Agent) cs(Referer) cs-host sc-status sc-substatus sc-win32-status sc-bytes cs-bytes 2010-12-13 05:06:26 GET /prebuilt/js/).1A(/^/s+|/s+$/g, - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 226 2010-12-13 05:06:46 GET /athletics/womens-soccer/2010/news - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 22764 227 2010-12-13 05:06:46 GET /prebuilt/dojo/]||dojo.hostenv.getBaseScriptUri()+ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 243 2010-12-13 05:06:51 GET /prebuilt/scripts/thickbox/+(6.1s[m[1]].5P|| - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 237 2010-12-13 05:07:33 GET /5C|42|7A|3x/i.1n(a.1f) - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 216 2010-12-13 05:08:27 GET /athletics/womens-soccer/2010/assistant-coach - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16220 238 2010-12-13 05:08:43 GET /athletics/womens-soccer/2010/all-time-records - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16008 239 2010-12-13 05:10:17 GET /prebuilt/js/(^|/.) - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 215 2010-12-13 05:12:24 GET /news-and-events/news-archive-new/text/javascript - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 404 0 0 281 242 2010-12-13 05:13:32 GET /athletics/womens-soccer/2010/team-archive - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16678 235 2010-12-13 05:13:40 GET /athletics/womens-soccer/2010/tradition-and-history - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 44926 244 2010-12-13 05:16:48 GET /athletics/womens-soccer/2010/team-photo - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 14882 233 2010-12-13 07:57:57 GET /prebuilt/js/)+(M.5h|| - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 215 2010-12-13 07:58:05 GET /prebuilt/js/(/.|$) - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 215 2010-12-13 07:58:12 GET /prebuilt/js/).1A(/^/s+|/s+$/g, - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 226 2010-12-13 07:58:31 GET /athletics/womens-soccer/2010/news - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 22766 227 2010-12-13 07:58:31 GET /prebuilt/dojo/]||dojo.hostenv.getBaseScriptUri()+ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 243 2010-12-13 07:58:34 GET /prebuilt/scripts/thickbox/+(6.1s[m[1]].5P|| - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 237 2010-12-13 07:59:15 GET /5C|42|7A|3x/i.1n(a.1f) - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 216 2010-12-13 08:01:54 GET /prebuilt/js/(^|/.) - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 215 2010-12-13 08:04:05 GET /news-and-events/news-archive-new/text/javascript - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 404 0 0 281 242 2010-12-13 08:05:15 GET /athletics/womens-soccer/2010/team-archive - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16680 235 2010-12-13 08:05:23 GET /athletics/womens-soccer/2010/tradition-and-history - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 44926 244 2010-12-13 08:11:04 GET /athletics/womens-soccer/2010/live-stats - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 14012 233 2010-12-13 08:49:21 GET /prebuilt/js/).1A(/^/s+|/s+$/g, - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 226 2010-12-13 08:49:42 GET /athletics/womens-soccer/2010/news - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 22768 227 2010-12-13 08:49:42 GET /prebuilt/dojo/]||dojo.hostenv.getBaseScriptUri()+ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 243 2010-12-13 08:49:47 GET /prebuilt/scripts/thickbox/+(6.1s[m[1]].5P|| - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 237 2010-12-13 08:51:23 GET /athletics/womens-soccer/2010/assistant-coach - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16218 238 2010-12-13 08:51:40 GET /athletics/womens-soccer/2010/all-time-records - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16008 239 2010-12-13 08:52:19 GET /prebuilt/dojo/ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 14 0 396 208 2010-12-13 08:52:40 GET /prebuilt/dojo/dojo.event.browser - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 0 0 1773 226 2010-12-13 08:53:15 GET /prebuilt/js/(^|/.) - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 215 2010-12-13 08:57:34 GET /athletics/womens-soccer/2010/recruiting-questionnaire - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16035 247 2010-12-13 08:57:42 GET /prebuilt/dojo/dojo.undo.browser - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 0 0 1772 225 2010-12-13 08:57:45 GET /athletics/womens-soccer/2010/junior-hawks-camp - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 15947 240 2010-12-13 08:58:25 GET /prebuilt/ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 14 0 396 203 2010-12-13 08:58:41 GET /prebuilt/dojo/+_449).replace(/^/s+|/s+$/g, - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 236 2010-12-13 11:40:08 GET /prebuilt/js/).1A(/^/s+|/s+$/g, - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 226 2010-12-13 11:40:29 GET /athletics/womens-soccer/2010/news - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 22766 227 2010-12-13 11:40:31 GET /prebuilt/dojo/]||dojo.hostenv.getBaseScriptUri()+ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 243 2010-12-13 11:40:32 GET /prebuilt/scripts/thickbox/+(6.1s[m[1]].5P|| - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 237 2010-12-13 11:41:59 GET /athletics/womens-soccer/2010/assistant-coach - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16220 238 2010-12-13 11:42:17 GET /athletics/womens-soccer/2010/all-time-records - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16010 239 2010-12-13 11:42:51 GET /prebuilt/dojo/ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 14 0 396 208 2010-12-13 11:43:13 GET /prebuilt/dojo/dojo.event.browser - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 0 0 1773 226 2010-12-13 11:43:48 GET /prebuilt/js/(^|/.) - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 215 2010-12-13 11:47:04 GET /athletics/womens-soccer/2010/team-archive - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16680 235 2010-12-13 11:47:13 GET /athletics/womens-soccer/2010/tradition-and-history - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 44926 244 2010-12-13 11:48:11 GET /athletics/womens-soccer/2010/recruiting-questionnaire - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 16035 247 2010-12-13 11:48:21 GET /prebuilt/dojo/dojo.undo.browser - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 0 0 1772 225 2010-12-13 11:48:24 GET /athletics/womens-soccer/2010/junior-hawks-camp - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 15946 240 2010-12-13 11:50:15 GET /athletics/womens-soccer/2010/team-photo - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 200 0 0 14865 233 2010-12-13 16:52:53 GET /prebuilt/js/).1A(/^/s+|/s+$/g, - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 226 2010-12-13 16:53:06 GET /prebuilt/dojo/]||dojo.hostenv.getBaseScriptUri()+ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 243 2010-12-13 16:53:09 GET /prebuilt/scripts/thickbox/+(6.1s[m[1]].5P|| - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 237 2010-12-13 16:54:51 GET /prebuilt/dojo/ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 14 0 396 208 2010-12-13 16:55:07 GET /prebuilt/dojo/dojo.event.browser - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 0 0 1773 226 2010-12-13 16:58:48 GET /prebuilt/dojo/dojo.undo.browser - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 0 0 1772 225 2010-12-13 16:59:20 GET /prebuilt/ - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 403 14 0 396 203 2010-12-13 16:59:35 GET /prebuilt/dojo/+_449).replace(/^/s+|/s+$/g, - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 500 0 0 3285 236 2010-12-13 17:00:26 GET /x18853.xml - 80 - 174.36.195.29 Nutch+small+test/Nutch-1.2+(A+Nutch+small+test-run) - www.hartwick.edu 301 0 0 248 204
