I've taken a close look at my log file entries that Analog is reporting as 
corrupt (unable to process) and discovered they have something in common.  The 
referrer portion includes embedded quotes.  I've included below a sample of some
of the problem entries from recent logs.  Each one shows the user having been 
referred from one of several search sites where they ran a query to find one of 
my site's pages.  It would appear that either the user is putting quotes around 
their search criteria, or that they are somehow being included by the search 
site.  These quotes were then included in the referrer portion of the header.  
My guess is that Analog is seeing these quotes and is not able to process the 
line as a result.  Is this correct?  If so, is there any way to fix it?  I'm 
getting hundreds of these lines every month and sure would like to have them 
included in my reports.

I'm running the Netscape Enterprise server 3.51 with log files configured as:

format=%Ses->client.ip% - %Req->vars.auth-user% [%SYSDATE%] 
"%Req->reqpb.clf-request%" %Req->srvhdrs.clf-status% 
%Req->srvhdrs.content-length% "%Req->headers.referer%" 
"%Req->headers.user-agent%"

152.163.205.88 - - [08/Feb/1999:01:21:25 -0500] "GET /money/milpay/index.htm 
HTTP/1.0" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=2&fallBackURL=htt
p%3A%2F%2Fwww%2Elooksmart%2Ecom%2Fr%5Fsearch%3Flook%3D%26pin%3D990207x27f7ea332c
9bf9b5361%26key%3Dmilitary%2Bpaygrades%26search%3D0%26x%3D7%26y%3D7&rangeStart=2
0&rangeLength=10&realName="military+paygrades"" "Mozilla/4.0 (compatible; MSIE 
4.01; AOL 4.0; Windows 98)"

208.3.76.121 - - [08/Feb/1999:06:18:22 -0500] "GET /money/milpay/ HTTP/1.0" 200 
7264 "http://www.altavista.com/cgi-bin/query?q="dfas"&text=yes" "Mozilla/4.5 
[en] (Win95; I)"

206.153.205.157 - - [08/Feb/1999:19:26:34 -0500] "GET /money/milpay/index.htm 
HTTP/1.0" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=20&r
angeLength=10&realName="civilan+employmentw%2Fmilitary"" "Mozilla/2.0 
(Macintosh; I; 68K)"

205.199.222.173 - - [09/Feb/1999:16:32:18 -0500] "GET /money/milpay/index.htm 
HTTP/1.1" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=80&r
angeLength=10&realName="government+%3Eus+military+retirement+facilities"" 
"Mozilla/4.0 (compatible; MSIE 4.01; Windows 98)"

192.156.73.34 - - [10/Feb/1999:10:32:16 -0500] "GET /money/milpay/index.htm 
HTTP/1.0" 200 2627 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=20&r
angeLength=10&realName="MILITARY+RANK+CHART"" "Mozilla/4.0 (compatible; MSIE 
4.01; Windows NT)"

208.217.13.130 - - [10/Feb/1999:10:58:28 -0500] "GET /money/milpay/index.htm 
HTTP/1.0" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=10&r
angeLength=10&realName="Civil+Service+pay+tables"" "Mozilla/2.0 (compatible; 
MSIE 3.01; Windows 95)"

136.234.42.49 - - [10/Feb/1999:16:22:28 -0500] "GET /money/milpay/98pay/ 
HTTP/1.0" 200 4986 
"http://www.altavista.com/cgi-bin/query?pg=q&msn&user=msn&q="military+pay"" 
"Mozilla/2.0 (compatible; MSIE 3.02; Windows 95)"

12.75.221.9 - - [10/Feb/1999:18:03:38 -0500] "GET / HTTP/1.0" 200 10878 
"http://search.yahoo.com/bin/search?p="dfas"&a=att" "Mozilla/2.0 (compatible; 
MSIE 3.01; Windows 95)"

207.225.166.197 - - [10/Feb/1999:23:30:22 -0500] "GET /money/milpay/index.htm 
HTTP/1.0" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=2&fallBackURL=htt
p%3A%2F%2Fwww%2Elooksmart%2Ecom%2Fr%5Fsearch%3Fcomefrom%3Dnspanel%2Dsearch%26key
%3Dmilitary%2Bw2%26search%3D1&rangeStart=20&rangeLength=10&realName="military+w2
"" "Mozilla/4.05 [en] (Win95; I)"

153.36.172.37 - - [12/Feb/1999:12:07:06 -0500] "GET /money/milpay/index.htm 
HTTP/1.1" 200 7189 
"http://www.altavista.com/cgi-bin/query?pg=q&what=web&fmt=.&q="military%20retire
ment%20pay"" "Mozilla/4.0 (compatible; MSIE 4.01; MSN 2.6; Windows 98)"

208.16.95.221 - - [12/Feb/1999:18:05:34 -0500] "GET /money/milpay/98pay/ 
HTTP/1.1" 200 4896 
"http://www.altavista.com/cgi-bin/query?pg=n200&kl=XX&q="military%20pay"" 
"Mozilla/4.0 (compatible; MSIE 5.0b2; Windows 98)"

207.69.161.103 - - [13/Feb/1999:00:46:18 -0500] "GET 
/money/milpay/98pay/index.htm HTTP/1.1" 200 4905 
"http://www.lycos.com/cgi-bin/pursuit?cat=lycos&mtemp=ms1&etemp=ms1error&part=MI
CROSOFT&query="dfas+cleveland"" "Mozilla/4.0 (compatible; MSIE 4.01; Windows 
98)"

12.73.163.202 - - [13/Feb/1999:15:07:15 -0500] "GET /money/milpay/98pay/ 
HTTP/1.0" 200 4896 
"http://www.altavista.com/cgi-bin/query?pg=q&what=web&q=%2B"military+%2Bpay"" 
"Mozilla/4.04 [en]C-WorldNet  (Win95; I)"

Thanks in advance,

Ed Kabat
Web Administrator
Defense Finance and Accounting Service

format=%Ses->client.ip% - %Req->vars.auth-user% [%SYSDATE%] "%Req->reqpb.clf-request%" 
%Req->srvhdrs.clf-status% %Req->srvhdrs.content-length% "%Req->headers.referer%" 
"%Req->headers.user-agent%"

152.163.205.88 - - [08/Feb/1999:01:21:25 -0500] "GET /money/milpay/index.htm HTTP/1.0" 
200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=2&fallBackURL=http%3A%2F%2Fwww%2Elooksmart%2Ecom%2Fr%5Fsearch%3Flook%3D%26pin%3D990207x27f7ea332c9bf9b5361%26key%3Dmilitary%2Bpaygrades%26search%3D0%26x%3D7%26y%3D7&rangeStart=20&rangeLength=10&realName="military+paygrades""
 "Mozilla/4.0 (compatible; MSIE 4.01; AOL 4.0; Windows 98)"

208.3.76.121 - - [08/Feb/1999:06:18:22 -0500] "GET /money/milpay/ HTTP/1.0" 200 7264 
"http://www.altavista.com/cgi-bin/query?q="dfas"&text=yes" "Mozilla/4.5 [en] (Win95; 
I)"

206.153.205.157 - - [08/Feb/1999:19:26:34 -0500] "GET /money/milpay/index.htm 
HTTP/1.0" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=20&rangeLength=10&realName="civilan+employmentw%2Fmilitary""
 "Mozilla/2.0 (Macintosh; I; 68K)"

205.199.222.173 - - [09/Feb/1999:16:32:18 -0500] "GET /money/milpay/index.htm 
HTTP/1.1" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=80&rangeLength=10&realName="government+%3Eus+military+retirement+facilities""
 "Mozilla/4.0 (compatible; MSIE 4.01; Windows 98)"

192.156.73.34 - - [10/Feb/1999:10:32:16 -0500] "GET /money/milpay/index.htm HTTP/1.0" 
200 2627 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=20&rangeLength=10&realName="MILITARY+RANK+CHART""
 "Mozilla/4.0 (compatible; MSIE 4.01; Windows NT)"

208.217.13.130 - - [10/Feb/1999:10:58:28 -0500] "GET /money/milpay/index.htm HTTP/1.0" 
200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=1&rangeStart=10&rangeLength=10&realName="Civil+Service+pay+tables""
 "Mozilla/2.0 (compatible; MSIE 3.01; Windows 95)"

136.234.42.49 - - [10/Feb/1999:16:22:28 -0500] "GET /money/milpay/98pay/ HTTP/1.0" 200 
4986 "http://www.altavista.com/cgi-bin/query?pg=q&msn&user=msn&q="military+pay"" 
"Mozilla/2.0 (compatible; MSIE 3.02; Windows 95)"

12.75.221.9 - - [10/Feb/1999:18:03:38 -0500] "GET / HTTP/1.0" 200 10878 
"http://search.yahoo.com/bin/search?p="dfas"&a=att" "Mozilla/2.0 (compatible; MSIE 
3.01; Windows 95)"

207.225.166.197 - - [10/Feb/1999:23:30:22 -0500] "GET /money/milpay/index.htm 
HTTP/1.0" 200 7273 
"http://www.realnames.com/Resolver.dll?action=query&providerID=2&fallBackURL=http%3A%2F%2Fwww%2Elooksmart%2Ecom%2Fr%5Fsearch%3Fcomefrom%3Dnspanel%2Dsearch%26key%3Dmilitary%2Bw2%26search%3D1&rangeStart=20&rangeLength=10&realName="military+w2""
 "Mozilla/4.05 [en] (Win95; I)"

153.36.172.37 - - [12/Feb/1999:12:07:06 -0500] "GET /money/milpay/index.htm HTTP/1.1" 
200 7189 
"http://www.altavista.com/cgi-bin/query?pg=q&what=web&fmt=.&q="military%20retirement%20pay""
 "Mozilla/4.0 (compatible; MSIE 4.01; MSN 2.6; Windows 98)"

208.16.95.221 - - [12/Feb/1999:18:05:34 -0500] "GET /money/milpay/98pay/ HTTP/1.1" 200 
4896 "http://www.altavista.com/cgi-bin/query?pg=n200&kl=XX&q="military%20pay"" 
"Mozilla/4.0 (compatible; MSIE 5.0b2; Windows 98)"

207.69.161.103 - - [13/Feb/1999:00:46:18 -0500] "GET /money/milpay/98pay/index.htm 
HTTP/1.1" 200 4905 
"http://www.lycos.com/cgi-bin/pursuit?cat=lycos&mtemp=ms1&etemp=ms1error&part=MICROSOFT&query="dfas+cleveland""
 "Mozilla/4.0 (compatible; MSIE 4.01; Windows 98)"

12.73.163.202 - - [13/Feb/1999:15:07:15 -0500] "GET /money/milpay/98pay/ HTTP/1.0" 200 
4896 "http://www.altavista.com/cgi-bin/query?pg=q&what=web&q=%2B"military+%2Bpay"" 
"Mozilla/4.04 [en]C-WorldNet  (Win95; I)"

Reply via email to