access_log numbers lower than expected....
I'm using mod_perl, and am getting some inaccurate numbers in my access_log file. for example, i have the google search engine on my page (http://www.euroseek.com), they are claiming our number of searches are 200,000 per day. However, my log file only shows about 18,000 queries for the search.cgi script. Is there any possibility that the search.cgi is cached and not reporting accurate numbers to the access_log? Just curious. Thanks, Anthony E. = Anthony Ettinger [EMAIL PROTECTED] http://apwebdesign.com mobile: 415.385.0146 __ Do you Yahoo!? New DSL Internet Access from SBC Yahoo! http://sbc.yahoo.com
RE: access_log numbers lower than expected....
It's my understanding that unless you have setup something explicitly otherwise it would report even the cached accesses in your access_log. Are you rotating your script or anything like that? Are you sure all searches are going through that one file? Is it accounting for mutiple domains etc? -Ben -Original Message- From: Anthony E. [mailto:[EMAIL PROTECTED]] Sent: Friday, September 27, 2002 12:47 PM To: [EMAIL PROTECTED] Subject: access_log numbers lower than expected I'm using mod_perl, and am getting some inaccurate numbers in my access_log file. for example, i have the google search engine on my page (http://www.euroseek.com), they are claiming our number of searches are 200,000 per day. However, my log file only shows about 18,000 queries for the search.cgi script. Is there any possibility that the search.cgi is cached and not reporting accurate numbers to the access_log? Just curious. Thanks, Anthony E. = Anthony Ettinger [EMAIL PROTECTED] http://apwebdesign.com mobile: 415.385.0146 __ Do you Yahoo!? New DSL Internet Access from SBC Yahoo! http://sbc.yahoo.com
RE: access_log numbers lower than expected....
One possibility is that if you (or some process) edits the logfile in question while apache is running, logging will stop until you restart apache. You might consider logging directly from your mod_perl handler to a file or DB. Charles -Original Message- From: Anthony E. [mailto:[EMAIL PROTECTED]] Sent: Friday, September 27, 2002 1:47 PM To: [EMAIL PROTECTED] Subject: access_log numbers lower than expected I'm using mod_perl, and am getting some inaccurate numbers in my access_log file. for example, i have the google search engine on my page (http://www.euroseek.com), they are claiming our number of searches are 200,000 per day. However, my log file only shows about 18,000 queries for the search.cgi script. Is there any possibility that the search.cgi is cached and not reporting accurate numbers to the access_log? Just curious. Thanks, Anthony E. = Anthony Ettinger [EMAIL PROTECTED] http://apwebdesign.com mobile: 415.385.0146 __ Do you Yahoo!? New DSL Internet Access from SBC Yahoo! http://sbc.yahoo.com
mod_backhand and commom front-end access_log
Hi, Right now I am using the front end simple Apache with the mod_proxy, which servers the normal images, and html, and works as a reverse proxy pass for the back end mod_perl Apache using hte mod_rewrite. But I cannot log the Proxy request in the front end server. I want to use the mod_backhand to work as mod_proxy if it allow me to log all the request in front end server, to maintain a common access_log. If some one implemented the same, please reply. Thanks and regards, -Surat Singh Bhati
showing mod_perl execute time in access_log
quick, obvious trick: This is a trivial modification of Doug's original Apache::TimeIt script that allows you to very precisely show the Apache execute time of the page. This is particularly useful if you want to know which pages of your site you could optimize. Here's a question, though: does anyone know an easy way of measuring how long apache keeps a socket to the client open, assuming that KeepAlive has been turned off? This is relevant because I want to know how long on average it is taking clients to receive certain pages in my application. I know that I can approximately calculate it from bandwidth, but I would expect the actual number to vary wildly throughout a given day due to Internet congestion. cheers, Ed --- package AccessTimer; # USAGE: # Just put the following line into your .conf file: # # PerlFixupHandler AccessTimer # # and use a custom Apache log (this logging piece is not at all mod_perl-based... # see http://httpd.apache.org/docs/mod/mod_log_config.html) # # CustomLog /path/to/your/log "%h %l %u %t \"%r\" %s %b %{ELAPSED}e" # use strict; use Apache::Constants qw(:common); use Time::HiRes qw(gettimeofday tv_interval); use vars qw($begin); sub handler { my $r = shift; $begin = [gettimeofday]; $r-push_handlers(PerlLogHandler=\log); return OK; } sub log { my $r = shift; my $elapsed = tv_interval($begin); $r-subprocess_env('ELAPSED' = "$elapsed"); return DECLINED; } 1;
POST data ending up in access_log
i sometimes have problems sending POST data. most of the time, everything works fine. however, sometimes, i see something like the following in my access_log: --- snip 8--- ... "GET /transact HTTP/1.1" 200 3412 ... "POST /transact HTTP/1.1" 200 3412 ... "key1=val1key2=val2key3=val3POST /transact HTTP/1.1" 302 293 ... "GET /transact HTTP/1.1" 200 3412 ... "POST /transact HTTP/1.1" 302 293 --- snip 8--- the middle line is the weird one. sometimes my POSTed data seems to end up there in the log instead of being sent to the client. has anyone seen this sort of behavior before? any ideas on possible causes? come to think of it, i believe i've seen this happen occasionally with GET requests as well. i'm running: apache 1.3.9 modperl 1.21 thanks! -sanjay
access_log
I was doing the stress testing of the Apache web server by simulating a large number of http requests. After several hours I started getting the following line in my access_log file: 165.78.11.40 - - [11/Jan/200:22:33:45 -0500] "-" 408 - Instead of the URL that was supposed to be accessed. Can somebody please tell me what this means? Petar
Re: access_log
At 11:09 AM 1/12/00 -0500, Gacesa, Petar wrote: I was doing the stress testing of the Apache web server by simulating a large number of http requests. After several hours I started getting the following line in my access_log file: 165.78.11.40 - - [11/Jan/200:22:33:45 -0500] "-" 408 - Instead of the URL that was supposed to be accessed. Can somebody please tell me what this means? Petar It's a bit off-topic... nothing to do with mod_perl. It's reporting a situation when the client starts to send an HTTP request but doesn't complete it - you have an Apache process tied up waiting for the request to complete; it doesn't, and Apache eventually times out the request and so logs it. So look at your simulated client. - Simon - Simon Rosenthal ([EMAIL PROTECTED]) Web Systems Architect Northern Light Technology 222 Third Street, Cambridge MA 02142 Phone: (617)577-2796 : URL: http://www.northernlight.com "Northern Light - Just what you've been searching for"