On Thursday, April 27, 2006 2:29 AM [EDT],
Ross Crawford <[EMAIL PROTECTED]> wrote:
> Duh, I worked it out.
For the benefit of future users of the list archive, please include the
solution when you post "I worked it
On Thursday, April 27, 2006 7:40 AM [EDT],
[EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
>> Dear Aengus,
>>
>> could I set up a report in which I see to each host the used User ID,
>>
>> for example
>>
>> HostUserID
>> 10.10.10.1
ache files from the earlier logfiles,
excluding the IP address, and then use that cachefile with the later
logfiles to create a report. That would probably work, but it wouldn't be a
general solution to the problem, which is a version of FAQ 128 -
http://analog.cx/docs/faq
use that cookie as a "user" field.
The issue is discussed in greater detail in
http://analog.cx/docs/webworks.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/anal
; arrive at your site, it doesn't tell you what names
are used on the links that they follow to get there.
IIS 5 and above allow you to log the hostname used in HTTP requests
(cs-host). You should turn that field on if you want this kind of
inf
ests.
reqs: search term
: ---
1: stef
1: ltof
1: sc
1: fgm
1: ltef
1: satt
1: wec
1: stof
1: tcal
1: peace
--------
Aengus
+
ort.
http://analog.cx/docs/include.html#outputexcludes
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List arch
On Tuesday, May 09, 2006 1:59 PM [EDT],
Mike VanHorn <[EMAIL PROTECTED]> wrote:
On 5/9/06 1:26 PM, "Aengus" <[EMAIL PROTECTED]> wrote:
On Tuesday, May 09, 2006 11:46 AM [EDT],
Mike VanHorn <[EMAIL PROTECTED]> wrote:
Is there a way to exclude certain terms
ible to get them
all on a single line.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List arch
if you wanted 4 different reports from a single servers logs, you might
still want 4 different .cfgs.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Doc
al changes into the
individual .cfg files, rather than into analog.cfg.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Read
the site.
Listing files, sorted by the number of requests.
reqs: %bytes: last time: file
: --: ---:
1: : 31/Aug/05 10:41: prospective
Aengus
+
| TO UNSUBSCRIBE from this list:
|http:
rt?
http://analog.cx/docs/syntax.html#CONFIGFILE
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List arch
n make sure that crawlers entries in the log will not be
counted in this report?
See above.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: h
to the same article, but I've included both for the sake of
the archive - it's possible that one may have a longer shelf-life than the
other).
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/ma
x27;t calculate the number for
different months in a set of logs. (It's also not an obviously useful
statistic, as it doesn't tell you whether the unique visitors in one month
are the same or different from the unique visitors in another month. A
sudden spike or drop in "un
On Tuesday, May 16, 2006 12:32 PM [EDT],
Shaleel Valsan <[EMAIL PROTECTED]> wrote:
Aengus,
Thanks for the great explanation - you are the first person who gave
me a proper answer.
Since generating that statistic for each month consumes so much system
resources, it would probably be wi
r analog.*. analog.exe and analog.cfg are normally in the same
directory. Edit analog.cfg to change settings
http://analog.cx/docs/start.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listi
he
General Summary or just add a new column for that time period.
When you run Analog, it creates a wole new report based on the parameters
that you give it, so if you change the parameters, you will overwrite the
existing report, unless you tell Analog to create a differ
Use the Browser Summary - it's the next item after Browser Report in the
index.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analo
On Thursday, May 18, 2006 12:29 PM [EDT],
Nicholas C. Shears <[EMAIL PROTECTED]> wrote:
Is it possible to customize the "Search Word Report" so it shows the
visitor's IP number for each search word?
No. For a start, what would Analog display if 10 people searched on a s
1: Firebird
:1: 1: Firebird/0
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List
certain caveats, allowing you to create your longterm reports
with smaller inputs.
http://analog.cx/docs/cache.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|
On Friday, May 19, 2006 10:25 AM [EDT],
[EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
really?
you can have your log files in zip format and Analog can still read
them? Can I put a bunch of logs in 1 Zip file?
Yes.
http://analog.cx/docs/logfile.html#UNCOMPRESS
you zip the logfiles first. But make sure that the zip process runs on the
server that the logfiles start on - there's no point in sucking the files
across the network to compress them.
Aengus
+
| TO UNSUBSCRIB
ve repercussions, other than increased log
size.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List
the term "pages" in Analog reports
refers to .html page types? If so, how can I add add pages with
an .xml extension to the pages data?
http://analog.cx/docs/indx.html#P
Aengus
+
| TO UNSUBSCRIBE from this list:
long as the number of users
and the size of the logs aren't hugely unweildy.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.c
t.html
If you're running Tomcat as a servlet engine for Apache or some other web
server, then use that servers logs.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
alled convlog on the IIS4 server that will
convert the the logfiles into NCSA format, including the date on each line.
If not, then Jeremys adddates.pl or my logfix.vbs will do the job.
(http://analog.cx/helpers/logf
e
part of the script that calls Analog, as Analog doesn't have any capacity
for doing this itself (except for a daily or monthly analysis, using date
codes in the LOGFILE command - http://analog.cx/docs/logfile.html).
Aengus
+
On Wednesday, May 31, 2006 3:57 PM [EDT],
Sokolow, Daniel <[EMAIL PROTECTED]> wrote:
All,
I've spent the better part of the day trying different
configurations, and getting all kinds of weird outputs, and I'm
still not getting what I want, so I'm asking the smart people.
I'm trying to get a se
any of the links generated by by your search engine. If
you want to tell how successful interal searches actually are, you really
need the search engine to measure that for you, the iformation doesn't reall
exist in the access logs that Analog analyzes.
Aengus
+--
ugh I suppose if you wanted to compare the numbers from a weekly
report with a monthly or annual report, it would be useful to have
averages).
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman
On Wednesday, June 07, 2006 5:06 PM [EDT],
Mike Murphy <[EMAIL PROTECTED]> wrote:
Hello, I am looking for a version for RedHat 3. Does it exist and if
so where would I go?
Try http://www.iddl.vt.edu/~jackie/analog/
parate Domain Reports is to do multiple runs of Analog.
http://analog.cx/docs/faq.html#faq128
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation
}i\")
But your sample string obviously doesn't start with "%{Host}i %h" (it only
has one address at the start, not two), and %{Host}i is the same as %v, so I
took %{Host}i out, and added a %j at the end for that "86.29.142.254" field,
which leaves
APACHELOGFORMAT
4 "Page Not Found" error handler for the server, it should display when a
user clicks on any link in your request report. (Though some browsers may
not display a custom 404 page, so you may have to send a 200 status back
from your 404 page!).
http://analog.cx/docs/othreps
ARTDIR.
Is there something wrong with my configuration or doesn't the OUTPUT
LATEX command support charts.
It doesn't look like it - Analog doesn't seem to produce any charts unless
you select OUTPUT XHTM
demand.
The INTSEARCHENGINE, INTSEARCHQUERY, INTSEARCHWORD commands are designed to
report on search URLS in great detail.
http://analog.cx/docs/args.html#SEARCHENGINE
If you want separate information on 2 report engines, you need to run Analog
twice.
Aengus
+
, but
your browser will only display one.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www
rned into a nightmare! Can someone help? Appreciated
Which part of the documentation are you having a problem with?
http://analog.cx/docs/faq.html#startfaqcont
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lis
On Saturday, June 24, 2006 6:06 PM [EDT],
roger jamison <[EMAIL PROTECTED]> wrote:
I'm puzzled - what happens now?
You read the documentation.
Follow the instructions for getting started on Windows
(http://analog.cx/docs/startpc.html).
It starts with this short summary:
1.. Edit analog.cf
synta that Apache uses to the syntax that
Analog uses. It's not relevant unless you have access to the Apache
configuration files in the first place.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.
't required).
Aengus
See http://analog.cx/docs/logfmt.html for more details on the
LOGFORMAT command.
Hope that helps,
Jeremy Wadsack
Seven Simple Machines
-Original Message-
From: [EMAIL PROTECTED] [mailto:analog-help-
[EMAIL PROTECTED] On Behalf Of hemiga
Sent: Thursday, June
AT command is supposed to apply to. To tell Analog
what LOGFORMAT to use for a logfile that is piped in, you must use
DEFAULTLOGFORMAT.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/l
.cx/docs/include.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mail
f a logfile line doesn't contain a file name, analog will assume that the
request wasn't for a page. Similarly, if it doesn't give the number of bytes
transferred, analog will make the bytes zero. So the number of page requests
or bytes credited to the other items on that line
.
Are you using the Redirection report? If the script in question always
results in a redirect, then a FILEALIAS or a REQALIAS for the script should
give you what you need in the Redirection report.
Aengus
+
| TO UNSUBSCR
version 6.0/Win32
C:\Program Files\analog 6.0\analog.exe: Warning E: Redirecting future
diagnostic messages to C:\Program Files\analog 6.0\errors.txt
It never closes and its failing my tasks to run every evening. Any
ideas?
What does it say in C:\Program Files\analog 6.0\errors.t
g to treat a 304 as a redirect when you use
304ISSUCCESS OFF.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
|
first, and then it notes that it successfully opened the .lng file
to create the report. So if your error.txt file is empty, it would indcate
that there is a problem accessing your logfile - perhaps some sort of file
lock problem.
Does Analog work if you point at a different log file?
hat might be a solution too. If you are using Apache, you might be
able to create a custom logformat that includes an entry that concatenates
the IP address and filename together.
Aengus
+
| TO UNSUBSCRIBE from this li
file, I'll suggest a
LOGFORMAT that might work.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List
exclude everything except /index.html.
DIREXCLUDE is an "output" exclude - it only excludes entries from the
Directory report, it doesn't exclude those logfile entries from being
included in other reports.
Aengus
+
On Friday, July 14, 2006 9:35 AM [EDT],
Graham Tinley <[EMAIL PROTECTED]> wrote:
Thanks for that Aengus,
Here's my new config:
LOGFILE B:\TNE\Web\disc-calif\httpd\logs\access_log.200607*
FILEINCLUDE index.html
OUTFILE c:\analog\homeonly%Y.%M.html
LOCALCHARTDIR "c:\ana
On Friday, July 14, 2006 10:37 AM [EDT],
Graham Tinley <[EMAIL PROTECTED]> wrote:
FILEINCLUDE index.html
is not the same as
FILEINCLUDE /index.html
Aengus
Thanks again Aengus, I modified the line, however I still get the same
result:
Program started at Fri-14-Jul-2006 15:36.
G
e efficient to have the database generate a report listing
the page names you want, in the format
REQALIAS /cmspub.asp?psdn=Page&dbid=76 "/cmspub.asp Bid 76 (widget)"
The clickable link will be unaffected - it will only be the displayed text
in the Analog repo
tiple times.
Unless you're dealing with several gigabytes of logs per day, simply zipping
your logs may be a more effective way to solve whatever problems you were
having in the first place.
Aengus
+
| TO UNSUBSCRIB
cx/docs/hierreps.html#ARGSFLOOR
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog
l the logs.
You haven't said why you want to get rid of the logs. How big are they? How
long are your reports taking to run?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/lis
geone.html, then as a user,
I only "see" one request being fulfilled. So redirected requests and
successful requests and failed requests are all counted, but they each get
their own report.
Aengus
+
| TO U
On Tuesday, July 18, 2006 8:57 AM [EDT],
Graham Tinley <[EMAIL PROTECTED]> wrote:
Hi Aengus,
I'm using the same analog.cfg for both the web site and home page
results, the only difference is the command in the home page cfg:
# only include home page requests
FILEINCLUDE http
y single line of the log to
figure out the format.
The formats that Analog recognizes are described in the documentation:
http://analog.cx/docs/logfmt.html#fmtexamples
Aengus
+
| TO UNSUBSCRIBE from this list:
|http:
or each type of item individually, and
doesn't record enough information to cross-reference them afterwards.
In summary, you can run Analog multiple times to create hourly reports, and
concatenate them, but Analog won't do it automatically.
Aengus
+--
s.pl?version=5.1&file=Readme.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives:
the .pl script to
get consistent output -
http://lists.meer.net/pipermail/analog-help/2005-July/018575.html. I don't
recall anyone following up on that report.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
t;Date and time of last access" columns in the User Report with
USERCOLS ED
You'd have to use a script to parse these times to get a "session length" if
you felt that that information was valuable - it's not something that is
built into Analog.
Aengus
+---
On Wednesday, July 19, 2006 9:45 PM [EDT],
R C <[EMAIL PROTECTED]> wrote:
Thanks for your response Aengus. I asked one of my coworkers and he
says we are still using IIS 5.0, and I am using Analog 5.21.
What is considered a "big" logfile?
I can process a gigabyte logfile i
:
BROWALIAS Microsoft-WebDAV-MiniRedir/5.1.2600
"Microsoft-WebDAV-MiniRedir/5.1.2600 (Windows NT 5.1)"
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-hel
wsers, and you can use the Host report to
see where the requests are coming from.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://anal
nd add
BROWREPEXCLUDE *Windows*
BROWREPEXCLUDE *Macintosh*
BROWREPEXCLUDE *Linux*
BROWREPEXCLUDE *SunOS*
BROWREPEXCLUDE *BSD*
The browsers that are left are the ones that make up OS Uknown.
Aengus
Thanks.
Grace
On Mon, 24 Jul 2006, Aengus wrote:
On Monday, July 24, 2006 7:48 AM [EDT],
Grace S
Unsubscribe instructions are incuded at the bottom of every singe message
posted to this list.
+
TO UNSUBSCRIBE from this list:
http://lists.meer.net/mailman/listinfo/analog-help
Analog Documentation: http://analog
tp://my.host.com/ will tell you
1) how many visits to your site were referred from my.host.com
2) What were the referring pages on my.host.com (in the Referrer Report)
3) What pages on your site were linked from my.host.com (in the Request
R
o often, the
simple thing to do is to keep your lists of robots in two seperate
configfiles, and include the necessary one with a CONFIGFILE command.
http://analog.cx/docs/syntax.html#CONFIGFILE
Aengus
+
| TO
alog doesn't have any limit on how many
directories deep the logfile may be, but there is a limit to the length of
an entry in a configfile. But you should run up against that limit (254
characters) under normal circumstances.
Aengus
+
ere are directories not listed for some reason under
/intranet and /foo-bar
All looks fine to me. Any ideas?
/foo-bar/test/test2 is a file called test2 in /foo-bar/test/.
Aengus
+
| TO UNSUBSCRIBE from this list:
|
ile.
http://analog.cx/docs/include.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives
EARCHENGINE
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/m
quarter of a million log
entries per minute with that command, so it may be good enough, depending on
how big your logfiles are.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/
information, Analog is probably
the best tool available for getting the information out of the data. Analog
has a range of Failure reports, but they are off by default.
Aengus
+
| TO UNSUBSCRIBE from this list:
|h
NCLUDE 500-
But you would also need FAILURE ON, because the Failure report is not on by
default, and if you're only including requests with a 500 status code the
default reports, that only report on Successful requests
On Wednesday, August 09, 2006 1:11 AM [EDT],
Jeff Wilkinson <[EMAIL PROTECTED]> wrote:
Aengus wrote:
Jeff Wilkinson <[EMAIL PROTECTED]> wrote:
Is there any way to get more detail on the Status
report? or to perhaps do a report where you only
include by status?
STATUS
on Report rather than the Failure Report. Google ASP_0147
for some more ideas.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/
d=*&* /test/$1.gif?$3
(Thanks to Aengus for this configuration)
This will get rid of cache buster rnd values and
aggregate the request correctly. However, I've been
getting requests with random parameters which I don't
have any control over. I can't use FILEALIAS when
there are mul
running analog, some of the reports
are turned off by analog because they are
empty (no data, like referer, etc).
Is it more efficient to make sure they are
turned off in the cfg file or doesn't that
make any real difference?
It doesn't ma
ed,
maybe I'll have to write little perl script to
pre-process the logs.
Because you can only apply one alias to a request, I think you would
probably have to preprocess your logs. I'm still not entirely sure that I
understand the problem, but
There are 6 mirror sites in the US:
http://www.web42.com/analog/
http://analog.teleglobe.net/
http://analog.gsp.com/
http://analog.feratech.com/
http://www.reverse.net/pub/analog/
http://analog.org/loganalysis/
They sould all have up to date copies of www.analog.
st and last time
they requested each page, by using the USERINCLUDE command to generate a
report for a single user,as Jeremy suggested.
You can use the USERCOLS command to include the First and Last request time
columns.
http://analog.teleglobe.net/docs/othreps.html#othCOLS
ficulties running anlgform under IIS6.
There was a post to the list last year that suggested a work around, but I
haven't seen any followup to confirm that it works:
http://lists.meer.net/pipermail/analog-help/2005-July/018575.html
Aengus
+---
ttp://www.google.com/search?q=site%3Alists.meer.net+analog-help+iis6
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readm
On Monday, August 21, 2006 12:03 PM [EDT],
Mario Arce <[EMAIL PROTECTED]> wrote:
Aengus,
I don't know what exactly I changed in IIS. I think I just enabled
the three PERL 'Web Service Extensions' in IIS 6 and now I don't get
the "CGI Error" but I
As Jeremy points out, you can't get that level of information for more than
one unique IP address in a single run of Analog.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-
ot; %c %b)
logfile \temp\analog_bug.sample.log
The second LOGFORMAT tells Analog that some of the lines it needs to parse
will have an extraneous newline character after the Username field.
Aengus
+
| TO UNSUBSCRIBE from
ur search engine rankings?
Not unless that information is in the logfiles. It can certainly help you to
understand what search terms users are using to find your site, but I'm
fairly sure that there won't be anything in your logfiles that will indicate
your ranking versus anyo
On Wednesday, August 30, 2006 5:35 PM [EDT],
Shulkin, Vadim <[EMAIL PROTECTED]> wrote:
Aengus,
Looks like the problem is with the fact that I am using UNIX for
processing. It does not work on my system regardless. I follow all
your instructions. Here is the output from running the
x? That's the only reason APACHELOGFORMAT exists - to save
people having to translate the syntax from their Apache conf files to their
analog.cfg files.
LOGFORMAT (%M %d %Y %h:%n:%j] %S %u "%j %r %j" %c %b
m?
The simplest way to investigate this is to use REFINCLUDE which wwill
restrict the report to only those entries that have that referrer, and run a
report to see if the hits are only coming from a small range of IP
addresses, and what browsers are involved.
http:/
iate it. Thanks!
http://lists.meer.net/pipermail/analog-help/2006-August/019897.html
http://lists.meer.net/pipermail/analog-help/2006-September/019907.html
Aengus
-Original Message-
From: Watkins, Maureen
Sent: Wed 8/30/2006 1:21 PM
To: analog-help@lists.meer.net
Subject: Questions about A
too.
In the help i couldn't find anything about this.
thanks and best regards
Assuming you are logging referrers, you can certainly get a report on any
requests that don't have an "internal" referrer, which should be pretty much
all your "entry pages&q
501 - 600 of 1058 matches
Mail list logo
