/scripts/intro.php
> HTTP/1.1" 200 3653
>
> I get /scripts/ counts in my directory report but don't get the
> page count for intro.php in my request report.
> What am I missing?
Have you set the FLOOR for the request report low enough to show the
entry that you want to see?
or some people,
and not for others. You might be better off trying rdnslogs instead.
You can read previous posts about QDNS on the list here:
http://www.mail-archive.com/cgi-bin/htsearch?config=analog-help_lists_isite_net&words=qdns
Aengus
>
> -Original Message-
> From: [EMAIL
at file as a
logfile, and it didn't, because it couldn't find it.
What did you tell Analog to do? What arguments did you pass to it when
you ran it.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.me
that something is preventing Anlgform.exe from calling Analog properly.
Make sure that Ananlog is working properly before calling it from
Anlgform.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mai
ror.log: ignoring it
Analog won't usually parse error logs, so this is to be expected if you
tell it to parse *.log.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/list
and BROWSUMEXCLUDE just exclude those requests from the
Browser report and the Browser Summary reports.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: new
On Friday, September 17, 2004 3:28 PM [GMT],
J M <[EMAIL PROTECTED]> wrote:
> Thank you for responses to previous questions. I have anlgform
> working and am off to configure further. Extra thank you to Aengus
> for not only offering help but creating the Windows "helper&q
ing Sites.
The Referrer Report reports on Referrers. Try
REFERRER ON
Aengus
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news:/
Is all.cfg in the same directory as Analog?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|
On Tuesday, September 21, 2004 3:43 PM [GMT],
Jane Hermanson <[EMAIL PROTECTED]> wrote:
> Aengus thanksof course they were not in the same
> directory.changed the path to be reflective of the files...ran my
> script...and got separtate stats for my hosts.
>
> Did get
ALIAS or REQALIAS to hide the actual page name.
One way might be to do something like this:
FILEALIAS *.asp?* /search.asp?$2
INTSEARCHENGINE /search.asp section
(The Internal Search report should show all values that were assigned to
the "section" argument).
n/library c
INTSEARCHQUERY on
Listing queries, sorted by the number of requests.
reqs: search term
: ---
3: deafbios
2: gasw
2: auhist
1: fenian
1: ftpp
1: gadpi
Is that what you are trying to measure?
Aengus
+
e them by specifying
INTSEARCHQUERY ON
INTSEARCHWORD ON
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.gene
your lofgiles are formatted, running analog is as
simple as opening a command prompt, changing to the Analog directory,
and typing
Analog x:\directory\logfile.log
The result will be in report.html in the same directory.
Please read the documentation available on the Analog website.
http://www.analog.c
ccess to the logs whereever they
are on the server, or extract the logs for your website and send them to
you.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Use
lower
the floor (by default, the referrer report only lists "referring URLs
with at least 20 requests".
REFFLOOR 1r
will show all referrers.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net
the ...COLS
commands.
INTSEARCHQUERYCOLS
http://analog.cx/docs/othreps.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://ne
proxy servers that strip proxy
information.
You should probably do some reports of just those requests that don't
have any referrer information. Use
REFINCLUDE ""
and see if the Browser being used, or the Host report gives any insight
into who is generating these referrerless requests.
you tried running a report using BROWINCLUDE, to create a report on
just those NN4 requests? If they are coming from a small cluster of IP
addresses, or if they are only requesting pages, and not images, then a
spider would seem likely.
Aengus
+---
ate, but I
don't think I ever bothered doing it. Some of the logic required to
actually calculate yesterdays date is described in this post:
http://www.mail-archive.com/[EMAIL PROTECTED]/msg06580.html
Aengus
+
| TO UNSUBSC
te that every single request was made. When you told Analog to analyze
all cache files with SEP in the name, it included cachefiles from
September 2003, and because there are no dates associated with any
individual requests in cachefiles, the FROM/TO directives didn't exclude
the information from t
s counting all the index.html files as .htm, when
> using just a small sample log file.
Analog assumes that the default document in a directory is index.html.
You can use the DIRSUFFIX command to tell Analog what the default
document on yo
you expect them to be, and we can probably explain why they are
being interprted the way they are being interprted, and perhaps explain
how to erconfigure things to get the answer that you expect.
Aengus
+
| TO UNSUBSCRIBE
ve the GET method will be counted by Analog.
(You'll get a "Large number of corrupt log entries" warnings. You can
either ignore this, or just add a second LOGFORMAT entry - LOGFORMAT
(%j) should do it, I think).
Aengus
+-
t-Image/1.0"
If they're the entries in the logfile, then Analog isn't adding anything
to the beginning of the URLs, and you really should find out why your
web server is doing that.
Having said that, you can get Analog to take /advocates-for-an out of
the URL by using a FILEALIA
e two hypothetical log
entries as two "page views", but, as the FAQ
(http://www.analog.cx/docs/faq.html#faq181) says, that would really be
double counting.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://li
from the internet).
Have you looked at your failure report? Have you looked at the Host
report for those redirected requests to see if a large number of them
are coming from a broken client that can't do redirects properly, and
just constantly tries to reload the old homepage? (You'
gt; HTTP/1.0" 200 77323 "-" "Mozilla/4.0
>> (compatible; MSIE 6.0; Windows NT 5.1; SV1; MSN 9.0; MSNbMSNI;
>> MSNmen-us; MSNcIA; MPLUS)"
>> 221.217.222.116 - - [25/Oct/2004:00:28:07 -0400] "GET
>> /pages/index.html HTTP/1.1&qu
. If it doesn't, then
you may have configured Analog to only include Pages in the Request
Report (REQINCLUDE PAGES) and Analog wouldn't necessarily recognize that
request as a page (because it doesn't have an extension). Look at the
File Type Report for guidance.
Aengus
+
On Wednesday, October 27, 2004 12:15 PM [GMT],
Andreas Kalt <[EMAIL PROTECTED]> wrote:
> On Wed, 27 Oct 2004 11:34:35 +0100, Aengus <[EMAIL PROTECTED]> wrote:
>
> Aengus,
>
>> If you run Analog against a logfile containing that single line,
>> what do you get?
ting on what's in the logs - can you tell whether
the sites that are only showing this months hits even have log files for
last month?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listin
On Wednesday, October 27, 2004 5:21 PM [GMT],
Andreas Kalt <[EMAIL PROTECTED]> wrote:
> On Wed, 27 Oct 2004 12:48:37 +0100, Aengus <[EMAIL PROTECTED]> wrote:
>
> Ok, my analog result page says:
>
> Successful requests: 0
> Corrupt logfile lines: 1
>
> Could
.jar
I'm not sure it should make any difference, but have you tried
FILEEXCLUDE
*.gif,*.jpg,*.chm,*.asp,*.exe,*.csp,*.cab,*.css,*.cfc,*.swf,*.cmf,*.js,*
.jar
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://li
ser report to show up?
Is it turned on?
BROWSERSUM ON to turn on the Browser Summary, BROWSERREP ON to turn on
the full report.
http://www.analog.cx/docs/output.html#replist
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
55 (58.99 days)." , which confirms that analog found and
> processed those logs.
>
> But on the Daily Report I only get information from Sept 18 to
> October 29. Nothing from Sept 1 to 17. Any ideas? Thanks in advance.
http:/
On Wednesday, November 03, 2004 12:40 AM [GMT],
Natasha R Gallaty <[EMAIL PROTECTED]> wrote:
> S: Unwanted lines: 723
Unwanted lines means lines that you have excluded, either with a FROM/TO
directive, or a *INCLUDE/*EXCLUDE directive
line etc.
http://www.analog.cx/docs/startpc.html
You can control Analog by editing the analog.cfg file, rather than
passing parameters at the command line
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer
//www.analog.cx/docs/othreps.html#FLOOR
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http:
TDIR.
CHARTDIR tells Analog what URL prefix to use in the IMG SRC commands,
and LOCALCHARTDIR tells analog the physical location to write the images
to.
http://www.analog.cx/docs/othreps.html#CHARTDIR
Aengus
+
| TO UNSUBS
On Tuesday, November 09, 2004 1:52 AM [GMT],
Jeff Duncan <[EMAIL PROTECTED]> wrote:
> Is there a way to exclude certain IP addresses or networks from the
> report stats?
HOSTEXCLUDE
http://www.analog.cx/docs/include.html#HOSTINC
th names, you will have to be doing DNS lookups, and only
addresses that successfully resolve will be excluded.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet versi
n.
You have two %s field in your LOGFORMAT, two %b fields, 2 %u fields and
no %c field. This LOGFORMAT might work better:
LOGFORMAT (%Y-%m-%d %h:%:%j %s %u %j %j %j %j %r %q %c %j %b %j %t %j %B
%j %f)
Aengus
+
| TO UNSU
4 error handler from your request report all together
(not a good idea, I wold have thought) then use
FILEEXCLUDE /~404trap.aspx*
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
in the Browser Report, but note
that the Browser Report only reports on Page requests by default. You
should do a REQINCLUDE PAGES, with the Request report on, to see that
you're recording what you think you're recording.
Aengus
+---
esses would be counted.
> It will help if you could tell me what exact changes are to be done in
> the configuration file for this to work.
Thanks, but no thanks. It might be worth your while erading
http://www.analog.cx/docs/webworks.html before spending too much time
analyzing AOL
r time of last access, but that's only practical
on a user by user basis.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/gmane.co
On Friday, November 19, 2004 3:16 PM [GMT],
Christian Kaufmann <[EMAIL PROTECTED]> wrote:
> Hi Stephen,
>
> once the setup is done, then your tool is really great!
>
> do you have plans, to add statistic about visits to analog?
http://www.analog.cx/docs/fa
On Tuesday, November 16, 2004 7:18 PM [GMT],
Neil Jones <[EMAIL PROTECTED]> wrote:
> I'd like to detect just the visits from one single IP address.
>
> If there is a way to do this using analog how do I do it?
HOSTINCLUDE
http://www.analog.cx/docs/include.html
teria, but the config/docs are pretty confusing. How can I
> get it to show me the last month's referrals rather than the top 30?
I just ran Analog against one of my logfiles, and the referrer report
showed up just fine, even though the warnings were displayed:
analog ex041122.log +Otes
t of people give up after page 7, for example (assuming that most
people start at page 1, and work their way forward).
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|
ave to do for the
> root directory?
This was asked, and answered, only last Thursday:
http://lists.meer.net/pipermail/analog-help/2004-November/017314.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.
0; windows nt 5.1)"
LOGFORMAT (%S - - [%d/%M/%Y:%h:%n:%j %j] "%j %r %j" %c %j"%f" "%B")
Because there's no way of telling what any of the fields between the
Status code and the Referrer are, I've just marked them as junk.
Aengus
+-
logfile. If your logfile is called 10_26_2004.log, and it is in the
Analog directory, then it would also have been read, which suggest that
your logile either doesn't end in .log, or isn't stored in the Analog
directory.
Aengus
+
On Tuesday, November 23, 2004 6:54 PM [GMT],
Jeff Ross <[EMAIL PROTECTED]> wrote:
>>> This was asked, and answered, only last Thursday:
>>>
>>>
http://lists.meer.net/pipermail/analog-help/2004-November/017314.html
>>>
>>> Aengus
>
> Ok, so
ile is actually called
10_26_2004.log then that's what you have to tell Analog to open - the
fact that Windows is configured to tell you that the file is called
10_26_2004 instead of 10_26_2004.log is only going to cause confusion.
Go to Tools/Folder Options/View and unchec
On Tuesday, November 23, 2004 8:33 PM [GMT],
Jeff Ross <[EMAIL PROTECTED]> wrote:
>>> REQEXCLUDE will exclude entries from the Request report. If you
>>> want to exclude it from the Directory report, try DIREXCLUDE.
>
>>> http://www.analog.cx/docs/include.html#
> REQCOLS Rd
>
> Thanks Nick. I did look there. I want to remove the 2 columns, not
> add some.
The REQCOLS directive tells Analog what Columns to display. If you set
REQCOLS Rd, Analog will only display the number of requests and the date
of last access in the Request Report.
Aen
e date and time of first access as
well - set
REQCOLS NrED
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/gmane.comp.web.analog
s can be achieved?
> Perhaps some format of rewrite? I archive the native log files so I
> don't need the cachefile for reference.
Off the top of my head, I'd look at changing your LOGFORMAT command to
interpret the URL field as
2:34: /img/xpc.JPG
> etc. >> 1684: 18.80%: 29/Nov/04 02:35: [not listed: 317 files]
>
> Is the above therefore daily data? I'm trying to reconcile 1) and 2)
The last time each of these files was access was on 29/Nov at 2:33/2:34.
But each of
you delete the batch files that delete analog.cfg!).
http://www.analog.cx/docs/syntax.html#CONFIGFILE
> This works well, but all the pie charts get overwritten.
> Is there a way in the config file to write everything (graphics &
> html) to a different directory?
.
http://analog.cx/docs/logfmt.html
> Second. I migrated my site to a new server from IIS. Will analog
> analyze my IIS logs if I move them to the new server?
Analog doesn't care where the logs come from, if it understands them it
will analyze them.
Aengus
+-
On Thursday, December 02, 2004 6:04 PM [GMT],
Wallace Nicoll <[EMAIL PROTECTED]> wrote:
> Some progress ... I combined the daily cache files into several weekly
> ones, then analysed them at the end of the month, and the job reduced
> from 10 hours to 3 ...
>
> In relation
t Reader and the Web
server. If you want the entire PDF document to continue downloading in
the background while you view the first page of requested information,
be sure Allow Background Downloading is selected in the Web Browser
Options section of the preferences.
Or maybe some of them weren'
supports partial
downloads, so, if your web server is willing to cooperate, Acrobat will
send multiple requests for different parts of the file as you read
through it.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http:/
report 1 request, configure your web server
to only record 1 log entry.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/g
ffic from www.xyz.com",
what exactly is it that you are trying to achieve? if someone follows a
link on www.xyz.com, and ends up at your page, then only the very first
entry in your logfile will show www.xyz.com as the referrer - every
subsequ
link on
someone elses website, you may decide to make those requests work by
putting a copy of the requested file at the address that is being used
or (better) put a redirection there, to redirect those users to that
location.
Aengus
+
-
Analog can read multiple logfiles when it is generating a report.
Just specify LOGFILE *.LOG in your analog.cfg file to read all the
logfiles in the current directory.
http://www.analog.cx/docs/logfile.html
Aengus
+
|
hing between the 2nd space and the
[ as the username. Note that this will mean that the Username ends in a
space, which might cause some problems with USERINCLUDES and
USEREXCLUDES.
Aengus
+
| TO UNSUBSCRIBE from this list:
|
On Monday, December 20, 2004 6:49 PM [GMT],
Brian V Hughes <[EMAIL PROTECTED]> wrote:
> On Dec 20, 2004, at 01:43 PM, Aengus wrote:
>> What happens when you try to wrap the username in quotes? (change %u
>> to \"%u\")
>
> I tried that and didn't get the
idn't even know version 6
had been released.
I've just subscribed now, but thanks for sharing it with the list - I'm
sure I'm not the only one who'll be installing it shortly :-)
Aengus
+
| TO UNSU
esn¹t work...any recommendations?
Usually on Unix, you'd type ./analog. But you'd have to install a Unix
version first - the analog.exe file for Windows isn't going to run under
Unix.
The basic readme for getting started with Analog on Uni
On Thursday, December 23, 2004 4:53 PM [GMT],
Bill Kent <[EMAIL PROTECTED]> wrote:
> Aengus,
>
> I'm definitely new to this so apologies for the dumb question. I
> downloaded the version for mac and have been running it manually from
> my desktop for some time. As st
w.analog.cx/docs/faq.html#faq128
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives:
he possible reason?
Are you sure? I put those two IP addresses into one of my logfiles, and
they are both included in the Domain count for 10.
My Host Report has this:
reqs host
1610 10.23.229.6
57910.23.229.69
My Domain Report has this:
reqs organisation
2189 10
(I'm runn
wont display any entries with less than 10 requests.
>
> I have REQFLOOR 1r in the config file.
>
> So basically I need the code to display all "sub requests"
>
> Any help will be much appreciated.
Try
ample log file that is included with Analog).
Firefox is a member of the Mozilla family - it identifies itself as
Mozilla 5.0 and Firefox 1.0, and also mentions the Gecko rendering
engine that it uses:
Mozilla/5.0+(Windows;+U;+Window
't figure it out, then BROWEXCLUDE the browsers that you
do exclude, until all you've got left are the once that you're trying to
identify.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/m
in
> logfiles automatically?
The LOGTIMEOFFSET command is used to allow Analog to recalculate the GMT
timestamps in your logfiles and display the times using your local
timezone.
If you use
LOGTIMEOFFSET -360
then your Analog reports will reflect the local time in Mexico.
http://www.analog.cx
ient about doing DNS resolution. Given the number of
unresolved addresses you indicate, Analog could take many hours to do a
first report with DNS resolution on. You might want to check out some of
the DNS resolution tools listed on the Helpers page.
Aengus
+--
he user to access the page at all. I don't remember whether that was
changed for IIS5).
>> It appears to be ignoring the data in the log file.
It's not ignoring the data in the examples that you provided.
Aengus
>>
>> Larry McElhinney
>> www.SuperLinks.com
>
x27;t analog produce statistics on "visits"?
See "How the Web Works" - http://www.analog.cx/docs/webworks.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/l
as opposed to just
> all requests for a file, whether the entire file was delivered or not?
You could create a custom LOGFORMAT, and use the User field (%u) instead
of the Bytes field. Then if you do a USERINCLUDE 180 (or whatever
the full size is), the Analog report will ignore all e
ere any difference between a "foo" reference from Yahoo and a "foo"
reference from google? It sounds like you should probably be looking at
the Search report, rather than the referrer report.
I don't know whether you can use a
ermail/analog-help/2003-October/015742.html
http://lists.meer.net/pipermail/analog-help/2003-November/015912.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: new
SPs DNS server instead on the machine
that you are running Analog on. That might improve matters.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://new
o get my name in?
You just posted this message to the list, so your subscription is
active.
I don't think you can see the subscriber list - that's not publicly
available, and is only available to the administrator, according to
http://lists.meer.net
. That's why the documentation recommends that you use a helper
app to do the DNS lookups instead of having Analog do them.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog
\"%{Referer}i\"
> \"%{User-Agent}i\" %c %T %v" custom2
Thew correct APACHELOGFORMAT for that is
LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"
%c %T %v"
That's the whole point of the APACH
24 hours. That 18467.5. Presumably,
Analog uses the seconds to make the calculation more precise, which
explains the minor discrepancy.
> >> Average successful requests per day: 18,466
> Logfile lines without status code: 3
> Successful requests for pages: 610
dy.
JDResolve is a tool that does a lot of the "fake hostname" stuff that
you are doing, but unfortunately it's not built for Windows - it's been
a few years since I (unsuccessfully) tried to get it running under
Windows, but you
g on your network configuration, that
might not work properly with "NetBIOS over TCP/IP" disabled, so make
sure you have a local Admin account that works before you make this
change).
Aengus
+
| TO UNSUBSCRIBE from this
ther than on-going monitoring, but I used to use QDNS
when I needed DNS resolution, and found it good enough for my needs. The
last couple of times I've needed DNS resolution, though, I've used
RDNSLOGS).
Aengus
+
|
erything I could think of with no success.
It's not clear what exactly you are trying to do. You want the Monthly
Report period to be different to what?
You can specify how many months the report will display with a ROWS
command:
ht
March 2004 through today.
So the problem isn't at the beginning of the period, but at the end -
you don't want the Monthly report to show the current "partial" month?
Aengus
+
| TO UNSUBSCRIBE from this li
ast year on the WayBack Machine:
http://web.archive.org/web/20040207083029/http://wadsack-allen.com/products/robot-list.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|
| awk -F: '{print $2}' |
> sed 's/^ *//g' | sort | awk '{print "ROBOTINCLUDE \"" $1 "*\""}'
grep "robot-name:" or grep "robot-useragent:"?
Aengus
+
On Friday, February 11, 2005 7:50 PM [GMT],
Ken Schweigert <[EMAIL PROTECTED]> wrote:
> On Fri, Feb 11, 2005 at 07:21:00PM -0000, Aengus wrote:
>> On Friday, February 11, 2005 7:14 PM [GMT],
>> Ken Schweigert <[EMAIL PROTECTED]> wrote:
>>
>>> O
tions:Analog6.0:logs:logfile:"
but Analog couldn't find that file, so it didn't open it.
I'm afraid I don't know anything about the correct syntax for specifying
Mac file paths, but if you're dragging and dropping the .cfg file, you
could try d
1 - 100 of 1058 matches
Mail list logo
