[analog-help] please help

[Fitzpatrick, Brendan]

Hello,

I'm running Analog on hundreds of different logs (some IIS, some iPlanet, some 
Apache) and some of the reports show numbers in parenthesis ... most don't. 
Does anyone know why? -does it depend on the log format - does it depend if 
data inside the logs contains 7 or more days worth of data? Is there a way to 
tur the 7-day period number off - it's not even correct.

see the below example.

Thanks in advance.

Brendan



Figures in parentheses refer to the 7-day period ending 26-Apr-2005 14:18.

Successful requests: 34,175 (0) 
Average successful requests per day: 127 
Successful requests for pages: 533 (0) 
Average successful requests for pages per day: 1 
Failed requests: 11,790 (1) 
Redirected requests: 2,071 (0) 
Distinct files requested: 174 (0) 
Distinct hosts served: 55 (0) 
Corrupt logfile lines: 9 
Data transferred: 60,286,237 bytes (0 bytes) 
Average data transferred per day: 225,459 bytes (0 bytes) 

+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
+

[analog-help] Please help

[satheesh]

friends
I tried to run the analog code in VC++ environment. 
but I am getting some errors.
I am adding those errors also. Can anyone help me 
in sorting out this problem.
Expecting an earliest help
thanks and regards
Satheesh
 
Linking...alias.obj : error LNK2001: unresolved 
external symbol [EMAIL PROTECTED]alias.obj : error 
LNK2001: unresolved external symbol [EMAIL PROTECTED]init2.obj : error LNK2001: 
unresolved external symbol _pcre_fullinfoinit2.obj : error LNK2001: 
unresolved external symbol _pcre_compileutils.obj : error LNK2001: 
unresolved external symbol _pcre_compileinput.obj : error LNK2001: 
unresolved external symbol _unzGoToFirstFileinput.obj : error LNK2001: 
unresolved external symbol _unzOpeninput.obj : error LNK2001: unresolved 
external symbol _gzopeninput.obj : error LNK2001: unresolved external symbol 
[EMAIL PROTECTED]input.obj : error 
LNK2001: unresolved external symbol _unzGetCurrentFileInfoinput.obj : error 
LNK2001: unresolved external symbol _unzOpenCurrentFileinput.obj : error 
LNK2001: unresolved external symbol _unzGoToNextFileinput.obj : error 
LNK2001: unresolved external symbol [EMAIL PROTECTED]input.obj : error 
LNK2001: unresolved external symbol _unzCloseCurrentFileinput.obj : error 
LNK2001: unresolved external symbol _gzcloseinput.obj : error LNK2001: 
unresolved external symbol _unzCloseinput.obj : error LNK2001: unresolved 
external symbol [EMAIL PROTECTED]input.obj 
: error LNK2001: unresolved external symbol _unzReadCurrentFileinput.obj : 
error LNK2001: unresolved external symbol _gzreadouthtml.obj : error 
LNK2001: unresolved external symbol _gdImageFillouthtml.obj : error LNK2001: 
unresolved external symbol _gdImageLineouthtml.obj : error LNK2001: 
unresolved external symbol _gdImageRectangleouthtml.obj : error LNK2001: 
unresolved external symbol _gdImageArcouthtml.obj : error LNK2001: 
unresolved external symbol _gdImageColorAllocateouthtml.obj : error LNK2001: 
unresolved external symbol _gdImageCreateouthtml.obj : error LNK2001: 
unresolved external symbol _gdImageStringouthtml.obj : error LNK2001: 
unresolved external symbol _gdImageFilledRectangleouthtml.obj : error 
LNK2001: unresolved external symbol _gdImageGetPixelouthtml.obj : error 
LNK2001: unresolved external symbol _gdImageDestroyouthtml.obj : error 
LNK2001: unresolved external symbol _gdImagePngouthtml.obj : error LNK2001: 
unresolved external symbol _gdFontFixedouthtml.obj : error LNK2001: 
unresolved external symbol _gdFontSmallutils.obj : error LNK2001: unresolved 
external symbol _pcre_execwin32.obj : error LNK2001: unresolved external 
symbol [EMAIL PROTECTED]win32.obj : error 
LNK2001: unresolved external symbol [EMAIL PROTECTED]Debug/Tuesday.exe : fatal error 
LNK1120: 34 unresolved externalsError executing link.exe.
 
Tuesday.exe - 36 error(s), 0 
warning(s)

__
Scanned and protected by Email scanner

+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
+

[analog-help] please help!

[Eliza Faria-Santos]

Every day I've been checking the stats because I want to see how many 
new computers I get on my site each day (I was averaging 10)  but not 
the log files have stopped and I know it's wrong (look under the 
"General" file because on the 9th it was up to 423 and now for days it 
has been stuck on 422 and that's not possible!!!


+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+

Re: [analog-help] please help

[Klaus Johannes Rusch]

Fitzpatrick, Brendan wrote:
I'm running Analog on hundreds of different logs (some IIS, some iPlanet, some Apache) and some of the reports show numbers in parenthesis ... most don't. Does anyone know why? -does it depend on the log format - does it depend if data inside the logs contains 7 or more days worth of data? Is there a way to tur the 7-day period number off - it's not even correct.
 

RTFM :-)
   The figures in parentheses in the General Summary are for the last
   seven days: either the seven days before the TO time, or if no TO
   time is given, the seven days before the time of the program start.
   The figures for the last seven days are normally included if some,
   but not all, of the requests fall in those seven days; but you can
   turn them off by means of the command
   LASTSEVEN OFF
--
Klaus Johannes Rusch
[EMAIL PROTECTED]
http://www.atmedia.net/KlausRusch/
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
+

Re: [analog-help] Please help

[Jeremy Wadsack]

Try building with gcc. You can get a copy for Windows with Cygwin 
(http://www.cygwin.com/). Otherwise, you should configure your VC++ 
environment for ANSI C and it looks like you might be missing some libs 
(make sure to include subdirectories and any system libraries). You 
might still need Cygwin (or other POSIX system) for the gethostbyaddr, 
etc. type functions.

--
Jeremy Wadsack
Seven Simple Machines
satheesh wrote:
friends
I tried to run the analog code in VC++ environment. but I am getting 
some errors.
I am adding those errors also. Can anyone help me in sorting out this 
problem.
Expecting an earliest help
thanks and regards
Satheesh
 
Linking...
alias.obj : error LNK2001: unresolved external symbol 
[EMAIL PROTECTED] 
alias.obj : error LNK2001: unresolved external symbol [EMAIL PROTECTED] 

init2.obj : error LNK2001: unresolved external symbol _pcre_fullinfo
init2.obj : error LNK2001: unresolved external symbol _pcre_compile
utils.obj : error LNK2001: unresolved external symbol _pcre_compile
input.obj : error LNK2001: unresolved external symbol _unzGoToFirstFile
input.obj : error LNK2001: unresolved external symbol _unzOpen
input.obj : error LNK2001: unresolved external symbol _gzopen
input.obj : error LNK2001: unresolved external symbol 
[EMAIL PROTECTED] 
input.obj : error LNK2001: unresolved external symbol 
_unzGetCurrentFileInfo
input.obj : error LNK2001: unresolved external symbol _unzOpenCurrentFile
input.obj : error LNK2001: unresolved external symbol _unzGoToNextFile
input.obj : error LNK2001: unresolved external symbol 
[EMAIL PROTECTED] 
input.obj : error LNK2001: unresolved external symbol _unzCloseCurrentFile
input.obj : error LNK2001: unresolved external symbol _gzclose
input.obj : error LNK2001: unresolved external symbol _unzClose
input.obj : error LNK2001: unresolved external symbol [EMAIL PROTECTED] 

input.obj : error LNK2001: unresolved external symbol _unzReadCurrentFile
input.obj : error LNK2001: unresolved external symbol _gzread
outhtml.obj : error LNK2001: unresolved external symbol _gdImageFill
outhtml.obj : error LNK2001: unresolved external symbol _gdImageLine
outhtml.obj : error LNK2001: unresolved external symbol _gdImageRectangle
outhtml.obj : error LNK2001: unresolved external symbol _gdImageArc
outhtml.obj : error LNK2001: unresolved external symbol 
_gdImageColorAllocate
outhtml.obj : error LNK2001: unresolved external symbol _gdImageCreate
outhtml.obj : error LNK2001: unresolved external symbol _gdImageString
outhtml.obj : error LNK2001: unresolved external symbol 
_gdImageFilledRectangle
outhtml.obj : error LNK2001: unresolved external symbol _gdImageGetPixel
outhtml.obj : error LNK2001: unresolved external symbol _gdImageDestroy
outhtml.obj : error LNK2001: unresolved external symbol _gdImagePng
outhtml.obj : error LNK2001: unresolved external symbol _gdFontFixed
outhtml.obj : error LNK2001: unresolved external symbol _gdFontSmall
utils.obj : error LNK2001: unresolved external symbol _pcre_exec
win32.obj : error LNK2001: unresolved external symbol [EMAIL PROTECTED] 

win32.obj : error LNK2001: unresolved external symbol [EMAIL PROTECTED] 

Debug/Tuesday.exe : fatal error LNK1120: 34 unresolved externals
Error executing link.exe.
 
Tuesday.exe - 36 error(s), 0 warning(s)

__
Scanned and protected by Email scanner
 


+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
+
 

+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
+

Re: [analog-help] please help!

[Jeremy Wadsack]

Eliza,

Whether your analog statistics are updated or not is entirely a factor 
of the analog installation and the log file rotation mechanism in place 
on your web server. The analog software can be installed in numerous 
different ways and can work in a wide range of environments. If your 
analog report is provided by a hosting company, you should contact them 
with this issue.


If you installed it yourself, then there are a couple things you can 
check. First, see if the date the report was generated on changes. If 
not, you will need to look at your server and find out why the scheduler 
is not longer working. If the report generated date is being updated, 
look at the range of dates for the data. Most likely you have some 
logfile rotation set up on your web server and your old log files are 
being "rotated" (deleted or renamed) and no longer are included in the 
statistics.


--
Jeremy Wadsack
Seven Simple Machines




Eliza Faria-Santos wrote:

Every day I've been checking the stats because I want to see how many 
new computers I get on my site each day (I was averaging 10)  but not 
the log files have stopped and I know it's wrong (look under the 
"General" file because on the 9th it was up to 423 and now for days it 
has been stuck on 422 and that's not possible!!!



+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+

[analog-help] Please help with getting analog to count one single file.

[John Allspaw]

A colleague and myself have been having the worst time trying to get analog to do a simple thing:

count only the occurences of one single file in the access logs.

and with no luck at all.

We've been using analog for apache log processing for years now, and
never have had many issues.  Maybe something is escaping us, but
basically we've put a 1x1 pixel gif on the site, on only those pages
that we'd like to count, and want to only include that in our reports:

/images/thing.gif?0485033001125610205

where the number is a timestamp, to prevent browser caching.

That's it.  We want to ignore everything else.  At this point
we don't care about referrers or DNS.  We just want an accurate
count of pageviews, and since this case 1 page=

We've been over and over the excludes/includes list.  Can someone please help ?
I can't imagine that it's not something like:

PAGEINCLUDE /images/thing.gif
FILEINCLUDE /images/thing.gif
ARGSEXCLUDE /images/thing.gif  

and that's it, right ?  I'd hate to think that in this case analog
could be replaced with "zgrep -c thing.gif /var/logs/*-access.log.gz"

thanks in advance.
john
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+

Re: [analog-help] Please help with getting analog to count one single file.

[Jeremy Wadsack]

The command you want is FILEINCLUDE. However, when a request includes a 
query string, you need use a wildcard to include all matches:


   FILEINCLUDE /images/thing.gif*

See http://analog.cx/docs/include.html for a discussion.

PAGEINCLUDE would mean that this is included in Page Requests, which is 
probably not what you want.


ARGSINCLUDE means that the request reports will list sub-items for each 
unique query string, which may prove interesting if those numbers have 
specific meaning.


--
Jeremy Wadsack
Seven Simple Machines


John Allspaw wrote:

A colleague and myself have been having the worst time trying to get 
analog to do a simple thing:


count only the occurences of one single file in the access logs.

and with no luck at all.

We've been using analog for apache log processing for years now, and 
never have had many issues.  Maybe something is escaping us, but 
basically we've put a 1x1 pixel gif on the site, on only those pages 
that we'd like to count, and want to only include that in our reports:


/images/thing.gif?0485033001125610205

where the number is a timestamp, to prevent browser caching.

That's it.  We want to ignore everything else.  At this point we don't 
care about referrers or DNS.  We just want an accurate count of 
pageviews, and since this case 1 page=


We've been over and over the excludes/includes list.  Can someone 
please help ?

I can't imagine that it's not something like:

PAGEINCLUDE /images/thing.gif
FILEINCLUDE /images/thing.gif
ARGSEXCLUDE /images/thing.gif 

and that's it, right ?  I'd hate to think that in this case analog 
could be replaced with "zgrep -c thing.gif /var/logs/*-access.log.gz"


thanks in advance.
john



+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+

Re: [analog-help] Please help with getting analog to count one single file.

[John Allspaw]

actually, I do want to include it as a "page" because we've placed the thing.gif only on pages we'd like to count.
this is done to simplify what we'd like to count, instead of constantly
maintaining long exclude/include lists, since not all *.php  pages
are to be counted as "pages".

I don't want to count the unique strings after the ? because those are
just timestamps, placed there to make sure that the browser doesn't
cache the gif.
I assumed that putting ARGSEXCLUDE /images/thing.gif would force it to
treat every request for thing.gif as the same, no matter what the query
string...is that correct ?

Since posting, I believe I figured it out...I see:

  confline(op, "PAGEINCLUDE", "*/", NULL, -1);
  confline(op, "PAGEINCLUDE", "REGEXPI:\\.html?$", NULL, -1);

in src/globals.c.  

So no matter what you put in the PAGEEXCLUDE/INCLUDE list, if you compile analog with this, then you will *always* be including:

- */
- REGEXPI:\\.html?$

??  is that right ?   please someone smack me for not seeing anything about this in the analog docs.

--john


On 9/1/05, Jeremy Wadsack <[EMAIL PROTECTED]> wrote:
The command you want is FILEINCLUDE. However, when a request includes aquery string, you need use a wildcard to include all matches:FILEINCLUDE /images/thing.gif*See 
http://analog.cx/docs/include.html for a discussion.PAGEINCLUDE would mean that this is included in Page Requests, which isprobably not what you want.ARGSINCLUDE means that the request reports will list sub-items for each
unique query string, which may prove interesting if those numbers havespecific meaning.--Jeremy WadsackSeven Simple MachinesJohn Allspaw wrote:> A colleague and myself have been having the worst time trying to get
> analog to do a simple thing:>> count only the occurences of one single file in the access logs.>> and with no luck at all.>> We've been using analog for apache log processing for years now, and
> never have had many issues.  Maybe something is escaping us, but> basically we've put a 1x1 pixel gif on the site, on only those pages> that we'd like to count, and want to only include that in our reports:
>> /images/thing.gif?0485033001125610205>> where the number is a timestamp, to prevent browser caching.>> That's it.  We want to ignore everything else.  At this point we don't
> care about referrers or DNS.  We just want an accurate count of> pageviews, and since this case 1 page=>> We've been over and over the excludes/includes list.  Can someone> please help ?
> I can't imagine that it's not something like:>> PAGEINCLUDE /images/thing.gif> FILEINCLUDE /images/thing.gif> ARGSEXCLUDE /images/thing.gif>> and that's it, right ?  I'd hate to think that in this case analog
> could be replaced with "zgrep -c thing.gif /var/logs/*-access.log.gz">> thanks in advance.> john+
|  TO UNSUBSCRIBE from this list:|http://lists.meer.net/mailman/listinfo/analog-help||  Analog Documentation: 
http://analog.cx/docs/Readme.html|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives|  Usenet version: 
news://news.gmane.org/gmane.comp.web.analog.general+
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+

Re: [analog-help] Please help with getting analog to count one single file.

[John Allspaw]

ok confirmed:

after trying several combinations, I have no idea how to get analog to count the occurences of one file (thing.gif) in the logs,
and count it as a page.

simply doing:

PAGEINCLUDE /images/thing.gif (or, just thing.gif)
or
FILEINCLUDE /images/things.gif (or, just thing.gif)

with or without:
ARGSEXCLUDE /images/thing.gif (or just thing.gif)

or any combination of the abovejust doesn't work.

can someone please help me ?   explaining to people why the
'powerful' analog log analysis tool can't do better than "zgrep -c" is
getting tiresome.
--john

On 9/1/05, John Allspaw <[EMAIL PROTECTED]> wrote:
actually, I do want to include it as a "page" because we've placed the thing.gif only on pages we'd like to count.
this is done to simplify what we'd like to count, instead of constantly
maintaining long exclude/include lists, since not all *.php  pages
are to be counted as "pages".

I don't want to count the unique strings after the ? because those are
just timestamps, placed there to make sure that the browser doesn't
cache the gif.
I assumed that putting ARGSEXCLUDE /images/thing.gif would force it to
treat every request for thing.gif as the same, no matter what the query
string...is that correct ?

Since posting, I believe I figured it out...I see:

  confline(op, "PAGEINCLUDE", "*/", NULL, -1);
  confline(op, "PAGEINCLUDE", "REGEXPI:\\.html?$", NULL, -1);

in src/globals.c.  

So no matter what you put in the PAGEEXCLUDE/INCLUDE list, if you compile analog with this, then you will *always* be including:

- */
- REGEXPI:\\.html?$

??  is that right ?   please someone smack me for not seeing anything about this in the analog docs.

--john


On 9/1/05, Jeremy Wadsack <[EMAIL PROTECTED]
> wrote:
The command you want is FILEINCLUDE. However, when a request includes aquery string, you need use a wildcard to include all matches:FILEINCLUDE /images/thing.gif*See 

http://analog.cx/docs/include.html for a discussion.PAGEINCLUDE would mean that this is included in Page Requests, which isprobably not what you want.ARGSINCLUDE means that the request reports will list sub-items for each
unique query string, which may prove interesting if those numbers havespecific meaning.--Jeremy WadsackSeven Simple MachinesJohn Allspaw wrote:> A colleague and myself have been having the worst time trying to get
> analog to do a simple thing:>> count only the occurences of one single file in the access logs.>> and with no luck at all.>> We've been using analog for apache log processing for years now, and
> never have had many issues.  Maybe something is escaping us, but> basically we've put a 1x1 pixel gif on the site, on only those pages> that we'd like to count, and want to only include that in our reports:
>> /images/thing.gif?0485033001125610205>> where the number is a timestamp, to prevent browser caching.>> That's it.  We want to ignore everything else.  At this point we don't

> care about referrers or DNS.  We just want an accurate count of> pageviews, and since this case 1 page=>> We've been over and over the excludes/includes list.  Can someone> please help ?

> I can't imagine that it's not something like:>> PAGEINCLUDE /images/thing.gif> FILEINCLUDE /images/thing.gif> ARGSEXCLUDE /images/thing.gif>> and that's it, right ?  I'd hate to think that in this case analog
> could be replaced with "zgrep -c thing.gif /var/logs/*-access.log.gz">> thanks in advance.> john+
|  TO UNSUBSCRIBE from this list:|http://lists.meer.net/mailman/listinfo/analog-help
||  Analog Documentation: 
http://analog.cx/docs/Readme.html|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: 
news://news.gmane.org/gmane.comp.web.analog.general+


+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+