Re: Url checker

2005-10-03 Thread Hannah Schroeter
Hello!

On Mon, Oct 03, 2005 at 12:24:41PM -0400, Dave Anderson wrote:
>** Reply to message from <[EMAIL PROTECTED]> on Mon, 3 Oct
>2005 11:08:31 +0200

>>Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
>>to monitor web site traffic and present a report with all visits to all
>>websites per user (pc). I've searched the internet but did not find an
>>appropriate (free) solution. I have been playing with the idea to use
>>snort, but that seems a lot of work to me.

>Your boss _is_ aware that what he seems to be asking for is
>fundamentally impossible, due to caching proxies, dynamic IP addresses,
>multiuser systems, etc?

An exact solution is impossible for the reasons you state. But
you *can* do heuristic approximations. I don't know of any free
solutions though.

But I know that the OP isn't alone. There's a company doing that for
the web sites they host, based on the httpd (Apache) logs.

>   Dave

Kind regards,

Hannah.



Re: Url checker

2005-10-03 Thread Dave Anderson
** Reply to message from <[EMAIL PROTECTED]> on Mon, 3 Oct
2005 11:08:31 +0200

>Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
>to monitor web site traffic and present a report with all visits to all
>websites per user (pc). I've searched the internet but did not find an
>appropriate (free) solution. I have been playing with the idea to use
>snort, but that seems a lot of work to me.

Your boss _is_ aware that what he seems to be asking for is
fundamentally impossible, due to caching proxies, dynamic IP addresses,
multiuser systems, etc?

Dave

-- 
Dave Anderson
<[EMAIL PROTECTED]>



Re: Url checker

2005-10-03 Thread Gaby vanhegan
On 3 Oct 2005, at 14:48, <[EMAIL PROTECTED]> wrote:

> be warned: depending on the number of clients on your network, logging
> all http traffic is a pretty good way of testing the reliability of  
> your
> disk.

If you do eventually get your HTTP traffic running through one host,  
running EtherPeg on it always tickles me.

--
Junkets for bunterish lickspittles since 1998!
[EMAIL PROTECTED]
http://weblog.vanhegan.net



Re: Url checker

2005-10-03 Thread Nils.Reuvers
Good point. 

-Original Message-
From: michael hamerski [mailto:[EMAIL PROTECTED] 
Sent: maandag 3 oktober 2005 15:46
To: Reuvers, Nils
Subject: Re: Url checker

be warned: depending on the number of clients on your network, logging
all http traffic is a pretty good way of testing the reliability of your
disk.

when I was reluctantly asked to implement this a few years ago on a 100
client network, the aging disk failed within a week. if you want to do
this on a long-term basis for more than a few clients, I would consider
a dedicated disk.

mike


=
A disclaimer applies to this email and any attachments. 
Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this 
disclaimer.



Re: Url checker

2005-10-03 Thread Teemu Schaabl
Teemu Schaabl([EMAIL PROTECTED])@2005.10.03 13:15:20 +:
> [EMAIL PROTECTED]([EMAIL PROTECTED])@2005.10.03
> 11:08:31 +:
> > Hi list,
> >
> > Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
> > to monitor web site traffic and present a report with all visits to all
> > websites per user (pc). I've searched the internet but did not find an
> > appropriate (free) solution. I have been playing with the idea to use
> > snort, but that seems a lot of work to me.
> >
> > Any suggestions are more then welcome.
> >
>
> use squid transparent on your openbsd gateway:
> daniel has a working howto:
> http://www.benzedrine.cx/transquid.html
>
> [ ... ]
>

gezz - got this question wrong, sorry for the noise.

--
"Every man takes the limits of his own field of vision
 for the limits of the world." - Schopenhauer

[demime 1.01d removed an attachment of type application/pgp-signature]



Re: Url checker

2005-10-03 Thread Gaby vanhegan
On 3 Oct 2005, at 12:11, <[EMAIL PROTECTED]> wrote:

> I just thought of another solution. Stupid me not thinking of it
> earlier. I can log all http traffic with PF and write some perl to
> process the logfile. Can't believe I was staring blind on a 3rd party
> solution.

Perhaps transparent proxying with Squid and PF might give you the  
information you need?

--
Junkets for bunterish lickspittles since 1998!
[EMAIL PROTECTED]
http://weblog.vanhegan.net



Re: Url checker

2005-10-03 Thread Teemu Schaabl
[EMAIL PROTECTED]([EMAIL PROTECTED])@2005.10.03
11:08:31 +:
> Hi list,
>
> Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
> to monitor web site traffic and present a report with all visits to all
> websites per user (pc). I've searched the internet but did not find an
> appropriate (free) solution. I have been playing with the idea to use
> snort, but that seems a lot of work to me.
>
> Any suggestions are more then welcome.
>

use squid transparent on your openbsd gateway:
daniel has a working howto:
http://www.benzedrine.cx/transquid.html

after you got it up and running, analyse the resulting log-files
with one of these: http://www.squid-cache.org/Scripts/

maybe you should try out this, sounded good to me, but I never had to
implemented it (thank god):

http://squidalyser.sourceforge.net

hope this helps,
teemu

--
personal crap: http://teemu.lynix.net

[demime 1.01d removed an attachment of type application/pgp-signature]



Re: Url checker

2005-10-03 Thread Nils.Reuvers
Thanks Jasper,

I just thought of another solution. Stupid me not thinking of it
earlier. I can log all http traffic with PF and write some perl to
process the logfile. Can't believe I was staring blind on a 3rd party
solution.

Nils
 

-Original Message-
From: J. Lievisse Adriaanse [mailto:[EMAIL PROTECTED] 
Sent: maandag 3 oktober 2005 12:41
To: Reuvers, Nils; misc@openbsd.org
Subject: Re: Url checker


Maybe you mean something like:
http://www.openbsd.org/cgi-bin/cvsweb/ports/www/linkchecker/ ?

Cheers,
Jasper

Op 3/10/2005 schreef "[EMAIL PROTECTED]"
<[EMAIL PROTECTED]>:

>Hi list,
>
>Anyone knows a good URL checker that runs on OpenBSD? My boss wants me 
>to monitor web site traffic and present a report with all visits to all

>websites per user (pc). I've searched the internet but did not find an 
>appropriate (free) solution. I have been playing with the idea to use 
>snort, but that seems a lot of work to me.
>
>Any suggestions are more then welcome.
>
>Nils
>
>===
>== A disclaimer applies to this email and any 
>attachments.
>Refer to http://www.sparkholland.com/emaildisclaimer for the full text
of this disclaimer.
>


=
A disclaimer applies to this email and any attachments. 
Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this 
disclaimer.



Re: Url checker

2005-10-03 Thread J. Lievisse Adriaanse
Maybe you mean something like:
http://www.openbsd.org/cgi-bin/cvsweb/ports/www/linkchecker/ ?

Cheers,
Jasper

Op 3/10/2005 schreef "[EMAIL PROTECTED]"
<[EMAIL PROTECTED]>:

>Hi list,
>
>Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
>to monitor web site traffic and present a report with all visits to all
>websites per user (pc). I've searched the internet but did not find an
>appropriate (free) solution. I have been playing with the idea to use
>snort, but that seems a lot of work to me.
>
>Any suggestions are more then welcome.
>
>Nils
>
>=
>A disclaimer applies to this email and any attachments.
>Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this 
>disclaimer.



Url checker

2005-10-03 Thread Nils.Reuvers
Hi list,

Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
to monitor web site traffic and present a report with all visits to all
websites per user (pc). I've searched the internet but did not find an
appropriate (free) solution. I have been playing with the idea to use
snort, but that seems a lot of work to me.

Any suggestions are more then welcome.

Nils

=
A disclaimer applies to this email and any attachments. 
Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this 
disclaimer.