Re: Url checker
Hello! On Mon, Oct 03, 2005 at 12:24:41PM -0400, Dave Anderson wrote: >** Reply to message from <[EMAIL PROTECTED]> on Mon, 3 Oct >2005 11:08:31 +0200 >>Anyone knows a good URL checker that runs on OpenBSD? My boss wants me >>to monitor web site traffic and present a report with all visits to all >>websites per user (pc). I've searched the internet but did not find an >>appropriate (free) solution. I have been playing with the idea to use >>snort, but that seems a lot of work to me. >Your boss _is_ aware that what he seems to be asking for is >fundamentally impossible, due to caching proxies, dynamic IP addresses, >multiuser systems, etc? An exact solution is impossible for the reasons you state. But you *can* do heuristic approximations. I don't know of any free solutions though. But I know that the OP isn't alone. There's a company doing that for the web sites they host, based on the httpd (Apache) logs. > Dave Kind regards, Hannah.
Re: Url checker
** Reply to message from <[EMAIL PROTECTED]> on Mon, 3 Oct 2005 11:08:31 +0200 >Anyone knows a good URL checker that runs on OpenBSD? My boss wants me >to monitor web site traffic and present a report with all visits to all >websites per user (pc). I've searched the internet but did not find an >appropriate (free) solution. I have been playing with the idea to use >snort, but that seems a lot of work to me. Your boss _is_ aware that what he seems to be asking for is fundamentally impossible, due to caching proxies, dynamic IP addresses, multiuser systems, etc? Dave -- Dave Anderson <[EMAIL PROTECTED]>
Re: Url checker
On 3 Oct 2005, at 14:48, <[EMAIL PROTECTED]> wrote: > be warned: depending on the number of clients on your network, logging > all http traffic is a pretty good way of testing the reliability of > your > disk. If you do eventually get your HTTP traffic running through one host, running EtherPeg on it always tickles me. -- Junkets for bunterish lickspittles since 1998! [EMAIL PROTECTED] http://weblog.vanhegan.net
Re: Url checker
Good point. -Original Message- From: michael hamerski [mailto:[EMAIL PROTECTED] Sent: maandag 3 oktober 2005 15:46 To: Reuvers, Nils Subject: Re: Url checker be warned: depending on the number of clients on your network, logging all http traffic is a pretty good way of testing the reliability of your disk. when I was reluctantly asked to implement this a few years ago on a 100 client network, the aging disk failed within a week. if you want to do this on a long-term basis for more than a few clients, I would consider a dedicated disk. mike = A disclaimer applies to this email and any attachments. Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this disclaimer.
Re: Url checker
Teemu Schaabl([EMAIL PROTECTED])@2005.10.03 13:15:20 +: > [EMAIL PROTECTED]([EMAIL PROTECTED])@2005.10.03 > 11:08:31 +: > > Hi list, > > > > Anyone knows a good URL checker that runs on OpenBSD? My boss wants me > > to monitor web site traffic and present a report with all visits to all > > websites per user (pc). I've searched the internet but did not find an > > appropriate (free) solution. I have been playing with the idea to use > > snort, but that seems a lot of work to me. > > > > Any suggestions are more then welcome. > > > > use squid transparent on your openbsd gateway: > daniel has a working howto: > http://www.benzedrine.cx/transquid.html > > [ ... ] > gezz - got this question wrong, sorry for the noise. -- "Every man takes the limits of his own field of vision for the limits of the world." - Schopenhauer [demime 1.01d removed an attachment of type application/pgp-signature]
Re: Url checker
On 3 Oct 2005, at 12:11, <[EMAIL PROTECTED]> wrote: > I just thought of another solution. Stupid me not thinking of it > earlier. I can log all http traffic with PF and write some perl to > process the logfile. Can't believe I was staring blind on a 3rd party > solution. Perhaps transparent proxying with Squid and PF might give you the information you need? -- Junkets for bunterish lickspittles since 1998! [EMAIL PROTECTED] http://weblog.vanhegan.net
Re: Url checker
[EMAIL PROTECTED]([EMAIL PROTECTED])@2005.10.03 11:08:31 +: > Hi list, > > Anyone knows a good URL checker that runs on OpenBSD? My boss wants me > to monitor web site traffic and present a report with all visits to all > websites per user (pc). I've searched the internet but did not find an > appropriate (free) solution. I have been playing with the idea to use > snort, but that seems a lot of work to me. > > Any suggestions are more then welcome. > use squid transparent on your openbsd gateway: daniel has a working howto: http://www.benzedrine.cx/transquid.html after you got it up and running, analyse the resulting log-files with one of these: http://www.squid-cache.org/Scripts/ maybe you should try out this, sounded good to me, but I never had to implemented it (thank god): http://squidalyser.sourceforge.net hope this helps, teemu -- personal crap: http://teemu.lynix.net [demime 1.01d removed an attachment of type application/pgp-signature]
Re: Url checker
Thanks Jasper, I just thought of another solution. Stupid me not thinking of it earlier. I can log all http traffic with PF and write some perl to process the logfile. Can't believe I was staring blind on a 3rd party solution. Nils -Original Message- From: J. Lievisse Adriaanse [mailto:[EMAIL PROTECTED] Sent: maandag 3 oktober 2005 12:41 To: Reuvers, Nils; misc@openbsd.org Subject: Re: Url checker Maybe you mean something like: http://www.openbsd.org/cgi-bin/cvsweb/ports/www/linkchecker/ ? Cheers, Jasper Op 3/10/2005 schreef "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>: >Hi list, > >Anyone knows a good URL checker that runs on OpenBSD? My boss wants me >to monitor web site traffic and present a report with all visits to all >websites per user (pc). I've searched the internet but did not find an >appropriate (free) solution. I have been playing with the idea to use >snort, but that seems a lot of work to me. > >Any suggestions are more then welcome. > >Nils > >=== >== A disclaimer applies to this email and any >attachments. >Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this disclaimer. > = A disclaimer applies to this email and any attachments. Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this disclaimer.
Re: Url checker
Maybe you mean something like: http://www.openbsd.org/cgi-bin/cvsweb/ports/www/linkchecker/ ? Cheers, Jasper Op 3/10/2005 schreef "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>: >Hi list, > >Anyone knows a good URL checker that runs on OpenBSD? My boss wants me >to monitor web site traffic and present a report with all visits to all >websites per user (pc). I've searched the internet but did not find an >appropriate (free) solution. I have been playing with the idea to use >snort, but that seems a lot of work to me. > >Any suggestions are more then welcome. > >Nils > >= >A disclaimer applies to this email and any attachments. >Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this >disclaimer.
Url checker
Hi list, Anyone knows a good URL checker that runs on OpenBSD? My boss wants me to monitor web site traffic and present a report with all visits to all websites per user (pc). I've searched the internet but did not find an appropriate (free) solution. I have been playing with the idea to use snort, but that seems a lot of work to me. Any suggestions are more then welcome. Nils = A disclaimer applies to this email and any attachments. Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this disclaimer.