Marcello Romani wrote:
Amos Jeffries ha scritto:
Marcello Romani wrote:
Amos Jeffries ha scritto:
Marcello Romani wrote:
Hallo,
I have been using squid for about 3 years now for normal web
caching and url filtering in our company.
I have written a small perl script to be used as a logfile daemon,
which stores the access log entries in a mysql database.
I'm currently using it in our company and I've also received
requests from a few people that were looking for a mysql access log
solution for squid.
So far the script is working well, but mine is a low traffic
scenario (15 clients), so I'd like to see it tested in more
demanding environments to find out bugs or performance bottlenecks.
Also, some of the views contained in the DDL script accompaining
the daemon were written as an excercise, while some other provided
useful information for my own requirements. The list of views could
be expanded or modified based on other people's requests.
The last line on my TODO list is how to deal with database growth.
Currently there is no consolidation routine, so the database has to
be cleaned by hand.
I have some experience in mysql and postgresql, so I'm planning to
write a version of the script for postgresql also.
Welcome.
I'm working on the port of LogDaemon into 3.2. I look forward to
working with you and it as the first LD helper. MySQL is precisely
one of the tools I'm looking at testing the port with.
Back at the beginning of LogDaemon in 2.7 there was a MySQL helper
as well. I have not heard much since. Presumably is happily working
in places, If that was not you we'd best check up and see about
merging the script concepts rather than adding new one.
I'll have to look closely but I belive what you are mentioning is not
my script.
Turns out it was you on March 2008. I grabbed a copy of your early
script and was playing around with it.
http://www.mail-archive.com/squid-us...@squid-cache.org/msg53342.html
Ouch! You're right.
The fact is, I've also seen a LD helper written in C somewhere...
The only other MySQL stuff I've seen was Arthur Tumanyan's shaga patch
in 2007, which was for integrated MySQL support before LD came along.
Might be interesting to compare the SQL tables etc, but the code is not
relevant to this.
Adrian wrote the initial access.log output into LD form using the
original C from inside Squid.
I'm not aware of any other LD around yet.
If you are intending and able to stick around and support the script
I believe mysql logging is one of the helpers we could find great
use for bundling.
I have developed the perl script in my spare time, so I might not be
as timely as I should, but I'm willing to support and expand it.
I'm not a C or C++ expert, but if you feel that it's better to have a
LD helper written in C or C++ rather than perl, I might also look
into that.
The only issues we have with coding language are that it must be
widely usable/useful, and someone is able to keep up with bug fixes.
Perl passes on both.
Amos
Ok, perfect.
I have registered the project on sourceforge, but I've not yet commited
anything there.
Is it the right way to host the script and its future developements ?
The project is here:
http://sourceforge.net/projects/squid-mysql-log/
Up to you. Thats how the squid_kerb_auth did it.
The binary name if we bundle with Squid will end up being
log_mysql_daemon.pl though.
Amos
--
Please be using
Current Stable Squid 2.7.STABLE6 or 3.0.STABLE13
Current Beta Squid 3.1.0.6