Re: [EMAIL PROTECTED] Managing large-scale apache logs and data mining...

2006-07-06 Thread Roel van Meer
Forrest Aldrich writes: Are there any resources out there that discuss how to manage these scenarios effectively. I'd be interested in hearing from anyone that presently does this. We are writing everyting in a single log file, and use a custom written perl script that splits it into a sing

[EMAIL PROTECTED] Managing large-scale apache logs and data mining...

2006-07-06 Thread Forrest Aldrich
I've a configuration that can potentially generate thousands of *_log entries. That's a lot of disk space, for one, but also presents a challenge as to how to manage that data effectively for use in data mining (ie: tracking site usage and other statistics). It's reasonable to use envariable