Re: Is Apache rotatelogs efficienct for real world use?
Olivier Nicole wrote: Is Apache rotatelogs suitable for handling large volumes of access logs, i.e. around 50K requests per hour at _peak_ time which is 1.2M requests per day. According to Apache website (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes about 120MB in size per day. In another setting (few hits, buts hundreds of sites, rotatelogs means one process per site, while newsyslog is only one process when it is needed. The last log to rotate sending the appropriate signale to Apache. That's a fine point to mention. However, if you're running a bunch of domains using virtual hosts on one Apache instance, then you can just combine them into a single output logfile, have just one rotatelogs instance, feed that through rDNS lookups, and then feed them into a splitter per site or just use a webanalyser which is vhosts-aware and generates separate reports for each vhost -- -Chuck ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Is Apache rotatelogs efficienct for real world use?
Hi all, Is Apache rotatelogs suitable for handling large volumes of access logs, i.e. around 50K requests per hour at _peak_ time which is 1.2M requests per day. According to Apache website (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes about 120MB in size per day. Does somebody have similar experience with rotatelogs? Would you direct me to the proper tool in case it's not efficient enough ? TIA, Bahman ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Is Apache rotatelogs efficienct for real world use?
On Oct 1, 2007, at 2:43 PMOct 1, 2007, Bahman M. wrote: Hi all, Is Apache rotatelogs suitable for handling large volumes of access logs, i.e. around 50K requests per hour at _peak_ time which is 1.2M requests per day. According to Apache website (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes about 120MB in size per day. Does somebody have similar experience with rotatelogs? Would you direct me to the proper tool in case it's not efficient enough ? TIA, Bahman I would recommend letting syslog handle the rotation. While we don't have that many hits, it's always worked well. HTH - Eric F Crist Secure Computing Networks ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Is Apache rotatelogs efficienct for real world use?
Hi all, Is Apache rotatelogs suitable for handling large volumes of access logs, i.e. around 50K requests per hour at _peak_ time which is 1.2M requests per day. According to Apache website (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes about 120MB in size per day. Does somebody have similar experience with rotatelogs? Would you direct me to the proper tool in case it's not efficient enough ? TIA, Bahman We've used /usr/ports/sysutils/cronolog pretty much since the author first wrote it. Something to consider. Tuc/TBOH ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Is Apache rotatelogs efficienct for real world use?
On Oct 1, 2007, at 3:43 PM, Bahman M. wrote: Is Apache rotatelogs suitable for handling large volumes of access logs, i.e. around 50K requests per hour at _peak_ time which is 1.2M requests per day. According to Apache website (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes about 120MB in size per day. Does somebody have similar experience with rotatelogs? Absolutely-- rotatelogs did just fine with one of the sites I used to admin which was getting between 1 and 2.5 million hits a day, depending on the day of the week it was. Storing the logfiles and doing analysis on them afterwards started getting pretty challenging, however: even doing reverse DNS lookups took a fair amount of work, and once you started piling up a year or so's worth, doing things like analog or webalyzer or Unison started taking close to 24-hours to finish running and produce a report. -- -Chuck ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Is Apache rotatelogs efficienct for real world use?
On 2007-10-01 Eric Crist wrote: On Oct 1, 2007, at 2:43 PMOct 1, 2007, Bahman M. wrote: Hi all, Is Apache rotatelogs suitable for handling large volumes of access logs, i.e. around 50K requests per hour at _peak_ time which is 1.2M requests per day. According to Apache website (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes about 120MB in size per day. Does somebody have similar experience with rotatelogs? Would you direct me to the proper tool in case it's not efficient enough ? TIA, Bahman I would recommend letting syslog handle the rotation. While we don't have that many hits, it's always worked well. Absolutely agree however I'm looking for a non-native solution to logging as the configuration will be migrated to a Windoze 2003 server in the end -just testing on FreeBSD. Sorry, should have already stated this at the start of thread. Thanks, Bahman ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
Re: Is Apache rotatelogs efficienct for real world use?
Is Apache rotatelogs suitable for handling large volumes of access logs, i.e. around 50K requests per hour at _peak_ time which is 1.2M requests per day. According to Apache website (http://httpd.apache.org/docs/1.3/logs.html#rotation) this becomes about 120MB in size per day. In another setting (few hits, buts hundreds of sites, rotatelogs means one process per site, while newsyslog is only one process when it is needed. The last log to rotate sending the appropriate signale to Apache. Olivier ___ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to [EMAIL PROTECTED]
