Re: AWStats and HAProxy Logs
You can fix that in sources anytime, last but not least, don't forget about the maxlength of syslog message On 15.09.2010 20:36, Graeme Donaldson wrote: On 15 September 2010 18:25, Willy Tarreau mailto:w...@1wt.eu>> wrote: On Wed, Sep 15, 2010 at 05:56:39PM +0200, Graeme Donaldson wrote: > As of 1.4, HAproxy does have the "option httplog clf" option, which > generates logs in "common log format", which AWstats understands just fine. > In our case however, we have used "combined log format" in the past, which > gives us the HTTP User-Agent and Referer headers, which enables some useful > stats in AWstats. Switching to common log format would reduce the amount of > information we get from our AWstats. You can still enable header captures though (check "capture request header"). Regards, Willy Nice, I wasn't aware of that. I'd add a caveat though according to the doc, header capture is limited to 64 bytes. Its usefulness would therefore be severely limited for headers like User-Agent or even Referer, which can easily exceed 64 bytes. Graeme.
Re: AWStats and HAProxy Logs
On 15 September 2010 18:25, Willy Tarreau wrote: > On Wed, Sep 15, 2010 at 05:56:39PM +0200, Graeme Donaldson wrote: > > As of 1.4, HAproxy does have the "option httplog clf" option, which > > generates logs in "common log format", which AWstats understands just > fine. > > In our case however, we have used "combined log format" in the past, > which > > gives us the HTTP User-Agent and Referer headers, which enables some > useful > > stats in AWstats. Switching to common log format would reduce the amount > of > > information we get from our AWstats. > > You can still enable header captures though (check "capture request > header"). > > Regards, > Willy > > Nice, I wasn't aware of that. I'd add a caveat though according to the doc, header capture is limited to 64 bytes. Its usefulness would therefore be severely limited for headers like User-Agent or even Referer, which can easily exceed 64 bytes. Graeme.
Re: AWStats and HAProxy Logs
On Wed, Sep 15, 2010 at 05:56:39PM +0200, Graeme Donaldson wrote: > As of 1.4, HAproxy does have the "option httplog clf" option, which > generates logs in "common log format", which AWstats understands just fine. > In our case however, we have used "combined log format" in the past, which > gives us the HTTP User-Agent and Referer headers, which enables some useful > stats in AWstats. Switching to common log format would reduce the amount of > information we get from our AWstats. You can still enable header captures though (check "capture request header"). Regards, Willy
Re: AWStats and HAProxy Logs
Hi Kyle Unfortunately I think you're out of luck for the moment. We had the same problem, we ended up leaving the logging on the backend/Apache level and put a process in place that periodically ships the logs off to a central server, which runs awstats for all the sites we want stats for. As of 1.4, HAproxy does have the "option httplog clf" option, which generates logs in "common log format", which AWstats understands just fine. In our case however, we have used "combined log format" in the past, which gives us the HTTP User-Agent and Referer headers, which enables some useful stats in AWstats. Switching to common log format would reduce the amount of information we get from our AWstats. Graeme. On 15 September 2010 17:08, Kyle Brandt wrote: > Hi All, > > I am trying to come up with a way that I might combine AWStats ( or a > similar system ) with HAProxy logging. Looking at the AWStats custom log > options it doesn't seem like HAProxy httplog will fit and I don't see any > custom options for HAProxy logging (Perhaps I am missing that?). > > Has anyone ever plugged HAProxy logs into any analysis software before that > they might recommend? > > Thank you, > Kyle Brandt >
Re: AWStats and HAProxy Logs
Hi Kyle, option httplog clf Hervé. On Wed, 15 Sep 2010 11:08:43 -0400 Kyle Brandt wrote: > Hi All, > > I am trying to come up with a way that I might combine AWStats ( or a > similar system ) with HAProxy logging. Looking at the AWStats custom > log options it doesn't seem like HAProxy httplog will fit and I don't > see any custom options for HAProxy logging (Perhaps I am missing > that?). > > Has anyone ever plugged HAProxy logs into any analysis software > before that they might recommend? > > Thank you, > Kyle Brandt -- Hervé COMMOWICK, EXOSEC (http://www.exosec.fr/) ZAC des Metz - 3 Rue du petit robinson - 78350 JOUY EN JOSAS Tel: +33 1 30 67 60 65 - Fax: +33 1 75 43 40 70 mailto:hcommow...@exosec.fr
AWStats and HAProxy Logs
Hi All, I am trying to come up with a way that I might combine AWStats ( or a similar system ) with HAProxy logging. Looking at the AWStats custom log options it doesn't seem like HAProxy httplog will fit and I don't see any custom options for HAProxy logging (Perhaps I am missing that?). Has anyone ever plugged HAProxy logs into any analysis software before that they might recommend? Thank you, Kyle Brandt
