Hello, Following my mail about log format a couple of days ago (thank you for answers) , we have released a plugin for Apache Flume ( https://cwiki.apache.org/FLUME/ ) a former Cloudera project ( https://ccp.cloudera.com/display/CDHDOC/Flume+Installation ).
Here it is : https://github.com/figarocms/flume-haproxy-extractor jar archives could be found on https://oss.sonatype.org/ (searching for "geoip" for example) you need also org.kohsuke.geoip too. The aim of this plugin is to extend the Flume event generated by the syslog of haproxy with new attributes for each fields of the haproxy HTTP log. Those fields could be used after in sink (hbase rowid or collumn) elasticsearch document whatever. Feel free to review it and comment. Cheers, -- Damien
