Hi Rob,
    Thank you for liking to help me.
My log files are created dynamically, so that my log directory is "/usr/local/share/megamherk/logs" and my file_match will be "DYNAMIC_DIRECTORY_NAME/access.log". I want to output the logs in rabbitmq exchange with exchange_name as "DYNAMIC_DIRECTORY_NAME".
Note : There will be more DYNAMIC_DIRECTORY_NAME created.
Example : If my LogstreamerInput file is "/usr/share/megamherk/logs/TOM/access.log", my AMQPOutput exchange should be "TOM".
Please help me.

On Thursday 26 June 2014 05:18 AM, Rob Miller wrote:
I'd like to help you, but you probably know considerably more about Logstash configuration and how it works than I do. Plus, while there is a great deal of similarity and overlap, Logstash and Heka approach certain things a bit differently, and there isn't a 1:1 correspondence with features.

It would be more useful for me if you could describe what you're hoping to accomplish with the Heka config that you pasted below, and what, exactly, isn't working like you want it to. Given that I can hopefully help you debug.

Thanks!

-r


On 06/25/2014 06:17 AM, Thomas Alrin wrote:
Hi all,
I'm new to heka. Before this i use logstash shipper for logstream.
My logstash shipper conf

input {

   file {
     type => "access-log"
     path => [ "/usr/local/share/megamherk/logs/*/*" ]
   }
}
filter {
   grok {
     type => "access-log"
     match => [ "@source_path", "(//usr/local/share/megamherk/logs/)(?
<source_key>.+)(//*)" ]
   }
}
output {
   stdout { debug => true debug_format => "json"}
   redis {
     key => '%{source_key}'
     type => "access-log"
      data_type => "channel"
      host => "redis.myhost.co"
   }
}

Like the above conf i'd like to do the same in heka. can anyone help me?

My hekad.toml file

[accesslog]
type = "LogstreamerInput"
log_directory = "/usr/local/share/megamherk/logs"
file_match = '(?P<DomainName>[^/]+)/access\.log\.?(?P<Seq>\d*)'

[AMQPOutput]
url = "amqp://guest:guest@localhost/"
exchange = DomainName
exchangeType = "fanout"
message_matcher = 'TRUE'

_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka


--
With Warm Regards,
Thomas Alrin,
Infrastructure Engineer; Megam Systems;
email: [email protected]; cell: +91 9789345999
twitter : @thomasalrin

_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka

Reply via email to