[heka] Throttling email alerts

2014-11-19 Thread Klaus Post
Hi! I have been looking all through the documentation and source code to see if I could find a way to throttle email sending. I have a simple setup, where I have a simple matcher for severity <= 3 like this: [RstEncoder] [ErrorAlert] type = "SmtpOutput" message_matcher = "Severity <= 3" send_fr

Re: [heka] Throttling email alerts

2014-11-19 Thread Michael Trinkala
We usually throttle them at the source like https://github.com/mozilla-services/heka/blob/dev/sandbox/lua/filters/http_status.lua#L85 but there is nothing to prevent you from adding global throttling or aggregation in the alert encoder (by host, plugin, application... whatever) Trink -

Re: [heka] Throttling email alerts

2014-11-19 Thread Rob Miller
To elaborate just a bit on what Trink said, we expose an `alert` module to our Lua sandbox, meant to be used in SandboxFilter code. It supports immediate sending of an individual alert message as well as queueing alerts to be sent out in a batch, and both sending mechanisms include throttling s

Re: [heka] TLS with ElasticSearchOutput?

2014-11-19 Thread Rob Miller
Oops, missed this one, sorry. I'm afraid support for detailed TLS settings has not yet been added to the ElasticSearchOutput. We're not using it internally at Mozilla, and AFAIK you're the first to have mentioned it. It would not be hard to add, it just needs to be done. Please feel free to op