[heka] Heka

Hi All, For the new solutions, I am planning to use Heka to ship the logs from my server to another for analysing. I am using this for the first and heard a lot of positive reviews from many. My intention is to use Heka on a RHEL5 server and ship the logs to RHEL6 server. Is this possible? If yes

[heka] Heka + Solr

Hey, all. Anyone using Solr with Heka? I started off using Elasticsearch, but now that I am probably going to have to stand up Solr for another project, I'm wondering if I should just focus on Solr. I would rather not have to manage both if only one is required. Last time I used Solr was maybe

[heka] heka monitoring

Hi, What is the best way of monitoring the proper working of a heka instance? Let me give a concrete example: I have heka-1 that has log files as input and TCP outputs to another heka instance. The second one would receive the stream from the first one and publishes to elastic search as well as in

[heka] heka-inject

Hi, New user to Heka, I am trying to test a new HttpOutput. On Openstack Kilo and LMA .7 and heka .9 I have tried all sorts of options but get nothing but silence. /usr/bin/heka-inject -payload="event" -type="event" -severity="1" /usr/bin/heka-inject -payload="event" -type="event" -seve

[heka] heka wedged

Hi, I have a nagging question. I read in the documentations and I also experienced it myself that hekad might become "wedged" and there would be no activity within the system while the process seems up from the outside. My question is what are the conditions that this might happen? The reason I as

Re: [heka] Heka

You'll have problem with installing current hekad on centos5, it's too old ( it's not supported for go-lang). For sure you can't use packages provided by upstream. I managed to combine working version of go compiler and hekad, compile it on centos6 and use it on centos5 but I don't have it anymore.

Re: [heka] Heka

t;> Date: Wednesday, 4 May 2016 at 10:04 To: roradhak mailto:rorad...@cisco.com>> Cc: "heka@mozilla.org<mailto:heka@mozilla.org>" mailto:heka@mozilla.org>> Subject: Re: [heka] Heka You'll have problem with installing current hekad on centos5, it's too ol

Re: [heka] Heka

e.com)> Date: Wednesday, 4 May 2016 at 10:04 To: roradhak <[rorad...@cisco.com](mailto:rorad...@cisco.com)> Cc: "[heka@mozilla.org](mailto:heka@mozilla.org)" <[heka@mozilla.org](mailto:heka@mozilla.org)> Subject: Re: [heka] Heka > > > > You'll h

[heka] Heka Config

Hi I am setting up Heka and Logstash in my server. Since I am new to this, I am not sure about the configuration parameter. Both Heka and Logstash are running on 2 different RHEL6 servers. My current configuration is : [astro-cmdc-ReadLogFiles] type = "LogstreamerInput" log_directory = "/mnt/cmdc_

Re: [heka] Heka

Have you solved this issue? Could you please share your solution? ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

[heka] Heka 0.4.2 released

Howdy! Happy to say that a Heka 0.4.2 release was made yesterday afternoon. This is a very minor upgrade. In fact, nothing in the Heka code has changed at all since 0.4.1. We've fixed a few more packaging and documentation bugs, and the binaries were built with the Go 1.2 final release instea

[heka] Heka v0.5.1 released

Hi all, Short heads up to let you know that Heka 0.5.1 has been released. This is an incremental bug fix release, resolving a few issues that have turned up since we got v0.5.0 out the door, details available in the changelog: https://github.com/mozilla-services/heka/blob/v0.5.1/CHANGES.txt

[heka] Heka v0.5.2 released

Hi! I'm here to brighten up your Friday by letting you know that Heka v0.5.2 has been released. This is a bug-fix release only, it contains no breaking changes from v0.5.1, and it doesn't contain any of the new Encoder plugin functionality. Full details about what exactly has been changed is

[heka] Heka v0.6.0 released

Hi, I'm happy to announce that Heka v0.6.0 is officially released and available for download: https://github.com/mozilla-services/heka/releases/tag/v0.6.0 This release introduces a number of significant improvements and fixes, including Encoder plugins, a bunch of new parsing Decoder plugins

[heka] Heka v0.7.1 released

After v0.7.0 was released last week we quickly found and fixed a couple of bugs, resolved an issue with the OSX build, and made some small tweaks and fixes to the docs. Available for your downloading pleasure now: https://github.com/mozilla-services/heka/releases/tag/v0.7.1 Thanks! -r __

[heka] Heka v0.7.2 released

Hi all, Time for another round of everybody's favorite game: Heka bugfix release! Heka v0.7.2 includes fixes to the ElasticSearchOutput, the heka-flood utility, ScribbleDecoder, our idle / orphaned message diagnostic reporting, and multiple config file loading. Binary packages are available a

[heka] heka for centos

Hi all, Now i'm using heka on ubuntu trusty, it works superb. I had built heka deb package from your git repo. In the same way, how can i build package for centos7 from your git? What is the procedure? I had tested hekad binary in centos7, it's not working correctly. When i start hek

[heka] Heka 0.8.1 released

Hi all, Just a quick note to let you know that Heka v0.8.1 is out and ready for public consumption. This is a bugfix release that resolves a handful of issues that have been discovered since the 0.8.0 release. As always, the release packages are available for download here: https://github.co

[heka] Heka v0.8.2 released

Happy New Year! Thanks to a testing oops made by yours truly, the Linux builds of the 0.8.1 release that went out wouldn't work unless libGeoIP.so.1 was installed on the target host. Yesterday I released v0.8.2, which is functionally equivalent to v0.8.1 except for the removal of the GeoIPDec

[heka] Heka ETL scopes

Hello Rob and Heka users - I was exploring Heka (on Ubuntu VM) and had a few questions. i will try to keep them brief. ... 1. Can Heka be used, being used as an ETL tool to load data from various files into DBMS? or is it mainly for log processing and/or stream processing? 2. To me it seems that

[heka] [Heka] Test Sandboxes

I wrote many sandboxes to treat data, and I would ​to do some test ​in order ​ to make sure of the reliability of my sandboxes ​​ . But I didn't find how write test file ​. ​ ​Please help me to find how to make test​ , --- Djamel FELLAH ___ Heka mailin

[heka] Heka 0.9.0 released

Hi all, I'm happy to be able to say that Heka v0.9.0 has been officially released, at last! This is a significant release, containing a considerable number of new features and bug fixes. It also has a handful of significant breaking changes, so upgrading from prior versions will require tweak

[heka] Heka 0.9.1 released

Hi all, Heka 0.9.1 is now available, just in time for your weekend enjoyment. This release resolves a couple of issues that have been discovered since 0.9.0 came out, as well as a couple of new features that were being worked on but didn't quite make it into the first 0.9 release. Binary pac

[heka] Heka Puppet module

Hi all, I just saw Nathan’s post about the Heka Chef cookbook earlier and it reminded me to post a note to the list about the Puppet module I wrote: https://github.com/newrelic/puppet-heka/ Enjoy!___ Heka ma

[heka] Heka Haproxy Decoder

Hi all, just sharing this if can help someone. https://gist.github.com/victorcoder/4b9bea9ade7671fcea75 Comments are welcome -- V ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

[heka] Heka v0.9.2 released

Hi all, Yesterday afternoon I cut the Heka v0.9.2 release. This is a bug-fix release, resolving some of the more pressing issues that have been recently reported, including: - ElasticSearchOutput and TcpOutput recovery from full disk buffers. - ElasticSearchOutput no longer retrying messages

[heka] Heka v0.10.0b1 released

Hi all, I've just built Linux and OSX binaries for the v0.10.0b1 release and uploaded them to the GitHub project page, see: https://github.com/mozilla-services/heka/releases/tag/v0.10.0b1 This release features: * A number of bug fixes to the ProcessInput * Support for a SIGUSR2 signal that w

[heka] Heka v0.10.0b2 released

Hi all, After much delay, I finally managed to quietly slip a Heka v0.10.0b2 release out the door at the end of last week. This release is primarily focused on resolving a large number of bugs that have been reported in the earlier betas, especially related to the disk buffering support that

Re: [heka] heka monitoring

On 2016-01-14 14:59, Ramin Ali Dousti wrote: Hi, What is the best way of monitoring the proper working of a heka instance? Let me give a concrete example: I have heka-1 that has log files as input and TCP outputs to another heka instance. The second one would receive the stream from the first on

Re: [heka] heka monitoring

Yes, not wanting to start up is easy. The process listing will show that and you raise an alarm. My problem is I do not know from " http://hekad.readthedocs.org/en/v0.10.0/monitoring/index.html"; what condition is error or warning. Specially when dealing with influx or elk outputs, when the remote

Re: [heka] heka monitoring

what can be done (what is the correct way) to make sure that heka-1 can send to heka-2 and heka-2 is able to publish to elastic search and influxdb? As always any insight is greatly appreciated. -- Ramin ___ Heka mailing list

Re: [heka] heka-inject

-payload="event" > > root@fail# > > message_matcher = "Fields[payload_type] == 'json' && Fields[payload_name] > == 'event'" > > ___ > Heka mailing list > Heka@mozilla.org > https://mail.mozilla.org/listinfo/heka > > ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] heka monitoring

The answers to questions 2 and 3 are clearly "yes", and between what you already know about Heka and my reply to the first message in this thread you should have some ideas re: how to handle monitoring Heka. That leaves us with question 1: "Should a logline that is too big for your sandbox stop

Re: [heka] heka-inject

t -type="event" /usr/bin/heka-inject -payload="event" root@fail# message_matcher = "Fields[payload_type] == 'json' && Fields[payload_name] == 'event'" ___ Heka mailing lis

Re: [heka] heka monitoring

Hi Rob, Thanks for your answers. On 2 Feb 2016, at 20:32, Rob Miller wrote: > The answers to questions 2 and 3 are clearly "yes", and between what you > already know about Heka and my reply to the first message in this thread you > should have some ideas re: how to handle monitoring Heka. That

Re: [heka] heka monitoring

Thanks for the insight Rob, very helpful. On Tue, Feb 2, 2016 at 2:15 PM, Rob Miller wrote: > The simplest way to monitor heka-1 would probably be to set up a trivial > filter on heka-1 that periodically emits a heartbeat message to be > delivered to heka-2, and to set up a heartbeat filter on h

Re: [heka] heka monitoring

ing, making sure hekad is up, but what can be done (what is the >>> correct way) to make sure that heka-1 can send to heka-2 and heka-2 is >>> able to publish to elastic search and influxdb? >>> >>> As always any insight is greatly appreciated. >>>

Re: [heka] heka wedged

e it log > "important" information about its doing? > > I really appreciate any insight. > > -- > Ramin > > ___ > Heka mailing list > Heka@mozilla.org > https://mail.mozilla.org/listinfo/heka > > ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] heka wedged

Hi Timur, 1) wedged: In my case, my hekad gets wedged for no reason (or I think i cannot pinpoint as to why) 2) logging Yes, I could do a LogOutput (which I'm doing when I'm troubleshooting) but I was looking for some kind of application logging with different severity so that i could up or down

Re: [heka] heka wedged

I really appreciate any insight. -- Ramin ___ Heka mailing list Heka@mozilla.org <mailto:Heka@mozilla.org> https://mail.mozilla.org/listinfo/heka -- Ramin ____

Re: [heka] heka wedged

Hi Rob, thanks for the response/info. Yes, as you might remember I implemented your heartbeat suggestion months ago and am sending heartbeats of a chain of hekad's to influx and am using kapacitor's deadman watch to catch the lack of heartbeat and it's working perfectly fine. The problem I'm tryi

Re: [heka] heka wedged

The defaults of pool size = 100 and chan size = 30 are good for many cases. If you need to increase the pool size, that's fine, but don't make the channel size as large. I'd try reducing my channel size to 50. -r On 3/30/16 4:27 PM, Ramin Ali Dousti wrote: Hi Rob, thanks for the response/info

Re: [heka] heka wedged

On Wed, Mar 30, 2016 at 9:01 PM, Rob Miller wrote: > Heka can get wedged when there's a deadlock in the pipeline, usually related > to pack exhaustion. For example, a filter might block because it's waiting > for an empty pack with which to inject a new message, but there are no packs > available

Re: [heka] heka wedged

On 04/04/2016 05:32 AM, Eric LEMOINE wrote: On Wed, Mar 30, 2016 at 9:01 PM, Rob Miller wrote: > Heka can get wedged when there's a deadlock in the pipeline, usually related > to pack exhaustion. For example, a filter might block because it's waiting > for an empty pack with which to inject a ne

Re: [heka] heka wedged

> Buffering does help, yes. When buffering is in use, the shared pack from the global pool is recycled immediately after the message is written to the disk buffer. Each plugin that uses disk buffering uses its own packs internally that don't intermingle with the global packs at all. That makes sen

[heka] Heka test suite

Hi all, Half a year ago I felt the need to write unit tests for my Lua modules for Heka but didn’t find easy way to do that with standard Heka/LuaSandbox toolchain. For that I’ve created a pure Lua mock for Heka:  https://github.com/timurb/heka_mock That is you can write unit tests with standar

Re: [heka] Heka Config

Phone: *+44 (0)23 8435 7392* Mobile: *+44 (0)7454375411* https://twitter.com/roshKrish *Cisco International Limited* 4 Stoneycroft Rise, Chestnut Avenue Chandlers Ford, Hampshire SO53 3YU United Kingdom Cisco.com <http://www.cisco.com/global/UK/>

Re: [heka] Heka 0.4.2 released

lease does not contain the code reorg changes I wrote about yesterday. That (and all new) development has been happening on the dev branch, to eventually land in 0.5. Cheers, -r ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo

[heka] heka with intermittent connection

Hi, We are currently evaluating Heka which sounds promising for handling our logs and metrics gathering and routing. If possible, we also target to use Heka on low power sensors servers which produces various metrics but have intermittent internet connection. These low power devices typically run

Re: [heka] Heka v0.6.0 released

n irc.mozilla.org. > > Try it out and let us know about any problems you hit. Thanks for playing! > > -r > ___ > Heka mailing list > Heka@mozilla.org > https://mail.mozilla.org/listinfo/heka > ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

[heka] heka statsd [multicore] performance

Hi, with https://github.com/vimeo/statsdaemon, our statsd replacement in go (1.3) we are processing between 40~70k messages a second (10k timers/s, 500 gauges/s and the rest is counters), and: * cpu (Xeon E5-2697 v2 @ 2.70GHz) is typically 70~90% used with the occasional 100% (increasing GOMAXPR

Re: [heka] heka for centos

W dni pon 17 lis, 2014 o 12∶17 użytkownik Thomas Alrin napisał: Hi all, Now i'm using heka on ubuntu trusty, it works superb. I had built heka deb package from your git repo. In the same way, how can i build package for centos7 from your git? What is the procedure? I had tested h

[heka] heka with old data

Hello dear mozilla team, I have a question about heka. Since it is possible to handle with live data I tried out to work with data that is a bit older. Unfortunately this didn't work. Is it even possible to handle with older data in heka?   greetz Ibrahim

[heka] Heka working directory variable

Does anybody know if there is working directory variable available which can be used inside a configuration file. For example, I would like to be able to use a lua script that is relative to my configuration file. hekad -config hekad.toml [json_decoder] type = "SandboxDecoder" script_type = "

Re: [heka] Heka ETL scopes

3. I was comparing it as an alternative to the Mesos / Kafka / Aurora  architecture - which seems much heavier than what Heka accomplishes much  simpler. But again in going through the tutorials on your site I am not  able to configure for DBMS from the flat files I am loading.  We use both Heka

Re: [heka] Heka ETL scopes

I mostly agree with Jonathan's post. I agree completely with his descriptions of Heka and Kafka, and how they differ. I wouldn't write Heka off as a choice for ETL, though. It can be nice when your ETL tool provides the option for doing crunching, graphing, and alerting on the gathered data whi

Re: [heka] Heka ETL scopes

Thank you for your responses Jonathan and Rob. Appreciate the clarifications. I am not really trying to do ETL but mainly collating and loading. I will play around with Heka and will get back in touch to see how I can contribute - in travels so trying things out in between. I would like to use H

Re: [heka] [Heka] Test Sandboxes

_ > Heka mailing list > Heka@mozilla.org > https://mail.mozilla.org/listinfo/heka > > ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] Heka 0.9.0 released

ES.txt) for the > complete list of what we've been up to. Check the release page ( > https://github.com/mozilla-services/heka/releases/tag/v0.9.0) for the > available binary packages. Test carefully before deploying, and report any > issues or bugs that you discover in the issue

Re: [heka] Heka 0.9.0 released

rce.com/#/c/5711/), we'll be testing that >> soon to see if it helps. Fingers crossed! >> >> Okay, I've blathered on long enough. Check the changelog ( >> https://github.com/mozilla-services/heka/blob/v0.9.0/CHANGES.txt) for >> the complete list of what we've been up to. Check the release page ( >> https://github.com/mozilla-services/heka/releases/tag/v0.9.0) for the >> available binary packages. Test carefully before deploying, and report any >> issues or bugs that you discover in the issue tracker ( >> https://github.com/mozilla-services/heka/issues). >> >> And, most importantly, thanks for using Heka, and have a great day. >> >> Cheers! >> >> -r >> ___ >> Heka mailing list >> Heka@mozilla.org >> https://mail.mozilla.org/listinfo/heka >> > > ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] Heka 0.9.0 released

issues or bugs that you discover in the issue tracker (https://github.com/mozilla-__services/heka/issues <https://github.com/mozilla-services/heka/issues>). And, most importantly, thanks for using Heka, and have a great day. Cheers! -r __

Re: [heka] Heka 0.9.0 released

at *may* resolve this issue >> (https://go-review.__googlesource.com/#/c/5711/ >> <https://go-review.googlesource.com/#/c/5711/>), we'll be >> testing that soon to see if it helps. Fingers crossed! >> >&

Re: [heka] Heka 0.9.1 released

on the mailing > list or in the #heka channel on irc.mozilla.org. > > Thanks! > > -r > ___ > Heka mailing list > Heka@mozilla.org > https://mail.mozilla.org/listinfo/heka ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] Heka 0.9.1 released

, please share comments and/or ask questions here on the mailing > list or in the #heka channel on irc.mozilla.org. > > Thanks! > > -r > ___ > Heka mailing list > Heka@mozilla.org > https://mail.mozilla.org/listinfo/heka ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] Heka 0.9.1 released

t recent Heka builds >> > will >> > run on Windows if you're not using any Sandbox* plugins, so if that will >> > suffice for your needs, and you're brave enough to build it from source >> > and >> > try it out, then you might give it a go and let

Re: [heka] Heka Puppet module

ed me to post a note to the list about the Puppet module I wrote: > > https://github.com/newrelic/puppet-heka/ > > Enjoy! > > ___ > Heka mailing list > Heka@mozilla.org > https://mail.mozilla.org/listinfo/heka > > _

Re: [heka] Heka Puppet module

Worth saying that we've also created our own module. I believe the motivation was because one didn't exist at the time. Link: https://github.com/alphagov/puppet-heka On Tuesday, 31 March 2015, Nicholas Chappell wrote: > Hi all, > > I just saw Nathan’s post about the Heka Chef cookbook earlier a

Re: [heka] Heka Puppet module

On 03/30/2015 10:56 PM, Nathan Williams wrote: we're in portland as well, maybe we should propose a heka talk for a pdx devops meetup with some demos? It's probably worth mentioning that I'll be in Portland in June for Monitorama (June 15-17), will be giving a 45 minute workshop on Heka on th

Re: [heka] Heka Puppet module

good deal, i'll be at monitorama as well, look forward to catching the workshop and saying hi! On Tue, Mar 31, 2015 at 1:37 PM, Rob Miller wrote: > On 03/30/2015 10:56 PM, Nathan Williams wrote: > >> we're in portland as well, maybe we should propose a heka talk for a pdx >> devops meetup with s

[heka] Heka forward partial messages

​Hi all, I'm trying to setup two hekad instances, one instance forward syslog messages to the other using tcp input/output. The sender instance config is as follows: [dashboard_output] type = 'DashboardOutput' address = '0.0.0.0:4352' ticker_interval = 10 [tcp_output] message_matcher = 'Type ==

Re: [heka] Heka Prometheus Plugin

Hey there, thanks for reaching out. I could use some help from someone with more Prometheus experience. I hope you don't mind I've included the Heka list since I think we might find some good help there too. I'll start by explaining what caused me to set out on this plugin. I want Prometheus to be

Re: [heka] Heka Prometheus Plugin

Hi David, sorry for not responding earlier, have been quite busy recently. On Tue, Jun 2, 2015 at 9:35 PM, David Birdsong wrote: > > I'll start by explaining what caused me to set out on this plugin. I want > Prometheus to be able to scrape a growing list of prescribed Influxdb > queries. The o

[heka] Heka v0.10.0 final released

Hi all, Finally have a Heka v0.10.0 release out the door, just before the new year is upon us: https://github.com/mozilla-services/heka/releases/tag/v0.10.0 Hope everyone has a safe, happy, and fulfilling 2016! -r ___ Heka mailing list Heka@mozilla

[heka] Heka master compilation error

Dear Hekas, I'm writing a Heka plugin for our project. After clone Heka master and follow the installation instruction to build it, I got the following compilation error when import "github.com/mozilla-services/heka/pipeline" in myplugin.go file. # github.com/mozilla-services/heka/message ../../

Re: [heka] heka with intermittent connection

, Trink - Original Message - > From: "bruno binet" > To: heka@mozilla.org > Sent: Tuesday, March 25, 2014 3:41:30 AM > Subject: [heka] heka with intermittent connection > Hi, > We are currently evaluating Heka which sounds promising for handling our logs

[heka] Heka v0.8.0 and v0.7.3 released

Hi all, Happy to announce a double dose of Heka release goodness, available for immediate consumption. First v0.7.3, the final (barring discovery of any huge security holes) release in the 0.7 series, a bug fix release that resolves some problems that were reported since 0.7.2, including a c

Re: [heka] heka statsd [multicore] performance

Getting caught up on backlog sorry for the delay. On 10/18/2014 01:06 PM, Dieter Plaetinck wrote: So I plan to do some experimenting with heka, but meanwhile I'ld like to hear from you. 1) does anyone have some empirical numbers on heka-as-statsd performance? in particular, when does it

Re: [heka] heka statsd [multicore] performance

On Tue, 04 Nov 2014 11:22:00 -0800 Rob Miller wrote: > Getting caught up on backlog sorry for the delay. > > On 10/18/2014 01:06 PM, Dieter Plaetinck wrote: > > > > So I plan to do some experimenting with heka, but meanwhile I'ld like to > > hear from you. > > > > 1) does anyone have some e

Re: [heka] heka statsd [multicore] performance

On 4 November 2014 19:22, Rob Miller wrote: > On 10/18/2014 01:06 PM, Dieter Plaetinck wrote: >> >> 3) does heka leverage multi-core properly for the statsd workload >> (receiving the packets, and doing the aggregations)? >> > Not sure what you mean by "properly", but it is true that the StatsdIn

Re: [heka] heka statsd [multicore] performance

the net library than try to distribute the work and potentially have to drag a SK_buf across NUMA nodes. > > > > Sorry to not be much help, > > thanks either way! > > ___ > Heka mailing list >

Re: [heka] heka statsd [multicore] performance

On Thu, 6 Nov 2014 09:30:48 -0500 Tom Cameron wrote: > But, I suspect the > cost of disassembling packets is higher than the math you're going to do. > This is made more true by the fact that you need shared (locked) structures > for your counts. i was thinking of having N workers, where every w

Re: [heka] heka statsd [multicore] performance

> > i was thinking of having N workers, where every worker is responsible for > a certain subset of the key space. > e.g. using consistent hashing, the processing for all metric lines > relating to an individual key requires no outside data. > But at the same time, I think you're right that reading

Re: [heka] heka statsd [multicore] performance

On Thu, 6 Nov 2014 12:01:11 -0500 Tom Cameron wrote: > I suppose you could hash on the source address note that we would have to make sure that given keys are always processed together, i.e. if doing this, multiple sources can't send packets with the same key (typically people encode hostname

Re: [heka] heka statsd [multicore] performance

On 11/07/2014 09:51 AM, Dieter Plaetinck wrote: anyway, i just did some crude testing. on an intel xeon E5-2690 @ 2.90GHz heka consumes 70~80% cpu typically, when i send around 75k timers/s and 40k counters/s and once in a while it'll drop some packets from the udp buffer. (like 10k every minut

Re: [heka] heka statsd [multicore] performance

On Fri, 07 Nov 2014 09:56:47 -0800 Rob Miller wrote: > On 11/07/2014 09:51 AM, Dieter Plaetinck wrote: > > anyway, i just did some crude testing. > > on an intel xeon E5-2690 @ 2.90GHz heka consumes 70~80% cpu typically, when > > i send around 75k timers/s and 40k counters/s and once in a while

Re: [heka] heka statsd [multicore] performance

On 11/07/2014 12:38 PM, Dieter Plaetinck wrote: On Fri, 07 Nov 2014 09:56:47 -0800 Rob Miller wrote: > On 11/07/2014 09:51 AM, Dieter Plaetinck wrote: >> anyway, i just did some crude testing. >> on an intel xeon E5-2690 @ 2.90GHz heka consumes 70~80% cpu typically, when i send around 75k time

Re: [heka] heka with old data

mail.mozilla.org/listinfo/heka ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] heka with old data

Depending on where your data is stored, you could always re-write it to a log file and get heka to use the timestamps in the data. Set heka's FilePollingInput to watch the new log. For example, I've used this method

Re: [heka] Heka working directory variable

ratefully appreciated? Thanks Alex ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

[heka] Heka Release including Kafka Output

Hi All, Does anybody know when a new release of heka including Kafka will be out? Best, Adriano ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] Heka forward partial messages

ot; type:string value:"CRON" > > While on the receiver side, I get: > > 2015/04/28 12:53:05 > :Timestamp: 2015-04-28 12:51:01 + UTC > :Type: > :Hostname: > :Pid: 0 > :Uuid: 8d6f9424-7866-438b-a8b8-a646d41a2b2e > :Logger: > :Payload: (root) CMD (/usr/lo

[heka] Heka v0.10.0 beta 0 released

Hi! I'm happy to announce the first beta release for Heka 0.10: https://github.com/mozilla-services/heka/releases/tag/v0.10.0b0 This is a big one, featuring a complete overhaul of the filter and output plugin APIs. The changes not only greatly simplify most plugin implementations, but also ma

Re: [heka] Heka master compilation error

efined: tree It blocks my work. Your timely help is greatly appreciated. Thanks, Emily ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

Re: [heka] Heka master compilation error

services/heka/pipeline>" in myplugin.go file. >> >> # github.com/mozilla-services/heka/message >> <http://github.com/mozilla-services/heka/message> >> >> ../../../mozilla-services/heka/message/message_matcher.go:21: undefined: >> tree >> >&

Re: [heka] Heka master compilation error

//github.com/mozilla-services/heka/message> ../../../mozilla-services/heka/message/message_matcher.go:21: undefined: tree It blocks my work. Your timely help is greatly appreciated. Thanks, Emily __

Re: [heka] Heka master compilation error

ilation error when import "github.com/mozilla-services/heka/pipeline >>> <http://github.com/mozilla-services/heka/pipeline>" in myplugin.go file. >>> >>> # github.com/mozilla-services/heka/message >>> <http://githu

Re: [heka] Heka master compilation error

services/heka/pipeline>" in >> myplugin.go file. >> >> # github.com/mozilla-services/heka/message >> <http://github.com/mozilla-services/heka/message> >> <http://github.com/mozilla-services/heka/message> >> >> ../../../mozilla-services/heka/message/message_matcher.go:21: >> undefined: >> tree >> >> It blocks my work. Your timely help is greatly appreciated. >> >> Thanks, >> >> Emily >> >> >> >> ___ >> Heka mailing list >> Heka@mozilla.org <mailto:Heka@mozilla.org> >> https://mail.mozilla.org/listinfo/heka >> >> >> >> ___ Heka mailing list Heka@mozilla.org https://mail.mozilla.org/listinfo/heka

[heka] Heka consumes CPU doing nothing

Hi This is to report what may be an issue in Heka, where Heka consumes CPU while there's nothing to do. My test-case is the following: LogStreamer with an rsyslog.lua decoder reading logs from a number of static log files. After having processed all the logs (from all the files) Heka still consum

[heka] heka and elasticsearch bulk upload

Hi, I have an ES output that bulk uploads to a cluster. The HTTP status code is 200 OK but the reply payload says that it failed the upload for a few of the items. But heka doesn't seem to care about the failed items. I looked at the code and it says: https://github.com/mozilla-services/heka/blob

[heka] Heka as a Sensu-Client Replacement.

Hello, Folks, We were planning on deploying collectd, statsd, logstash, and sensu-client on our client servers/VMs. I mentioned that Heka can easily replace statsd and logstash (and several parts of collectd). And I'm fairly certain Heka can replace standalone checks using ProcessInput. Can Heka

  1   2   >