Re: Chukwa - Lightweight agents

2011-03-20 Thread Bill Graham
Yes, we run light weight Chukwa agents and collectors only, using Chukwa just as you describe. We've been doing so for over a year or so without many issues. The code is fairly easy to extend when needed. We rolled our own collector, agent and demux RPMs. The monitoring peice of chukwa is optional

Re: Chukwa - Lightweight agents

2011-03-20 Thread Ted Dunning
Bummer. On Sun, Mar 20, 2011 at 10:12 AM, Mark wrote: > We tried flume however there are some pretty strange bugs occurring which > prevent us from using it. > > > http://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/66c6aecec9d1869b > > > On 3/20/11 10:03 AM, Ted Dunni

Re: Chukwa - Lightweight agents

2011-03-20 Thread Mark
We tried flume however there are some pretty strange bugs occurring which prevent us from using it. http://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/66c6aecec9d1869b On 3/20/11 10:03 AM, Ted Dunning wrote: OpenTSDB is purely a monitoring solution which is the primar

Re: Chukwa - Lightweight agents

2011-03-20 Thread Ted Dunning
OpenTSDB is purely a monitoring solution which is the primary mission of chukwa. If you are looking for data import, what about Flume? On Sun, Mar 20, 2011 at 9:59 AM, Mark wrote: > Thanks but we need Chukwa to aggregate and store files from across our app > servers into Hadoop. Doesn't really

Re: Chukwa - Lightweight agents

2011-03-20 Thread Mark
Thanks but we need Chukwa to aggregate and store files from across our app servers into Hadoop. Doesn't really look like opentsdb is meant for that. I could be wrong though? On 3/20/11 9:49 AM, Ted Dunning wrote: Take a look at openTsDb at http://opentsdb.net/ It provides lots of the capabili

Re: Chukwa - Lightweight agents

2011-03-20 Thread Ted Dunning
Take a look at openTsDb at http://opentsdb.net/ It provides lots of the capability in a MUCH simpler package. On Sun, Mar 20, 2011 at 8:43 AM, Mark wrote: > Sorry but it doesn't look like Chukwa mailing list exists anymore? > > Is there an easy way to set up lightweight agents on cluster of mac

Chukwa - Lightweight agents

2011-03-20 Thread Mark
Sorry but it doesn't look like Chukwa mailing list exists anymore? Is there an easy way to set up lightweight agents on cluster of machines instead of downloading the full Chukwa source (+50mb)? Has anyone build separate RPM's for the agents/collectors? Thanks