Chukwa - Lightweight agents

[Mark]

Sorry but it doesn't look like Chukwa mailing list exists anymore?

Is there an easy way to set up lightweight agents on cluster of machines 
instead of downloading the full Chukwa source (+50mb)?


Has anyone build separate RPM's for the agents/collectors?

Thanks

Re: Chukwa - Lightweight agents

[Ted Dunning]

Take a look at openTsDb at http://opentsdb.net/

It provides lots of the capability in a MUCH simpler package.

On Sun, Mar 20, 2011 at 8:43 AM, Mark  wrote:

> Sorry but it doesn't look like Chukwa mailing list exists anymore?
>
> Is there an easy way to set up lightweight agents on cluster of machines
> instead of downloading the full Chukwa source (+50mb)?
>
> Has anyone build separate RPM's for the agents/collectors?
>
> Thanks
>

Re: Chukwa - Lightweight agents

[Mark]

Thanks but we need Chukwa to aggregate and store files from across our 
app servers into Hadoop. Doesn't really look like opentsdb is meant for 
that. I could be wrong though?


On 3/20/11 9:49 AM, Ted Dunning wrote:

Take a look at openTsDb at http://opentsdb.net/

It provides lots of the capability in a MUCH simpler package.

On Sun, Mar 20, 2011 at 8:43 AM, Mark > wrote:


Sorry but it doesn't look like Chukwa mailing list exists anymore?

Is there an easy way to set up lightweight agents on cluster of
machines instead of downloading the full Chukwa source (+50mb)?

Has anyone build separate RPM's for the agents/collectors?

Thanks

Re: Chukwa - Lightweight agents

[Ted Dunning]

OpenTSDB is purely a monitoring solution which is the primary mission of
chukwa.

If you are looking for data import, what about Flume?

On Sun, Mar 20, 2011 at 9:59 AM, Mark  wrote:

>  Thanks but we need Chukwa to aggregate and store files from across our app
> servers into Hadoop. Doesn't really look like opentsdb is meant for that. I
> could be wrong though?
>
>
> On 3/20/11 9:49 AM, Ted Dunning wrote:
>
> Take a look at openTsDb at http://opentsdb.net/
>
>  It provides lots of the capability in a MUCH simpler package.
>
> On Sun, Mar 20, 2011 at 8:43 AM, Mark  wrote:
>
>> Sorry but it doesn't look like Chukwa mailing list exists anymore?
>>
>> Is there an easy way to set up lightweight agents on cluster of machines
>> instead of downloading the full Chukwa source (+50mb)?
>>
>> Has anyone build separate RPM's for the agents/collectors?
>>
>> Thanks
>>
>
>

Re: Chukwa - Lightweight agents

[Mark]

We tried flume however there are some pretty strange bugs occurring 
which prevent us from using it.


http://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/66c6aecec9d1869b

On 3/20/11 10:03 AM, Ted Dunning wrote:
OpenTSDB is purely a monitoring solution which is the primary mission 
of chukwa.


If you are looking for data import, what about Flume?

On Sun, Mar 20, 2011 at 9:59 AM, Mark > wrote:


Thanks but we need Chukwa to aggregate and store files from across
our app servers into Hadoop. Doesn't really look like opentsdb is
meant for that. I could be wrong though?


On 3/20/11 9:49 AM, Ted Dunning wrote:

Take a look at openTsDb at http://opentsdb.net/

It provides lots of the capability in a MUCH simpler package.

On Sun, Mar 20, 2011 at 8:43 AM, Mark mailto:static.void@gmail.com>> wrote:

Sorry but it doesn't look like Chukwa mailing list exists
anymore?

Is there an easy way to set up lightweight agents on cluster
of machines instead of downloading the full Chukwa source
(+50mb)?

Has anyone build separate RPM's for the agents/collectors?

Thanks

Re: Chukwa - Lightweight agents

[Ted Dunning]

Bummer.

On Sun, Mar 20, 2011 at 10:12 AM, Mark  wrote:

>  We tried flume however there are some pretty strange bugs occurring which
> prevent us from using it.
>
>
> http://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/66c6aecec9d1869b
>
>
> On 3/20/11 10:03 AM, Ted Dunning wrote:
>
> OpenTSDB is purely a monitoring solution which is the primary mission of
> chukwa.
>
>  If you are looking for data import, what about Flume?
>
> On Sun, Mar 20, 2011 at 9:59 AM, Mark  wrote:
>
>>  Thanks but we need Chukwa to aggregate and store files from across our
>> app servers into Hadoop. Doesn't really look like opentsdb is meant for
>> that. I could be wrong though?
>>
>>
>> On 3/20/11 9:49 AM, Ted Dunning wrote:
>>
>> Take a look at openTsDb at http://opentsdb.net/
>>
>>  It provides lots of the capability in a MUCH simpler package.
>>
>> On Sun, Mar 20, 2011 at 8:43 AM, Mark  wrote:
>>
>>> Sorry but it doesn't look like Chukwa mailing list exists anymore?
>>>
>>> Is there an easy way to set up lightweight agents on cluster of machines
>>> instead of downloading the full Chukwa source (+50mb)?
>>>
>>> Has anyone build separate RPM's for the agents/collectors?
>>>
>>> Thanks
>>>
>>
>>
>

Re: Chukwa - Lightweight agents

[Bill Graham]

Yes, we run light weight Chukwa agents and collectors only, using
Chukwa just as you describe. We've been doing so for over a year or so
without many issues. The code is fairly easy to extend when needed. We
rolled our own collector, agent and demux RPMs.

The monitoring peice of chukwa is optional and we don't use that part.


On Sun, Mar 20, 2011 at 6:47 PM, Ted Dunning  wrote:
> Bummer.
>
> On Sun, Mar 20, 2011 at 10:12 AM, Mark  wrote:
>
>>  We tried flume however there are some pretty strange bugs occurring which
>> prevent us from using it.
>>
>>
>> http://groups.google.com/a/cloudera.org/group/flume-user/browse_thread/thread/66c6aecec9d1869b
>>
>>
>> On 3/20/11 10:03 AM, Ted Dunning wrote:
>>
>> OpenTSDB is purely a monitoring solution which is the primary mission of
>> chukwa.
>>
>>  If you are looking for data import, what about Flume?
>>
>> On Sun, Mar 20, 2011 at 9:59 AM, Mark  wrote:
>>
>>>  Thanks but we need Chukwa to aggregate and store files from across our
>>> app servers into Hadoop. Doesn't really look like opentsdb is meant for
>>> that. I could be wrong though?
>>>
>>>
>>> On 3/20/11 9:49 AM, Ted Dunning wrote:
>>>
>>> Take a look at openTsDb at http://opentsdb.net/
>>>
>>>  It provides lots of the capability in a MUCH simpler package.
>>>
>>> On Sun, Mar 20, 2011 at 8:43 AM, Mark  wrote:
>>>
 Sorry but it doesn't look like Chukwa mailing list exists anymore?

 Is there an easy way to set up lightweight agents on cluster of machines
 instead of downloading the full Chukwa source (+50mb)?

 Has anyone build separate RPM's for the agents/collectors?

 Thanks

>>>
>>>
>>
>