Hi,
You can set up ‘http’ monitoring when you start your process to get the metrics
of your Flume.
Example;
-Dflume.monitoring.type=http -Dflume.monitoring.port=34545
Then you can connect a browser to your IP and port. I use Firefox to do that
as the output is JSON. You just need to refresh your browser. Not sure if
that’s what you are looking for.
Example;
{"CHANNEL.fileChannel":{"EventPutSuccessCount":"56665000","ChannelFillPercentage":"0.0","Type":"CHANNEL","StopTime":"0","EventPutAttemptCount":"56665000","ChannelSize":"0","StartTime":"1447855497117","EventTakeSuccessCount":"56665000","ChannelCapacity":"1000000","EventTakeAttemptCount":"56719994"},"SOURCE.LSMetrics":{"OpenConnectionCount":"1","Type":"SOURCE","AppendBatchAcceptedCount":"566650","AppendBatchReceivedCount":"566650","EventAcceptedCount":"56665000","AppendReceivedCount":"0","StopTime":"0","StartTime":"1447855497515","EventReceivedCount":"56665000","AppendAcceptedCount":"0"}}
Keith
From: Gonzalo Herreros [mailto:[email protected]]
Sent: Thursday, November 19, 2015 4:25 AM
To: user
Subject: Re: How to monitor flume agents
Using a distribution like Cloudera or Hortonworks. They both have free versions.
Alternatively you can use standard linux process monitoring tools.
Regards,
Gonzalo
On 19 November 2015 at 09:11, Zhishan Li
<[email protected]<mailto:[email protected]>> wrote:
Is there a way to simply and conveniently monitor flume agents?
Currently, I check the flume’s log on each flume node everyday.
Thanks,
