[ 
https://issues.apache.org/jira/browse/FLUME-748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13264617#comment-13264617
 ] 

Mubarak Seyed commented on FLUME-748:
-------------------------------------

Thanks Eric. CounterGroup increments count for success/failure/count-of-events, 
do we have list of metrics to be displayed/exposed?

For example, in HBase RS web-ui, we can get region specific write/read counts, 
store (store-file) sizes, memstore size etc..

We need two level of metrics, one for global counts (as like CounterGroup -> 
rpc.success, rpc.failure) and other one for components (source, sink, channel) 
specific metrics. If i want to see how channelXXX performs (for point in time 
and historical) then we need to define/collect metrics as like how region in RS 
collects metrics and displayed in RS web-ui.

This is how i am thinking on how we can represent

{code}
Global (agent specific) :
--------------------------
bind port
rpc.received.batch
rpc.events
rpc.successful
rpc.failure

java.util.concurrent.executor level stats 
jvm heap stats
up time

Sources:
-------
--------------------------------------------------------------------------------------------------
 Name        | config         |  rpc.events    | rpc.successful  |   
rpc.failure   | graph
--------------------------------------------------------------------------------------------------
 source-1     | latest config  | xxxxx          | xxxxxx          | xxxxxxx     
    | link to graph
--------------------------------------------------------------------------------------------------

Channels:
--------------------------------------------------------------------------------------------------
 Name        | associated source | associated sink | capacity | remaining | yet 
to take/process |
--------------------------------------------------------------------------------------------------
mem-channel  | source-1          | hdfs-sink1      | 10000    | 2000      | 3000
--------------------------------------------------------------------------------------------------

{code}



                
> Create metric collection infrastructure
> ---------------------------------------
>
>                 Key: FLUME-748
>                 URL: https://issues.apache.org/jira/browse/FLUME-748
>             Project: Flume
>          Issue Type: Sub-task
>          Components: Build, Docs, Master, Node, Shell, Sinks+Sources, 
> Technical Debt, Test, Web
>    Affects Versions: NG alpha 1
>            Reporter: E. Sammer
>             Fix For: v1.2.0
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to