Re: Custom Graphs/Metrics reporting

[Mark Payne]

Michael,

As Bryan pointed out, at this time the metrics reported are not really 
extendable,
but the Reporting Tasks are a good approach to use.

There is a ticket [1], though, that I think is very applicable here. The idea 
is that
Processors are able to increment counters by calling 
ProcessContext.adjustCounter(String name, long value).
We would like to get those counters into the graphs so that these become 
essentially
custom metrics for a Processor. So that idea is on the roadmap but just hasn't 
yet
been tackled. Does this sound like it may be along the lines of what you were 
thinking?

Thanks
-Mark


[1] https://issues.apache.org/jira/browse/NIFI-120 




> On Mar 24, 2016, at 7:47 AM, Bryan Bende  wrote:
> 
> Hi Michael,
> 
> Currently the graphing functionality is not extensible, as far as I know.
> 
> One option that might be helpful is a ReportingTask. ReportingTasks are
> components that get access to all of the metrics and provenance events and
> can push them out to an external system. Currently there are ReportingTasks
> for Ganglia and Ambari, and I believe an open pull-request to add one for
> Rieman, but ReportingTasks are an extension point just like processors, so
> a custom ReportingTask could be developed to push metrics to any system [1].
> 
> Let us know if you had something else in mind.
> 
> -Bryan
> 
> [1]
> https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html#reporting-tasks
> 
> On Thu, Mar 24, 2016 at 6:51 AM, michael.griffit...@baesystems.com <
> michael.griffit...@baesystems.com> wrote:
> 
>> Morning (in the UK) all,
>> 
>> Does NiFi's API have the ability to extend the graphing functionality? It
>> currently shows flow files or bytes read/written every 5 minutes. Is it
>> possible to extend this to show custom metrics?
>> 
>> Many thanks,
>> 
>> Michael
>> 
>> Michael Griffiths
>> System Developer
>> BAE Systems Applied Intelligence
>> ___
>> |  E: michael.griffit...@baesystems.com
>> 
>> BAE Systems Applied Intelligence, Surrey Research Park, Guildford, Surrey,
>> GU2 7RQ.
>> www.baesystems.com/ai
>> 
>> Please consider the environment before printing this email. This message
>> should be regarded as confidential. If you have received this email in
>> error please notify the sender and destroy it immediately. Statements of
>> intent shall only become binding when confirmed in hard copy by an
>> authorised signatory. The contents of this email may relate to dealings
>> with other companies under the control of BAE Systems Applied Intelligence
>> Limited, details of which can be found at
>> http://www.baesystems.com/Businesses/index.htm.
>> 

Re: Custom Graphs/Metrics reporting

[Bryan Bende]

Hi Michael,

Currently the graphing functionality is not extensible, as far as I know.

One option that might be helpful is a ReportingTask. ReportingTasks are
components that get access to all of the metrics and provenance events and
can push them out to an external system. Currently there are ReportingTasks
for Ganglia and Ambari, and I believe an open pull-request to add one for
Rieman, but ReportingTasks are an extension point just like processors, so
a custom ReportingTask could be developed to push metrics to any system [1].

Let us know if you had something else in mind.

-Bryan

[1]
https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html#reporting-tasks

On Thu, Mar 24, 2016 at 6:51 AM, michael.griffit...@baesystems.com <
michael.griffit...@baesystems.com> wrote:

> Morning (in the UK) all,
>
> Does NiFi's API have the ability to extend the graphing functionality? It
> currently shows flow files or bytes read/written every 5 minutes. Is it
> possible to extend this to show custom metrics?
>
> Many thanks,
>
> Michael
>
> Michael Griffiths
> System Developer
> BAE Systems Applied Intelligence
> ___
> |  E: michael.griffit...@baesystems.com
>
> BAE Systems Applied Intelligence, Surrey Research Park, Guildford, Surrey,
> GU2 7RQ.
> www.baesystems.com/ai
>
> Please consider the environment before printing this email. This message
> should be regarded as confidential. If you have received this email in
> error please notify the sender and destroy it immediately. Statements of
> intent shall only become binding when confirmed in hard copy by an
> authorised signatory. The contents of this email may relate to dealings
> with other companies under the control of BAE Systems Applied Intelligence
> Limited, details of which can be found at
> http://www.baesystems.com/Businesses/index.htm.
>