Zookeeper issues mentioned in a talk about storm / heron

[Tony Kurc]

I mentioned slides I saw at the meetup about zookeeper perils at scale in
storm, here are slides, i couldn't find a video after some limited
searching.
https://qconsf.com/system/files/presentation-slides/heron-qcon-2015.pdf

Re: Fwd: Your Distro

[Josh Elser]

Sorry you're having problems, but if you want help figuring it out, 
please contact infrastruc...@apache.org


Paul Nahay wrote:

Yes. I don't understand it.

See screenshot for my settings, which have never changed.

Paul

-Original Message-
From: Josh Elser [mailto:josh.el...@gmail.com]
Sent: Thursday, March 24, 2016 10:28 AM
To: Paul Nahay
Subject: Re: Fwd: Your Distro

The mail list server appears to disagree :)

Paul Nahay wrote:

According to my webmail settings, I HAVE been sending as flat text, not as HTML!


Paul Nahay
1013 Rosemere Ave.
Silver Spring, MD 20904-3008
301-680-3825 (home)
301-806-9265 (cell)
pna...@sprynet.com


-Original Message-

From: Josh Elser
Sent: Mar 24, 2016 12:44 AM
To: dev@nifi.apache.org
Cc: pna...@sprynet.com
Subject: Re: Fwd: Your Distro

Matthew Clarke wrote:

-- Forwarded message --
From: Paul Nahay
Date: Wed, Mar 23, 2016 at 10:31 AM
Subject: Your Distro
To: Matthew Clarke


This is the 2nd time I've gotten an email I sent to
dev@nifi.apache.org returned to me:



Hi. This is the qmail-send program at apache.org.
I'm afraid I wasn't able to deliver your message to the following addresses.
This is a permanent error; I've given up. Sorry it didn't work out.

:
ezmlm-reject: fatal: Sorry, I don't accept messages of MIME
Content-Type 'text/html' (#5.2.3)


As it says: you're sending HTML emails which the mail-list program
doesn't accept.

In other words, configure your mail client to send plaintext emails
instead of HTML "rich content" message. If you still have trouble
sending email, you should contact infrastruct...@apache.org for
assistance in configuring your mail client.

Re: NiFi and Event Hubs!

[Joe Witt]

Hello Dan

>From here [1] you can see we're using
com.microsoft.eventhubs.client:eventhubs-client:0.9.1

Always happy to engage on making such integrations strong and
educating folks on NiFi.

[1] 
https://github.com/apache/nifi/blob/master/nifi-nar-bundles/nifi-azure-bundle/nifi-azure-processors/pom.xml

On Thu, Mar 24, 2016 at 1:08 PM, Dan Rosanova  wrote:
> Hello NiFi friends!
> I'm the program manager for Azure Event Hubs. I was delighted to see Event 
> Hubs in NiFi and wanted to know a little but more about it and how we can 
> support the community better.
>
> I also wanted to inquire if you're using our native java client or Proton-J 
> directly? I'll dig in over the weekend to see. I had this come to my support 
> team today and realized we've got a blind spot here.
>
> Finally, I wondered if anyone would like to do a presentation to our Azure 
> Advisors group or a public webinar about NiFi and Event Hubs (and other toys 
> in your toolbox).
>
> Kind Regards,
> -Dan Rosanova

NiFi and Event Hubs!

[Dan Rosanova]

Hello NiFi friends!
I'm the program manager for Azure Event Hubs. I was delighted to see Event Hubs 
in NiFi and wanted to know a little but more about it and how we can support 
the community better.

I also wanted to inquire if you're using our native java client or Proton-J 
directly? I'll dig in over the weekend to see. I had this come to my support 
team today and realized we've got a blind spot here.

Finally, I wondered if anyone would like to do a presentation to our Azure 
Advisors group or a public webinar about NiFi and Event Hubs (and other toys in 
your toolbox).

Kind Regards,
-Dan Rosanova

[GitHub] nifi pull request: NIFI-1660 - Enhance the expression language wit...

[ckmcd]

GitHub user ckmcd opened a pull request:

https://github.com/apache/nifi/pull/303

NIFI-1660 - Enhance the expression language with jsonPath function

Allows JSON path application in EL.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ckmcd/nifi NIFI-1660

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/303.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #303


commit 4c54a8ef9763c2cd50b44001013df27ee5778aa7
Author: Chris McDermott 
Date:   2016-03-24T18:10:19Z

NIFI-1660 - Enhance the expression language with jsonPath function




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Flow.xml.gz are Empty

[dale.chang13]

UPDATE:

Here's the complete stack trace for from the slave node's app.log

java.lang.Exception: Unable to load flow due to: java.io.IOException:
org.apache.nifi.cluster.ConnectionException: Failed to connect node to
cluster because local or cluster flow is malformed.
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:784)
~[nifi-jetty-1.1.1.0-12.jar:1.1.1.0-12]
at org.apache.nifi.NiFi.(NiFi.java:137)
[nifi-runtime-1.1.1.0-12.jar:1.1.1.0-12]
at org.apache.nifi.NiFi.main(NiFi.java:227)
[nifi-runtime-1.1.1.0-12.jar:1.1.1.0-12]
Caused by: java.io.IOException: org.apache.nifi.cluster.ConnectionException:
Failed to connect node to cluster because local or cluster flow is
malformed.
at
org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:453)
~[nifi-framework-core-1.1.1.0-12.jar:1.1.1.0-12]
at org.apache.nifi.web.server.JettyServer.start(JettyServer.java:775)
~[nifi-jetty-1.1.1.0-12.jar:1.1.1.0-12]
... 2 common frames omitted
Caused by: org.apache.nifi.cluster.ConnectionException: Failed to connect
node to cluster because local or cluster flow is malformed.
at
org.apache.nifi.controller.StandardFlowService.loadFromConnectionResponse(StandardFlowService.java:734)
~[nifi-framework-core-1.1.1.0-12.jar:1.1.1.0-12]
at
org.apache.nifi.controller.StandardFlowService.load(StandardFlowService.java:433)
~[nifi-framework-core-1.1.1.0-12.jar:1.1.1.0-12]
... 3 common frames omitted
Caused by: org.apache.nifi.controller.FlowSerializationException:
org.xml.sax.SAXParseException; lineNumber: 3384; columnNumber: 23; Character
reference 

Re: Question about code formatting for pull requests

[Andy LoPresto]

Chris,

My IDE does the same. It is preferable to undo those changes to minimize the 
impact of the PR and help reviewers focus on actual code changes. You can use 
the git rebase command to remove individual changes or you can copy/paste the 
original ordering of the imports and commit again, and the end result will be 
the same. Thanks.

Andy LoPresto
alopresto.apa...@gmail.com
PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65B 2F7D EF69

> On Mar 24, 2016, at 9:17 AM, McDermott, Chris Kevin (MSDU - 
> STaTS/StorefrontRemote)  wrote:
> 
> I’m getting a pull request ready and discovered that my IDE did a bunch of 
> code “cleanup” on the files I modified.  The cleanup is mostly reordering 
> imports and removing leading and trailing whitespace.  Are these changes 
> desirable/acceptable or do I need to go back and undo them?
> 
> The commit can be found here 
> https://github.com/ckmcd/nifi/commit/485f8ce39b3e621f0659b2d91fe3945b29c39805
> 
> Thanks,
> Chris
> 



signature.asc
Description: Message signed with OpenPGP using GPGMail

Question about code formatting for pull requests

[McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote)]

I’m getting a pull request ready and discovered that my IDE did a bunch of code 
“cleanup” on the files I modified.  The cleanup is mostly reordering imports 
and removing leading and trailing whitespace.  Are these changes 
desirable/acceptable or do I need to go back and undo them?

The commit can be found here 
https://github.com/ckmcd/nifi/commit/485f8ce39b3e621f0659b2d91fe3945b29c39805

Thanks,
Chris

Text and metadata extraction processor

[Dmitry Goldenberg]

Hi,

I see that the ExtractText processor extracts text using regex.

What about a processor that extracts text and metadata from incoming
files?  That doesn't seem to exist - but perhaps I didn't quite look in the
right spots.

If that doesn't exist I'd like to implement and commit it, using Apache
Tika.  There may also be a couple of related processors to that.

Thoughts?

Thanks,
- Dmitry

Re: Text and metadata extraction processor

[Dmitry Goldenberg]

Thanks, Joe!

Hi Joe S. - I'm definitely up for discussing and contributing.

While building search-related ingestion systems, I've seen metadata and
text extraction being done all the time; it's always there and always has
to be done for building search indexes.  Beyond that, OCR-related
capabilities are often requested, and the advantage of Tika is that it
supports OCR out of the box.

- Dmitry

On Thu, Mar 24, 2016 at 11:36 AM, Joe Witt  wrote:

> Dmitry,
>
> Another community member (Joe Skora) has a PR outstanding for
> extracting metadata from media files using Tika.  Perhaps it makes
> sense to broaden that to in general extract what Tika can find.  Joe -
> perhaps you can discuss your ideas with Dmitry and see if broadening
> is a good idea or if rather domain specific ones make more sense.
>
> This concept of extracting metadata from documents/text files, etc..
> using something like Tika is certainly useful as that then can drive
> nice automated routing decisions.
>
> Thanks
> Joe
>
> On Thu, Mar 24, 2016 at 9:28 AM, Dmitry Goldenberg
>  wrote:
> > Hi,
> >
> > I see that the ExtractText processor extracts text using regex.
> >
> > What about a processor that extracts text and metadata from incoming
> > files?  That doesn't seem to exist - but perhaps I didn't quite look in
> the
> > right spots.
> >
> > If that doesn't exist I'd like to implement and commit it, using Apache
> > Tika.  There may also be a couple of related processors to that.
> >
> > Thoughts?
> >
> > Thanks,
> > - Dmitry
>

Re: Text and metadata extraction processor

[Joe Witt]

Dmitry,

Another community member (Joe Skora) has a PR outstanding for
extracting metadata from media files using Tika.  Perhaps it makes
sense to broaden that to in general extract what Tika can find.  Joe -
perhaps you can discuss your ideas with Dmitry and see if broadening
is a good idea or if rather domain specific ones make more sense.

This concept of extracting metadata from documents/text files, etc..
using something like Tika is certainly useful as that then can drive
nice automated routing decisions.

Thanks
Joe

On Thu, Mar 24, 2016 at 9:28 AM, Dmitry Goldenberg
 wrote:
> Hi,
>
> I see that the ExtractText processor extracts text using regex.
>
> What about a processor that extracts text and metadata from incoming
> files?  That doesn't seem to exist - but perhaps I didn't quite look in the
> right spots.
>
> If that doesn't exist I'd like to implement and commit it, using Apache
> Tika.  There may also be a couple of related processors to that.
>
> Thoughts?
>
> Thanks,
> - Dmitry

Re: Flow.xml.gz are Empty

[dale.chang13]

I went through the nifi.properties for my ncm and two nodes and made sure
that the "nifi.sensitive.props.key" values are all the same.

However, I do not know how to make sure my ports are clear between the
nodes. Could you help me or direct me to to some resources?




>Make that your 'nifi.sensitive.props.key" is the same between all the 
>nodes. If it is not, you will get a partial load of the file, basically up 
>until the point something gets loaded that needs to be decrypted. 

>Make sure that your ports a clear between all the nodes. There are 3 ports 
t>hat you need to open for clustering. Sounds simple, but lots of time, 
p>eople get 2 out of 3 on one of the boxes. 



--
View this message in context: 
http://apache-nifi-developer-list.39713.n7.nabble.com/Nodes-Flow-xml-gz-Are-Empty-When-Recreated-tp8503p8506.html
Sent from the Apache NiFi Developer List mailing list archive at Nabble.com.

Re: Flow.xml.gz are Empty

[Corey Flowers]

You can check a couple of things.

Make that your 'nifi.sensitive.props.key" is the same between all the
nodes. If it is not, you will get a partial load of the file, basically up
until the point something gets loaded that needs to be decrypted.

Make sure that your ports a clear between all the nodes. There are 3 ports
that you need to open for clustering. Sounds simple, but lots of time,
people get 2 out of 3 on one of the boxes.



On Thu, Mar 24, 2016 at 8:17 AM, dale.chang13 
wrote:

> Good morning guys,
>
> I've been having trouble connecting two slave nodes to the ncm.
> In the logs, on the line before "/unable to load flow due to...
> ConnectionException... local or cluster flow is malformed/,"
> I see /[Fatal Error] :3384:23: Character reference 

Re: [VOTE] Release Apache NiFi 0.6.0 (RC2)

[Matt Gilman]

+1 (binding)

Build, hashes, etc all look good.

Ran through various cases verifying Kerberos authentication in the UI/Rest
Api using both SSO and username/password login in both standalone and
clustered mode.

Matt

On Thu, Mar 24, 2016 at 8:34 AM, Matt Burgess  wrote:

> +1 (non-binding)
>
> Ran through all build verification steps successfully, tested locally with
> various templates, processors, and controller services.
>
> On Thu, Mar 24, 2016 at 12:46 AM, Joe Witt  wrote:
>
> > +1 (binding)
> >
> > Ran through all build verification steps and all checks out.  Local
> > testing as well as testing on single and cluster setup with security
> > including two-way SSL and LDAP interaction w/uname and pword on a
> > fairly high volume and complex flow checks out.
> >
> > On Wed, Mar 23, 2016 at 5:46 PM, Aldrin Piri 
> wrote:
> > > Hello Apache NiFi Community,
> > >
> > > I am pleased to be calling this vote for the source release of Apache
> > NiFi,
> > > nifi-0.6.0.
> > >
> > > The source zip, including signatures, digests, etc. can be found at:
> > > https://repository.apache.org/content/repositories/orgapachenifi-1079/
> > >
> > > The Git tag is nifi-0.6.0-RC2
> > > The Git commit hash is 0b9bd20d31d7f805300254da768d91b973480151
> > > *
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=0b9bd20d31d7f805300254da768d91b973480151
> > > *
> > >
> >
> https://github.com/apache/nifi/commit/0b9bd20d31d7f805300254da768d91b973480151
> > >
> > > Checksums of nifi-0.6.0-source-release.zip:
> > > MD5: 42dbc268668b3524eb7a56c403712a7f
> > > SHA1: be747176565ad94ba46fcd15490f99f22dbe17ec
> > > SHA256:
> 9cb7353199049660bb7905364e4a02def69186b165ebb3b13a786edb1a9d8da8
> > >
> > > Release artifacts are signed with the following key:
> > > https://people.apache.org/keys/committer/aldrin.asc
> > >
> > > KEYS file available here:
> > > https://dist.apache.org/repos/dist/release/nifi/KEYS
> > >
> > > 77 issues were closed/resolved for this release:
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12334372
> > > Release note highlights can be found here:
> > >
> >
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.6.0
> > >
> > > The vote will be open for 72 hours.
> > > Please download the release candidate and evaluate the necessary items
> > > including checking hashes, signatures, build from source, and test.
> Then
> > > please vote:
> > >
> > > [ ] +1 Release this package as nifi-0.6.0
> > > [ ] +0 no opinion
> > > [ ] -1 Do not release this package because...
> > >
> > > Thanks!
> >
>

Flow.xml.gz are Empty

[dale.chang13]

Good morning guys,

I've been having trouble connecting two slave nodes to the ncm. 
In the logs, on the line before "/unable to load flow due to...
ConnectionException... local or cluster flow is malformed/," 
I see /[Fatal Error] :3384:23: Character reference 

Re: Custom Graphs/Metrics reporting

[Mark Payne]

Michael,

As Bryan pointed out, at this time the metrics reported are not really 
extendable,
but the Reporting Tasks are a good approach to use.

There is a ticket [1], though, that I think is very applicable here. The idea 
is that
Processors are able to increment counters by calling 
ProcessContext.adjustCounter(String name, long value).
We would like to get those counters into the graphs so that these become 
essentially
custom metrics for a Processor. So that idea is on the roadmap but just hasn't 
yet
been tackled. Does this sound like it may be along the lines of what you were 
thinking?

Thanks
-Mark


[1] https://issues.apache.org/jira/browse/NIFI-120 




> On Mar 24, 2016, at 7:47 AM, Bryan Bende  wrote:
> 
> Hi Michael,
> 
> Currently the graphing functionality is not extensible, as far as I know.
> 
> One option that might be helpful is a ReportingTask. ReportingTasks are
> components that get access to all of the metrics and provenance events and
> can push them out to an external system. Currently there are ReportingTasks
> for Ganglia and Ambari, and I believe an open pull-request to add one for
> Rieman, but ReportingTasks are an extension point just like processors, so
> a custom ReportingTask could be developed to push metrics to any system [1].
> 
> Let us know if you had something else in mind.
> 
> -Bryan
> 
> [1]
> https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html#reporting-tasks
> 
> On Thu, Mar 24, 2016 at 6:51 AM, michael.griffit...@baesystems.com <
> michael.griffit...@baesystems.com> wrote:
> 
>> Morning (in the UK) all,
>> 
>> Does NiFi's API have the ability to extend the graphing functionality? It
>> currently shows flow files or bytes read/written every 5 minutes. Is it
>> possible to extend this to show custom metrics?
>> 
>> Many thanks,
>> 
>> Michael
>> 
>> Michael Griffiths
>> System Developer
>> BAE Systems Applied Intelligence
>> ___
>> |  E: michael.griffit...@baesystems.com
>> 
>> BAE Systems Applied Intelligence, Surrey Research Park, Guildford, Surrey,
>> GU2 7RQ.
>> www.baesystems.com/ai
>> 
>> Please consider the environment before printing this email. This message
>> should be regarded as confidential. If you have received this email in
>> error please notify the sender and destroy it immediately. Statements of
>> intent shall only become binding when confirmed in hard copy by an
>> authorised signatory. The contents of this email may relate to dealings
>> with other companies under the control of BAE Systems Applied Intelligence
>> Limited, details of which can be found at
>> http://www.baesystems.com/Businesses/index.htm.
>> 

Re: [VOTE] Release Apache NiFi 0.6.0 (RC2)

[Matt Burgess]

+1 (non-binding)

Ran through all build verification steps successfully, tested locally with
various templates, processors, and controller services.

On Thu, Mar 24, 2016 at 12:46 AM, Joe Witt  wrote:

> +1 (binding)
>
> Ran through all build verification steps and all checks out.  Local
> testing as well as testing on single and cluster setup with security
> including two-way SSL and LDAP interaction w/uname and pword on a
> fairly high volume and complex flow checks out.
>
> On Wed, Mar 23, 2016 at 5:46 PM, Aldrin Piri  wrote:
> > Hello Apache NiFi Community,
> >
> > I am pleased to be calling this vote for the source release of Apache
> NiFi,
> > nifi-0.6.0.
> >
> > The source zip, including signatures, digests, etc. can be found at:
> > https://repository.apache.org/content/repositories/orgapachenifi-1079/
> >
> > The Git tag is nifi-0.6.0-RC2
> > The Git commit hash is 0b9bd20d31d7f805300254da768d91b973480151
> > *
> >
> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=0b9bd20d31d7f805300254da768d91b973480151
> > *
> >
> https://github.com/apache/nifi/commit/0b9bd20d31d7f805300254da768d91b973480151
> >
> > Checksums of nifi-0.6.0-source-release.zip:
> > MD5: 42dbc268668b3524eb7a56c403712a7f
> > SHA1: be747176565ad94ba46fcd15490f99f22dbe17ec
> > SHA256: 9cb7353199049660bb7905364e4a02def69186b165ebb3b13a786edb1a9d8da8
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/aldrin.asc
> >
> > KEYS file available here:
> > https://dist.apache.org/repos/dist/release/nifi/KEYS
> >
> > 77 issues were closed/resolved for this release:
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020=12334372
> > Release note highlights can be found here:
> >
> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.6.0
> >
> > The vote will be open for 72 hours.
> > Please download the release candidate and evaluate the necessary items
> > including checking hashes, signatures, build from source, and test. Then
> > please vote:
> >
> > [ ] +1 Release this package as nifi-0.6.0
> > [ ] +0 no opinion
> > [ ] -1 Do not release this package because...
> >
> > Thanks!
>

Re: Custom Graphs/Metrics reporting

[Bryan Bende]

Hi Michael,

Currently the graphing functionality is not extensible, as far as I know.

One option that might be helpful is a ReportingTask. ReportingTasks are
components that get access to all of the metrics and provenance events and
can push them out to an external system. Currently there are ReportingTasks
for Ganglia and Ambari, and I believe an open pull-request to add one for
Rieman, but ReportingTasks are an extension point just like processors, so
a custom ReportingTask could be developed to push metrics to any system [1].

Let us know if you had something else in mind.

-Bryan

[1]
https://nifi.apache.org/docs/nifi-docs/html/developer-guide.html#reporting-tasks

On Thu, Mar 24, 2016 at 6:51 AM, michael.griffit...@baesystems.com <
michael.griffit...@baesystems.com> wrote:

> Morning (in the UK) all,
>
> Does NiFi's API have the ability to extend the graphing functionality? It
> currently shows flow files or bytes read/written every 5 minutes. Is it
> possible to extend this to show custom metrics?
>
> Many thanks,
>
> Michael
>
> Michael Griffiths
> System Developer
> BAE Systems Applied Intelligence
> ___
> |  E: michael.griffit...@baesystems.com
>
> BAE Systems Applied Intelligence, Surrey Research Park, Guildford, Surrey,
> GU2 7RQ.
> www.baesystems.com/ai
>
> Please consider the environment before printing this email. This message
> should be regarded as confidential. If you have received this email in
> error please notify the sender and destroy it immediately. Statements of
> intent shall only become binding when confirmed in hard copy by an
> authorised signatory. The contents of this email may relate to dealings
> with other companies under the control of BAE Systems Applied Intelligence
> Limited, details of which can be found at
> http://www.baesystems.com/Businesses/index.htm.
>

[GitHub] nifi pull request: NIFI-1684 fixed NPE, added tests

[olegz]

GitHub user olegz opened a pull request:

https://github.com/apache/nifi/pull/302

NIFI-1684 fixed NPE, added tests



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/olegz/nifi NIFI-1684

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nifi/pull/302.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #302


commit 409ad1051fc44a0ce8acf1a59ba8dac5261a688e
Author: Oleg Zhurakousky 
Date:   2016-03-24T11:37:58Z

NIFI-1684 fixed NPE, added tests




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] nifi pull request: NIFI-1537 Added SNMP processors

[olegz]

Github user olegz commented on the pull request:

https://github.com/apache/nifi/pull/257#issuecomment-200797003
  
@michalklempa @pvillard31 thank you both for the input. Will be reviewing 
and testing. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Custom Graphs/Metrics reporting

[michael.griffit...@baesystems.com]

Morning (in the UK) all,

Does NiFi's API have the ability to extend the graphing functionality? It 
currently shows flow files or bytes read/written every 5 minutes. Is it 
possible to extend this to show custom metrics?

Many thanks,

Michael

Michael Griffiths
System Developer
BAE Systems Applied Intelligence
___
|  E: michael.griffit...@baesystems.com

BAE Systems Applied Intelligence, Surrey Research Park, Guildford, Surrey, GU2 
7RQ.
www.baesystems.com/ai

Please consider the environment before printing this email. This message should 
be regarded as confidential. If you have received this email in error please 
notify the sender and destroy it immediately. Statements of intent shall only 
become binding when confirmed in hard copy by an authorised signatory. The 
contents of this email may relate to dealings with other companies under the 
control of BAE Systems Applied Intelligence Limited, details of which can be 
found at http://www.baesystems.com/Businesses/index.htm.

[GitHub] nifi pull request: NIFI-1537 Added SNMP processors

[pvillard31]

Github user pvillard31 commented on the pull request:

https://github.com/apache/nifi/pull/257#issuecomment-200748951
  
@olegz I just rebased the PR.

As @michalklempa mentioned, you can use online SNMP service provided by 
snmpsim (http://snmpsim.sourceforge.net/public-snmp-simulator.html), otherwise 
it depends of your OS. Personally, I tried the processor by requesting basic 
SNMP data (such as uptime for example) on a CentOS machine with net-snmp agent 
running with various configurations in SNMP v1, v2c and v3 (MD5/DES). 

As a side note, at this moment, the processor is expecting an OID in 
numerical format. If I try the following command on my computer:

`snmpwalk -v2c -c public demo.snmplabs.com IF-MIB::interfaces`

I can get numerical OID by adding the option -On:

`snmpwalk -v2c -c public demo.snmplabs.com IF-MIB::interfaces -On`

This way I can see that IF-MIB::interfaces is equivalent to 
.1.3.6.1.2.1.2.2.1

I will try to write something to help setting an environment. On a 
Linux-like environment, a quick setup can be:
yum install net-snmp net-snmp-utils
service snmpd start

It will allow access to basic SNMP information in v1 and v2c with 'public' 
as community. For SNMP v3 setup, it is possible to add users using the command 
net-snmp-create-v3-user.

Hope it helps, if not, let me know ;)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] nifi pull request: NIFI-1537 Added SNMP processors

[michalklempa]

Github user michalklempa commented on the pull request:

https://github.com/apache/nifi/pull/257#issuecomment-200691342
  
@olegz there is http://snmpsim.sourceforge.net/ project, which can be used 
for testing purposes. Some simulation files are available with distribution, so 
basic testing may be done out-of-the-box


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---