New 'Powered by Apache NiFi' Website Section

2016-12-27 Thread Joe Percivall
Hello NiFi Users, Thanks to a contribution by Andre de Miranda we have a new "Powered By Apache NiFi" section on our webpage[1]. It would be great to expand this list out with many more companies and organizations that are using Apache NiFi. If you'd like to be added to this list please feel free

Re: Processors on the fly for many sensor devices

2016-12-27 Thread ddewaele
H, We've been using our Netty4 based GetTCP processor in production for a while now with success. We've currently got the code on a branch in your forked repo : https://github.com/IxorTalk/nifi-gettcp-bundle/tree/raf/netty-tcp-client It detects read timeouts , channel inactivities, and can proper

Re: Process Group singleton

2016-12-27 Thread Yari Marchetti
Aldrin, I got what you mean, and it could actually work in my scenario but I need some time to look into it to evaluate pros and cons as I feel that, even if it could help reduce maintenance cost by centralising common functionalities, it also adding complexity to the overall design and debug of fl

Re: Process Group singleton

2016-12-27 Thread Aldrin Piri
Hi Yari, I think your assumptions may be a little off. You can use input/output ports to help traverse the nested levels of PGs. To help illustrate, I created a template [1] you can evaluate as to one way this could be managed for your scenario. As noted, the number of connections can become un

Re: Process Group singleton

2016-12-27 Thread Yari Marchetti
Hi Aldrin, the problem I see with your suggestion, at least in my specific case, it's that it requires to have all the referencing groups (in your example A,B) inside the same process group (otherwise you cannot link them, right?) but that's not the case for us because we've many of them so they're

Re: Process Group singleton

2016-12-27 Thread Aldrin Piri
Hi Yari, The concept you are looking for has been discussed a bit and a draft feature proposal was created for referenceable process groups [1], although is a common pattern and implementable with the current functionality provided; common cases of this are standard tagging or enrichment sets of f

Process Group singleton

2016-12-27 Thread Yari Marchetti
Hello, we're actively using Nifi on production but there's a recurring problem popping out every now and then: maintenance of process groups created from templates, as we're spending quite some time looking for all the instances of a specific template and updating them as required. What we would l