Re: Connecting Controller Services Automatically

2020-05-22 Thread Eric Secules
Hi Andy, Given that you have a flow which operates on two different S3 accounts for example, how would you do deployment automation? Do you mandate that the controller service with the same ID must exist in both a development and production environment rather than try to connect a processor to a m

Re: Connecting Controller Services Automatically

2020-05-22 Thread Andy LoPresto
Eric, I can’t answer all these questions but I would definitely have hesitations around building an expectation that there is only one instance of any given controller service type in an entire canvas. I can think of numerous flows (this may not affect your particular flows, but the concepts st

Connecting Controller Services Automatically

2020-05-22 Thread Eric Secules
Hello everyone, I am running into an issue with automated deployment using nipyapi . We would like to be able to pull down flows from a registry and have them ready to go once all their controller services have been turned on. But there are a few issues.

Re: Use of SNI routing in Nifi ?

2020-05-22 Thread Andy LoPresto
Thanks Pat. The S2S protocol uses TLS as a component, and attempts to use the highest protocol version supported by both endpoints. For Java 8, this should be TLSv1.2, and for Java 11, TLSv1.3 (introduced in upcoming NiFi 1.12.0). NiFi itself doesn’t support hosting multiple instances on the sa

Re: Use of SNI routing in Nifi ?

2020-05-22 Thread Pat White
Hi Andy, Thanks very much for the feedback, and my apologies for being vague. I have not used SNI so i have some learning to do. Specific use case we were asked about relates with Nifi to Nifi transfers, so not the webservice itself but rather S2S. I was wondering if S2S protocol supports SNI, and

Re: Use of SNI routing in Nifi ?

2020-05-22 Thread Andy LoPresto
Hi Pat, Are you asking if NiFi’s internal web server supports SNI or if NiFi processors/framework connecting to external services can resolve SNI? Maybe some more context around your question would help us answer. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Finger

Re: ExecuteProcess processor with TLS1.2 error: "failed setting cipher list"

2020-05-22 Thread Andy LoPresto
Hi Eric, Can you verify a couple things? 1. The specific curl instance you’re using in the terminal and in NiFi are the same? (i.e. run this command on the terminal and in an ExecuteProcess processor: $ which curl) 2. Run curl -V to see which version of openssl curl is using in both scenarios.

Use of SNI routing in Nifi ?

2020-05-22 Thread Pat White
Hi Folks, Has anyone tried using SNI routing with Nifi? I believe Jetty supports the TLS extension for SNI but have not tried using it, would appreciate any feedback if someone has tried this. Thank you.

ExecuteProcess processor with TLS1.2 error: "failed setting cipher list"

2020-05-22 Thread Eric Chaves
Hi folks, I have a flow that downloads files from an FTP server over SSL using TLS1.2. To achieve this I use curl command line in an ExecuteProcess processor. This routine has been working ok until recently when we tried it on an upgraded NiFi server. After tracking down the error we noticed th

Re: MergeRecord performance

2020-05-22 Thread Robert R. Bruno
Sorry one other thing I thought of that may help. I noticed on 1.11.4 when I would stop the updaterecord processor it would take a long period of time for the processor to stop (threads were hanging), but when I went back to 1.9.2 the processor would stop in a very timely manner. Not sure if that

Re: MergeRecord performance

2020-05-22 Thread Robert R. Bruno
I had more updates on this. Yesterday I again attempted to upgrade one of our 1.9.2 clusters that is now using mergecontent vs mergerecord. The flow had been running on 1.9.2 for about a week with no issue. I did the upgrade to 1.11.4, and saw about 3 of 10 nodes not being able to keep up. The

GetFile Usage

2020-05-22 Thread KhajaAsmath Mohammed
Hi, I have a question regarding how the getfile runs in the background. Lets say I have 1000 files in the directory, when I use getfile will all 1000 files are read once and loaded into queue or is it sequentially by file? My requirement is to load all files in queue at a time so that I can come