Slow flowfile transfer from process group port to output port.

2018-09-25 Thread ashwin konale
Hi I have the following flow which I am trying to increase the throughput. I am runnign 3 node nifi cluster(v1.6) CDC -> processGroupOutputPort -> externalOutputPort RPG -> downstream Flowfiles are always queued up between processGroupOutputPort to externalOutputPort. I dont see any configuration

Re: Slow flowfile transfer from process group port to output port.

2018-09-25 Thread Mark Payne
Ashwin, You'll want to Right-Click on the RPG and then choose to configure Remote Ports. From there, you can configure how many threads should be used to pull data from each port. So you've updated the Output Port to use up to 3 threads per node to provide the data, but each node is still only

Re: Slow flowfile transfer from process group port to output port.

2018-09-26 Thread Ashwin Konale
Hello Mike, Thanks a lot for looking at it. But I have already configured threads for remote port in RPG. But congestion is in the transfer between process group to external port. And there are no configuration option to increase number of threads in externalOutputPort. Number of running threads

Re: Slow flowfile transfer from process group port to output port.

2018-09-26 Thread ashwin . konale
On 2018/09/25 15:34:03, Mark Payne wrote: > Ashwin, > > You'll want to Right-Click on the RPG and then choose to configure Remote > Ports. From there, you can > configure how many threads should be used to pull data from each port. So > you've updated the Output Port > to use up to 3 thread

Re: Slow flowfile transfer from process group port to output port.

2018-09-26 Thread ashwin . konale
On 2018/09/25 15:34:03, Mark Payne wrote: > Ashwin, > > You'll want to Right-Click on the RPG and then choose to configure Remote > Ports. From there, you can > configure how many threads should be used to pull data from each port. So > you've updated the Output Port > to use up to 3 thread