Re: [E] Re: NiFi 1.12.1 queue balancing

2021-01-28 Thread Zilvinas Saltys
You're saying it wouldn't kick in because of low rates of files? The interesting bit for us is that we don't process a lot of files but the files themselves are quite large. And in our case some nodes keep getting behind and it seems that load balancer is not kicking in to rebalance the cluster.

Re: NiFi 1.12.1 queue balancing

2021-01-28 Thread Joe Witt
Maksym, Very difficult to look at these brief/limited details and offer meaningful responses. In the example you show about the data volumes are so small that I dont even know that load balancing would kick in. But yes generally speaking the combination of load balancing and back pressure

NiFi 1.12.1 queue balancing

2021-01-28 Thread Maksym Skrynnikov
I am running NiFi 1.12.1 without NiFi Registry and have a connection that is configured to *Round Robin *flow files. After some time I see some nodes performing worse than the other and the queue is piling up on 1-2 nodes. [image: niifi-queue.jpg] The question I have is how rebalancing actually