Joe - We're testing some scenarios. Andrew captured some confusing behavior in the UI when enabling and disabling load balancing on a relationship: "Update UI for Clustered Connections" -- https://issues.apache.org/jira/projects/NIFI/issues/NIFI-9236
Question - When a FlowFile is Load Balanced from one node to another, is the entire Content Claim load balanced? Or just the small portion necessary? Mike - We found two tickets that are in the ballpark: 1. Improve handling of Load Balanced Connections when one node is slow -- https://issues.apache.org/jira/browse/NIFI-7081 2. NiFi FlowFiles stuck in queue when using Single Node load balance strategy -- https://issues.apache.org/jira/browse/NIFI-8970 >From @Simon comment - we know we've seen underperforming nodes in a cluster before. We're discussing @Simon's comment is applicable to the issue we're seeing > "The one thing I can think of is the scenario where one (or more) nodes are significantly slower than the other ones. In these cases it might happen then the nodes are “running behind” blocks the other nodes from balancing perspective." @Simon - I'd like to understand the "blocks other nodes from balancing perspective" better if you have additional information. We're trying to replicate this scenario. Thanks, Ryan On Sat, Sep 18, 2021 at 3:45 PM Mike Thomsen <[email protected]> wrote: > > there is a ticket to overcome this (there is no ETA), > > Do you know what the Jira # is? > > On Mon, Sep 6, 2021 at 7:14 AM Simon Bence <[email protected]> > wrote: > > > > Hi Mike, > > > > I did a quick check on the round robin balancing and based on what I > found the reason for the issue must lie somewhere else, not directly within > it. The one thing I can think of is the scenario where one (or more) nodes > are significantly slower than the other ones. In these cases it might > happen then the nodes are “running behind” blocks the other nodes from > balancing perspective. > > > > Based on what you wrote this is a possible reason and there is a ticket > to overcome this (there is no ETA), but other details might shed light to a > different root cause. > > > > Regards, > > Bence > > > > > > > > > On 2021. Sep 3., at 14:13, Mike Thomsen <[email protected]> > wrote: > > > > > > We have a 5 node cluster, and sometimes I've noticed that round robin > > > load balancing stops sending flowfiles to two of them, and sometimes > > > toward the end of the data processing can get as low as a single node. > > > Has anyone seen similar behavior? > > > > > > Thanks, > > > > > > Mike > > >
