Hi Everyone, I am having errors in my Cluster when I try to create a new local connection:
*ERROR [Load-Balanced Client Thread-2] o.a.n.c.q.c.c.a.n.NioAsyncLoadBalanceClient Unable to connect to ec2-nifi-node-002.internal:8443 for load balancingjava.net.ConnectException: Connection timed out at java.base/sun.nio.ch.Net.connect0(Native Method) at java.base/sun.nio.ch.Net.connect(Net.java:476) at java.base/sun.nio.ch.Net.connect(Net.java:468) at java.base/sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:692) at java.base/sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:100) at java.base/sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:84) at org.apache.nifi.controller.queue.clustered.client.async.nio.NioAsyncLoadBalanceClient.createChannel(NioAsyncLoadBalanceClient.java:495) at org.apache.nifi.controller.queue.clustered.client.async.nio.NioAsyncLoadBalanceClient.establishConnection(NioAsyncLoadBalanceClient.java:438) at org.apache.nifi.controller.queue.clustered.client.async.nio.NioAsyncLoadBalanceClient.communicate(NioAsyncLoadBalanceClient.java:233) at org.apache.nifi.controller.queue.clustered.client.async.nio.NioAsyncLoadBalanceClientTask.run(NioAsyncLoadBalanceClientTask.java:81) at org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829)* The cluster has 3 nodes, and always when trying to add a local connection, one of the 3 randomly disconnects from the Cluster. After it reconnects, it already brings the latest changes. I can add processors and process groups and it doesn't throw an error. This is how they are configured: nifi.cluster.protocol.heartbeat.interval=5 sec nifi.cluster.protocol.heartbeat.missable.max=8 nifi.cluster.protocol.is.secure=true # cluster node properties (only configure for cluster nodes) # nifi.cluster.is.node=true nifi.cluster.node.address=ec2-nifi-node-002.internal nifi.cluster.node.protocol.port=8445 nifi.cluster.node.protocol.threads=10 nifi.cluster.node.protocol.max.threads=50 nifi.cluster.node.event.history.size=25 nifi.cluster.node.connection.timeout=30 sec nifi.cluster.node.read.timeout=30 sec nifi.cluster.node.max.concurrent.requests=150 nifi.cluster.firewall.file= nifi.cluster.flow.election.max.wait.time=2 mins nifi.cluster.flow.election.max.candidates=3 # cluster load balancing properties # nifi.cluster.load.balance.host= nifi.cluster.load.balance.port=6342 nifi.cluster.load.balance.connections.per.node=4 nifi.cluster.load.balance.max.thread.count=12 nifi.cluster.load.balance.comms.timeout=30 sec I am using NIFI-1.14.0 and Open JDK-11.0.12. Each node has a processor with 2 Cores and 5GB of memory. NIFI has 10700 processors, 2600 input ports, 2600 output ports, 0 remote process groups, 16500 connections and 3000 Process groups. We will have touched some limit? -- Jairo Henao @jairohenaorojas
