Re: Fixing unstable nifi cluster.

2018-10-16 Thread Jeff
Hello, Pierre's suggestions should be helpful for you, since you are running Zookeeper on the same nodes as NiFi. If it's possible for you to run Zookeeper on separate hosts from NiFi so that ZK and NiFi are not colocated, you should see better results. - Jeff On Tue, Oct 16, 2018 at 8:03 AM

Re: Fixing unstable nifi cluster.

2018-10-16 Thread Pierre Villard
Hi, Can you try increasing the below parameters? That's usually what I recommend, our default values being probably a bit too aggressively low. nifi.zookeeper.connect.timeout=15 secs nifi.zookeeper.session.timeout=15 secs nifi.cluster.node.read.timeout=30 sec Pierre Le mar. 16 oct. 2018 à

Fixing unstable nifi cluster.

2018-10-16 Thread ashwin konale
Hi, We have a 3 node nifi cluster (With separate zookeper instances running in the same machines) which pulls the data from mysql and write to hdfs. I am frequently running into problems with cluster. Nodes keeps disconnecting from each other, primary nodes keeps switching and sometimes it just