Re: Number and size of nodes

2019-06-01 Thread Jeff
Christian, Another factor to consider for the NiFi nodes is the disk hardware and configuration. Simply put, the faster your disks are (SSD, RAID0, etc), the faster NiFi will be able to perform. This is dependent on the needs of your flow; the number of CPUs/cores isn't the only consideration fo

Re: Number and size of nodes

2019-06-01 Thread Christian Andreasen
Thank you for your input, Martijn. It def helps us in our decision-making. Den tor. 30. maj 2019 kl. 11.21 skrev Martijn Dekkers < mart...@dekkers.org.uk>: > In clusters, odd numbers of nodes are generally preferred (depending on > clustering implementation) to avoid (to an extent) split-brain sc

Re: Number and size of nodes

2019-05-30 Thread Martijn Dekkers
In clusters, odd numbers of nodes are generally preferred (depending on clustering implementation) to avoid (to an extent) split-brain scenarios and generally manage quorum. I stand to be corrected, but in the current implementation in NiFi I don't think this is an issue. Additional nodes will

Number and size of nodes

2019-05-30 Thread Christian Andreasen
We are planning to build a NiFi cluster and have two questions that we hope you could help us answer. 1. When having our NiFi cluster configured to run with an external Zookeeper cluster (i.e. not using the default embedded ZK mode) is it then still best practice to have an odd number of