Thanks for that. Sorry I should have been more specific - we have a flow running already on non-dedicated hardware. Looking to identify any limitations in NiFi/JVM that would limit how much parallelism it can take advantage of
On Mon, 10 Sep 2018 at 14:32, Sivaprasanna <sivaprasanna...@gmail.com> wrote: > Phil, > > The hardware requirements are driven by the nature of the dataflow you are > developing. If you're looking to play around with NiFi and gain some > hands-on experience, go for a 4 core 8GB RAM i.e. any modern > laptops/computer would do the job. In my case, where I'm having 100s of > dataflows, I have it clustered with 3 nodes. Each having 16GB RAM and 4(8) > cores. I went with SSDs of smaller size because my flows are involved in > writing to object stores like Google Cloud Storage, Azure Blob and Amazon > S3 and NoSQL DBs. Hope this helps. > > - > Sivaprasanna > > On Mon, Sep 10, 2018 at 4:09 AM Phil H <gippyp...@gmail.com> wrote: > > > Hi all, > > > > I've been asked to spec some hardware for a NiFi installation. Does > anyone > > have any advice? My gut feel is lots of processor cores and RAM, with > less > > emphasis on storage (small fast disks). Are there any limitations on how > > many cores the JRE/NiFi can actually make use of, or any other > > considerations like that I should be aware of? > > > > Most likely will be pairs of servers in a cluster, but again any advice > to > > the contrary would be appreciated. > > > > Cheers, > > Phil > > >
