Jordan, Thanks for reaching out. I’d be remiss if I didn’t ask you to try running a newer version of NiFi - version 1.5.0 is over 5.5 years old! There may well be some issues that are lurking that have since been addressed.
But given your description, I wonder if the issue may actually be disk related instead of network related. A few things that I would recommend looking into: - How full is the disk where the content repository is stored? What is the value of “nifi.content.repository.archive.max.usage.percentage” set to in nifi.properties? - Is the content repository on its own disk? - Have you checked for any bad sectors on the disk? Also, how much garbage collection is occurring on the system? And how much heap is allocated to NiFi (configured in conf/bootstrap.conf, something like java.arg.3=-Xmx4g )? If garbage collection is heavy that may be slowing things down as well. Thanks -Mark > On Sep 5, 2023, at 6:11 AM, POMEROY, Jordan 7094 > <jordan.pome...@herts.police.uk.INVALID> wrote: > > Hello > > Wonder if you can help me with an issue that is being reported to us via our > users. > > We use NiFi to transfer evidential phone data across our network and place it > on to our networked file storage server. Most files are in excess of 100gb, > and we have allocated the server for this work a 10gb NIC. Although we do not > expect the transfers to reach these speeds, usually we see transfer speeds of > more than 1gbps and files move over pretty quickly. > > In the last two months, our users have reported to us that it is taking > significantly longer for files to reach the destination. Upon looking, the > transfer speeds have dropped to roughly 5mbps. > > I have asked our Network team to look at firewall rules to see if there is a > bottleneck on the Network anywhere, but there isn't. we've also migrated the > virtual server which NiFi is configured on and changed network switch ports > etc to see if this has made any difference, but nothing. > > To test the network even further, I mapped from the NiFi virtual server to > the file storage server and transferred over a large file to test speeds. > This moved over at 1.2gbps with no issues at all. > > The "get file" and "put file" commands have not been touched since they were > originally configured, and we are currently using NiFi version 1.5.0. The > server is running OS Windows Server 2022. > > Any help you can provide as to what we can check next to get this working > would be very much appreciated. > > Thanks, > Jordan. > > Jordan Pomeroy > Server and Storage Engineer > Infrastructure team > Herts, Beds and Cambs Police ICT Department > The best way to contact me is via Teams or Email as I have no fixed desk. > jordan.pome...@herts.pnn.police.uk<mailto:jordan.pome...@herts.pnn.police.uk> > > ________________________________ > Internet e-mail is not to be treated as a secure means of communication. > Hertfordshire Constabulary monitors all internet e-mail activity and content. > This communication is confidential and intended for the addressee(s) only. > Please notify the sender if you have received this in error. Unauthorised use > or disclosure of the contents may be unlawful. Opinions expressed in this > document may not be official policy. > > For more details please see Hertfordshire Constabulary Privacy Policy > <https://www.herts.police.uk/hyg/fpnbch/privacy-notice/>
