Hello Isha, Flowfile repository size directly correlates with the number of flowfiles in the system AND the total size of flowfile attributes on each. You might spot check some flowfiles to see if you have created any large attributes.
Also, NiFi has a way to collect and output some simple diagnostic information [1], which may help. -- Mike [1] - https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#nifi_diagnostics On Wed, Sep 18, 2024 at 4:00 AM Isha Lamboo <[email protected]> wrote: > Hi all, > > > > Are there any metrics available in NiFi that could help me track down the > processors/flows causing a lot of data to be written in the flowfile > repository? > > The production cluster in question typically sees 50-200 MB used in the > flowfile repository under daily load, but we’ve been seeing peaks of > several GBs, even filling up the flowfile repository once. > > > > It seems like all references to flowfile size in the GUI actually refer to > content size associated with the flowfile, so I’m looking for any other way > to track down the cause. > > > > Thanks, > > > > Isha >
