Nifi 1.13.2 here I need to make about 50 REST calls to an interface, but I suspect my rest service is unreliable. So I added a ControlRate processor. I tried to slow it down so that I only process one flowfile/min. I was still getting REST failures, so I decided to slow it down to only process one flowfile/five minutes. (Yeah, I know ... it's a terrible rest service), I'm experimenting...
I then experienced that my entire flow was hanging: I found the following log message was looping: 2021-05-12 14:44:10,896 INFO [Timer-Driven Process Thread-4] o.a.n.c.repository.FileSystemRepository Unable to write to container default due to archive file size constraints; waiting for archive cleanup I noticed that the conf/archive directory gotten to be 512MB, the size of the nifi.flow.configuration.archive.max.storage setting in nifi.properties, which appeared to have been my problem. Sure enough, deleting some old archive files appeared to have given me some extra space. What I don't understand is what the archive directory is used for/ how to administer it. Can anyone explain what I experienced? Do I just need to bump up storage? How does the archive work exactly? I thought the archive was only used when editing a flow, not when RUNNING the flow. -Geoff
