Dave, When you say that the journal files are huge, I presume you mean the FlowFile repository?
There are generally 4 things that can cause this: - OutOfMemoryError causing the FlowFile repo not to properly checkpoint - Out of Disk Space causing the FlowFile repo not to properly checkpoint - Out of open file handles causing the FlowFile repo not to properly checkpoint - Creating a lot of huge attributes on your FlowFiles. The first 3 situations can be identified by looking for errors in the logs. For the third one, you need to understand whether or not you’re creating huge FlowFile attributes. Generally, attributes should be very small - 100-200 characters or less, ideally. It’s possible that you have a flow that creates huge attributes but the flow is only running on the Primary Node, and Node 2 is your Primary Node, which would cause this to occur only on this node. Thanks -Mark > On Mar 7, 2024, at 9:24 PM, David Early via users <users@nifi.apache.org> > wrote: > > I have a massive issue: I have a 2 node cluster (using 5 external zookeepers > on other boxes), and for some reason on node 2 I have MASSIVE journal files. > > I am round robbining data between the nodes, but for some reason node 2 just > fills up. This is the second time this has happened this week. > > What should I do? nifi.properties are the same on both systems (except for > local host names).. > > Any ideas of what might be causing one node to overload? > > Dave > >
