Ryan Hendrickson created NIFI-10823:
---------------------------------------

             Summary: Backpressure Queue - Properties file vs. Canvas update, 
Properties file not respected.
                 Key: NIFI-10823
                 URL: https://issues.apache.org/jira/browse/NIFI-10823
             Project: Apache NiFi
          Issue Type: Bug
            Reporter: Ryan Hendrickson
            Assignee: Mark Payne


I assigned this to Mark so he'd take notice since we were chatting about this 
on the Apache NiFi Slack Channel: 
[https://apachenifi.slack.com/archives/C0L9VCD47/p1668546036757219]

We have been setting the following two nifi.properties for quite some time... 
 * nifi.queue.backpressure.count=20000
 * nifi.queue.swap.threshold=20000

Today we updated the dataflow on with a NiFi that can have a huge amount of 
FlowFiles queue up if backpressure isn't set correctly.  We realized that the 
new relationships drawn on the canvas did not inherit the 
nifi.queue.backpressure.count set in nifi.properties. (Discussion on Slack)

Hunting back, it looks like NIFI-8195 in NiFi 1.14.0 attempted to Migrate 
backpressure settings from nifi.properties to the Process Groups in the UI.

 
 # It looks like in the Pull Request, it was intended to read the 
nifi.properties file value and set that to the root process group value.
 ## [https://github.com/apache/nifi/pull/5192,]
 ## "verified the default values of the added elements are “0 sec” for FlowFile 
Expiration, and obtained from nifi.properties for back pressure settings" and
 ## "The backpressure defaults from nifi.properties should only be used when at 
the root level"
 # The Migration Guidance from 1.14.0 doesn't say anything about the 
nifi.properties `nifi.queue.backpressure.count` no longer being used.  
[https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance]
 # The core properties still have it listed: 
[https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#core-properties]
 

 

Version: Apache NiFi 1.16.3 Stanealone and Cluster



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to