[ https://issues.apache.org/jira/browse/NIFI-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517010#comment-17517010 ]
ASF subversion and git services commented on NIFI-9820: ------------------------------------------------------- Commit daafd08aaebb3c4fcf149e25999d869b9fe94d3c in nifi's branch refs/heads/support/nifi-1.16 from David Handermann [ https://gitbox.apache.org/repos/asf?p=nifi.git;h=daafd08aae ] NIFI-9820 Reduced Kudu Client Worker Count default setting - Changed default Kudu Client Worker Count to number of runtime-reported available processors Signed-off-by: Joe Gresock <jgres...@gmail.com> This closes #5886. > Change PutKudu Property "Kudu Client Worker Count" Default Value > ---------------------------------------------------------------- > > Key: NIFI-9820 > URL: https://issues.apache.org/jira/browse/NIFI-9820 > Project: Apache NiFi > Issue Type: Improvement > Components: Core Framework > Affects Versions: 1.15.3 > Reporter: Josef Zahner > Assignee: David Handermann > Priority: Minor > Fix For: 1.17.0, 1.16.1 > > Time Spent: 20m > Remaining Estimate: 0h > > The PutKudu processor property "Kudu Client Worker Count" has a suboptimal > value. Please don't use the current "number of CPUs multiplied by 2" > behaviour as it leads to a massive amount of workers in our case with > physical servers. We have a 8-node cluster where each server has 64 CPUs. We > have about 30 PutKudu processors configured -> a lot of worker threads per > default just for kudu. > We have changed the number of worker threads in our case to the number of > concurrent tasks. I don't know, maybe it would be great to set it a bit > higher than that, but to be honest, I don't exactly understand the impact. It > looks still fast with the current config. > *To sum it up, please set a low default value (eg. 4 or 8) for the property > "Kudu Client Worker Count" and not a pseudo dynamic one for the PutKudu > processor.* > Btw. are there any suggestions how big the number should be? -- This message was sent by Atlassian Jira (v8.20.1#820001)