Re: Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

2020-08-13 Thread sanjeet rath
Hi Mark, Thanks for the response. My flow.xml.gz file size is 14 Mb. Regards, Sanjeet On Thu, 13 Aug 2020, 10:27 pm Mark Payne, wrote: > Actually, I take back what I said. I was a little too quick to jump to > conclusions about what the issue was. There was an issue addressed that > should imp

Re: Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

2020-08-13 Thread Mark Payne
Actually, I take back what I said. I was a little too quick to jump to conclusions about what the issue was. There was an issue addressed that should improve startup time. But what you’re seeing here is unrelated, as you’re enchanting OutOfMemoryError. The long time is likely related to garbage

Re: Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

2020-08-13 Thread Mark Payne
Sanjeet, I believe this should be addressed in 1.12.0, which should be released very soon. Thanks -Mark On Aug 13, 2020, at 4:13 AM, sanjeet rath mailto:rath.sanj...@gmail.com>> wrote: Hi Team, I have migrated my flows.xml.gz, users.xml, authorization.xml from 1.8 env to 1.11.4 environment

Re: Nifi takes too long to start(~ 30 minutes)

2020-08-13 Thread Joe Witt
...true and I believe that has also been improved. But could be wrong on that. On Thu, Aug 13, 2020 at 9:26 AM Brandon DeVries wrote: > Mohit, > > How many flowfiles are currently on the instance? Sometimes a very large > number of flowfiles can result in slower start times. > > Brandon > > --

Re: Nifi takes too long to start(~ 30 minutes)

2020-08-13 Thread Brandon DeVries
Mohit, How many flowfiles are currently on the instance? Sometimes a very large number of flowfiles can result in slower start times. Brandon From: Pierre Villard Sent: Thursday, August 13, 2020 12:10:51 PM To: users@nifi.apache.org Subject: Re: Nifi takes to

Re: Nifi takes too long to start(~ 30 minutes)

2020-08-13 Thread Pierre Villard
Hi, I'm surprised this is something you observe in the election process part. I've constantly seen quick startup times even with thousands of components in the flow. I'd look into the logs and maybe turn on some debug logs to find out what's going on. Pierre Le jeu. 13 août 2020 à 16:33, Joe Wit

Re: Nifi takes too long to start(~ 30 minutes)

2020-08-13 Thread Joe Witt
Mohit, You almost certainly want to take that same flow and setup a cluster on a more recent version of NiFi to compare startup times. For flows with thousands of components there are important improvements which have occurred in the past year and a half. Startup time, user perceived behavior in

Nifi takes too long to start(~ 30 minutes)

2020-08-13 Thread Mohit Jain
Hi Team, I am using a single node NiFi 1.9.0 cluster. It takes more than 30 minutes to start each time it is restarted. There are more than 100 flows on the NiFi UI with an average of 25 processors per flow. It takes around 25-30 minutes to reach the cluster election process after which it gets st

Re: FetchSFTP Failed to fetch content for StandardFlowFileRecord

2020-08-13 Thread Valentina Ivanova
Hi Joe, Many thanks for pointing this out. Right now, I am implementing the case when files are already there when reading. Next step will be to implement both sending and receiving processes. I implemented the retry loop and it works perfectly. Thanks for all suggestions and comments! Valent

LDAP Integration (ldap-provider) Issue

2020-08-13 Thread muhyid72
Dear All, I am encountering issue with LDAP integration. 1. I have completed LDAP configuration (ldap-provider) according to documentation. 2. I added IU certificate and configured other pieces of the MS AD LDAP integration (authorizers.xml, login-identity-providers.xml and nifi.properties). 3.

Re: InvokeGRPC with External Proto

2020-08-13 Thread Chris Nicholas
Mike, Bryan - thanks for the info and the offer of help exploring self describing messages - I’ll leave the JIRA ticket for the time being to avoid wasting your time, but if we proceed with development I’ll get back in touch / contribute wherever possible. Thanks, Chris > On 12 Aug 2020, at 2

Nifi 1.11.4 three node cluster is taking longer time to up after migration from 1.8

2020-08-13 Thread sanjeet rath
Hi Team, I have migrated my flows.xml.gz, users.xml, authorization.xml from 1.8 env to 1.11.4 environment .(12k processor are therr in flow) There are no error in the log file, the issue is taking 10 mintues to server up and with all node connected. The warning logs , which i am suspecting is cau