RE: DeleteHDFS behavior when idle

2023-06-12 Thread Isha Lamboo
juni 2023 16:10 Aan: dev@nifi.apache.org Onderwerp: Re: DeleteHDFS behavior when idle The processor has @TriggerWhenEmpty so it is going to keep executing regardless of whether the incoming queue has data or not. I believe this was done early on for some processors that used Kerberos in order to

Re: DeleteHDFS behavior when idle

2023-06-12 Thread Bryan Bende
The processor has @TriggerWhenEmpty so it is going to keep executing regardless of whether the incoming queue has data or not. I believe this was done early on for some processors that used Kerberos in order to allow the processor to have a chance to renew the Kerberos ticket, however we since move

Re: DeleteHDFS behavior when idle

2023-06-12 Thread Mark Payne
Isha, If you have an incoming connection, and you’re seeing this, then it’s a bug. If there is no incoming connection and this processor is used as a source processor, it’s normal. Either way, it has rather little overhead, and you can further reduce the overhead by increasing the Yield Duratio

DeleteHDFS behavior when idle

2023-06-12 Thread Isha Lamboo
Hi all, I have a question about behavior I see on one of our NiFi 1.18 clusters that has a lot of xHDFS processors. When I look at the number of tasks in the summary, the DeleteHDFS processors have a very high number (800-1000+) of tasks even if they have nothing in their incoming queues. The P