Re: Nifi flowfile monitoring

2023-01-10 Thread Guillermo Muñoz
Hi, We have a seven nodes cluster with 1.16.3. We haven't been able to reproduce it. We just know that only it happens in the same nodes of the cluster, but we havent seen any difference between them. All the processor groups have only one input port and one output port. We have single batch per

Re: Nifi flowfile monitoring

2023-01-09 Thread Pierre Villard
Hi, We should figure out why this happens as it should not. Which version are you using? Is it something you've been able to reproduce? How are flow files getting into the process group, and how are they going out? Multiple input ports? Multiple output ports? Also you configured "Batch" for the

Re: Nifi flowfile monitoring

2023-01-09 Thread Guillermo Muñoz Salgado
Hi, Sometimes we have flowfiles stuck without reason in queues before out ports in consumer groups with batch output flowfile concurrency configured. We don't know why, and we haven't been able to find out where the problem is. So our operation teams has to check periodically, and change the

Re: Nifi flowfile monitoring

2023-01-02 Thread Pierre Villard
I think it'd be good to take a step back. How can a flow file get stuck in a relationship? 1 - Is it because you have a self loop failure relationship? 2 - Is it because you have "dead ends" with a failure relationship going to a funnel? 3 - or is it because a flow file is failing and is being

Re: Nifi flowfile monitoring

2022-12-31 Thread Jorge Machado
Activate prometheus exporter and you will have a metric for number of objects in the queue > On 31. Dec 2022, at 07:08, nayan sharma wrote: > > Hi Users, > Is there anyway through which I can monitor or raise alert if any flow file > got stuck in nifi queue. > > For now operation team

Nifi flowfile monitoring

2022-12-30 Thread nayan sharma
Hi Users, Is there anyway through which I can monitor or raise alert if any flow file got stuck in nifi queue. For now operation team needs to manually check for these. If you can suggest way through which I can achieve this that would be great. Thanks, Nayan -- Thanks & Regards, Nayan Sharma