Re: [Bug] Duplicate Flow Import From Registry

2020-12-10 Thread Joe Witt
Eric, This is simply NiFi on your laptop (single node?) talking to a Registry running on some IaaS infrastructure? There is no load balancer/proxy/etc.. in between ? Thanks On Thu, Dec 10, 2020 at 4:17 PM Eric Secules wrote: > Hello everyone, > > My team is encountering a bug where we import

Re: Need help setting up NiFi PutS3Object processor

2020-12-10 Thread Peter Turcsanyi
Dennis, You can add user-defined metadata via dynamic properties of PutS3Object itself (no UpdateAttribute needed). Plus (+) icon at the top-right corner on the processor properties tab. The name of the dynamic property will be the key (or name) of the user-defined metadata. The value of the dynam

[Bug] Duplicate Flow Import From Registry

2020-12-10 Thread Eric Secules
Hello everyone, My team is encountering a bug where we import a flow from our registry residing in the cloud to our laptops. The import takes a long time and we end up with multiple copies (about 6) of the same flow one on top of each other on the canvas. The canvas becomes unresponsive and we are

Need help setting up NiFi PutS3Object processor

2020-12-10 Thread Dennis N Brown
Running NiFi v1.12.1 , attempting to copy files from existing filesystem to S3. Trying to set user-defined metadata on the file objects, but can't seem to figure out the correct format. All the doc suggests it can be done with dynamic properties, so have an UpdateAttribute processor before the

Re: How to disconnect rabbitmq in PublishAMQP

2020-12-10 Thread Peter Turcsanyi
Hi Franco, If I understand your use case correctly, you do not ingest data continuously and would like PublishAMQP to disconnect after an idle period (when there are no messages to send to RabbitMQ). PublishAMQP is rather optimized for continuous / frequent data load and for this reason it pools t

ExecuteScript Concurrent Tasks

2020-12-10 Thread Noe Detore
Hello, Concurrent tasks increased using ExecuteScript or InvokeScriptedProcessor with python/jyphon to update content has no increased throughput. If I copy the processor and run the 2 in parallel the amount of data processed does not increase. Any explanation for this? Is there a system-wide sett

How to debug 500 error in nifi-api /controller-services method

2020-12-10 Thread Mike Thomsen
I set the root logger to debug in logback.xml, and I'm still not seeing any stacktraces in nifi-app.log. Is there something else I need to update? Thanks, Mike

Re: Utilizing NetflowV9 in NiFi v1.12.1

2020-12-10 Thread alex goos
Hi IMHO, since most of the "interesting" fields in NetflowV9 are somehow Vendor-specific, you'll be unlikely to find a generic NiFI-Processor, complete and ready-to-use. We ended up writing a NiFi processor from scratch with different "dialect" settings per Netflow-generating device family, only

GUI functions not available in secure / cluster instance

2020-12-10 Thread Etienne Jouvin
Hello all. Strange behaviour on the GUI. For background, I have 3 nodes in cluster. Authentication based on LDAP. Groups based also on LDAP. In nifi.properties nifi.security.allow.anonymous.authentication=false And with this, when I want to access the advanced setting of UpdateAttribute : [image

Re: ForkRecord 1.12.0 duplicates flowfiles

2020-12-10 Thread Pierre Villard
No worries, glad you sorted it out and let us know. Pierre Le jeu. 10 déc. 2020 à 11:59, muneti a écrit : > Thanks, Pierre. > > When I have reproduced the behaviour in a simple template, i have realized > the mistake was mine: I had two overlapped success queues at the fork > processor input!!

Re: ForkRecord 1.12.0 duplicates flowfiles

2020-12-10 Thread muneti
Thanks, Pierre. When I have reproduced the behaviour in a simple template, i have realized the mistake was mine: I had two overlapped success queues at the fork processor input!! Thanks and sorry for the inconvenience. Guillermo. -- Sent from: http://apache-nifi-users-list.2361937.n4.nabble.c

Re: Utilizing NetflowV9 in NiFi v1.12.1

2020-12-10 Thread Pierre Villard
Hi, I'm aware of some people using NiFi for that but I believe they're using NARs available from external Github repositories. We don't have anything packaged OOTB in NiFi itself. For example https://github.com/simonellistonball/nifi-netflow Thanks, Pierre Le mar. 8 déc. 2020 à 20:43, Thane Dure