Re: Get all available variables in the InvokeScriptedProcessor

Thanks Andy, but with expression language I can only get values of attributes and not both key and value. In our case , variable key also has some useful information. Thanks On Mon, Aug 10, 2020 at 10:32 PM Andy LoPresto wrote: > Those variables are available to be referenced via Expression

Re: Data Provenance Stops Working

Ah! That fixed my problem! I am running a secure/authenticated configuration. My user had the correct policy permissions when viewed from the hamburger menu, but not on the access-policies for the individual processors/canvas. Very confusing! One would think if the admin user had the

Re: Data Provenance Stops Working

That sounds like a permission issue. Are you running in secure mode? If so right click on the main canvas and go to access policies and make sure your current user is allowed provenance access, you’ll also have to go to the policies section in the system menu in the upper right hand corner and

Re: Data Provenance Stops Working

I also use 1.11.4 and out of the box there IS NO provenance data whatsoever. It just doesn't work if you install and run nifi as is. Sent from my Verizon, Samsung Galaxy smartphone Get Outlook for Android From: Shawn Weeks Sent: Monday,

Re: Data Provenance Stops Working

It sounds like if I expand the retention time a lot, say 30 days the issue should be less bad? Thanks Shawn From: Mark Payne Reply-To: "users@nifi.apache.org" Date: Monday, August 10, 2020 at 12:37 PM To: "users@nifi.apache.org" Subject: Re: Data Provenance Stops Working Shawn / Wyll, I

Re: Data Provenance Stops Working

Which I hope to have RC1 of 1.12 up today to start the review/vote process. If you two (Shawn, Wyll) could test it against what you're seeing it would be very helpful! Thanks On Mon, Aug 10, 2020 at 10:43 AM Mark Payne wrote: > OK, so that would be indicative of NIFI-7346. So the data is

Re: Data Provenance Stops Working

OK, so that would be indicative of NIFI-7346. So the data is being written into the ether, and then it’s being indexed by Lucene (which is why you see the data being written to that Lucene subdirectory). But even when you search, it can’t find the event files themselves. So this should all be

Re: Data Provenance Stops Working

Great, thanks! Looking forward to trying it out on 1.12 I can't see any provenance data with either method (right-click on processor or hamburger menu). When I login to the server, I do see data being written to the provenance_repository directory in a sub-dir that looks like

Re: Data Provenance Stops Working

Shawn / Wyll, I think you’re probably running into NIFI-7346 [1], which basically says there’s a case in which NiFi may “age off” old data even when it’s still the file that’s being actively written to. In Linux/OSX this results in simply deleting the file, and then anything else written to it

Re: Data Provenance Stops Working

shawn - i believe it is related to our default settings and have phoned a friend to jump in here when able. but default retention and default sharding i *think* can result in this. You can generate a thread dump before and after the locked state to see what it is stuck/sitting on. That will help

Re: Data Provenance Stops Working

Out of the box even the initial admin user has to be granted permission I think, mine worked fine for several months since 1.11.1 was released and just started having an issues a couple of weeks ago. I’ve increasing the retention time a bit to see if that improves the situation a bit. Thanks

Re: Data Provenance Stops Working

I run 1.11.4 in a cluster on AWS also and have a similar issue with the provenance data, I can't ever view it. It's probably somehow misconfigured but I haven't been able to figure it out. From: Andy LoPresto Sent: Monday, August 10, 2020 1:11 PM To:

Re: Data Provenance Stops Working

Shawn, I don’t know if this is specifically related, but there were a number of critical issues discovered in the 1.11.x release line that have been fixed in 1.11.4. I would not recommend running any prior version on that release line. 1.12.0 should be coming imminently, so if you are going

Re: Get all available variables in the InvokeScriptedProcessor

Those variables are available to be referenced via Expression Language in the flowfile attributes. They are not intended for direct programmatic access via code, so you don’t need to address them directly in your Groovy code. If you need to populate specific values at configuration time, you

Data Provenance Stops Working

I’m running a three node NiFi Cluster on AWS EC2s using integrated Zookeeper and SSL Enabled. Version is 1.11.1, OS is RedHat 7.7, Java is 1.8.0_242. For some reason after a period of time Data Provenance goes blank, old records are no longer queryable and new data provenance doesn’t appear to

R: [EXT] Re: No available buckets on Nifi

Hi Bryan, thank you very much for the suggest! I’ve solved my problem. It was what you were telling about, proxy user. I’ll wirte something, just to help someone else that can have the same problem in the future. So, on nifi registry I’ve added a user with the exact name present into machine

Re: No available buckets on Nifi

Hello, You most likely need to setup the proxy permissions for the nifi nodes so that they are authorized to proxy requests to nifi registry. This video has a good description of doing that - https://www.youtube.com/watch?v=DSO12fhnZ90 Thanks, Bryan On Mon, Aug 10, 2020 at 5:56 AM Andrea

Re: External Access using InvokeHTTP_Test processor and StandardSSLContextService

Hi Andy, Many thanks for your reply. I just tried the old workflow with NiFi 1.10 and it works. Just realized that the NiFi 1.11 runs behind Traefik so I might need to account for that in the processor settings, right? Thanks Valentina From: Andy LoPresto

No available buckets on Nifi

Hi all, I have installed nifi-1.11.4 and nifi-registry-0.6.0 on the same machine, both secured, and we have a problem with buckets: it seems that Nifi is not able to find any bucket on nifi registry. I'm able to understand that nifi is able to reach nifi registry (we don't have any SSL