Fork-Join Enrichment, Input Dependent Behaviour

HI, I seem to have a situation similar to [NIFI-9903], this time in the JoinEnrichment processor. I am performing some enrichments, and sometimes the enrichment look up fails as the item is not there. If the enrichment fails for the first item i

RE: Multiple GitLab accounts? (Nifi Registry)

You can have multiple registries, so you could put the buckets for the second account in a different registry, if that suits your use case. Steve Hindmarch From: Jakobsson Stefan Sent: 16 June 2022 11:27 To: users@nifi.apache.org Subject: RE: Multiple GitLab accounts? (Nifi Registry) The is ex

RE: batch job state tracking

The traditional way is to maintain some kind of metadata or log table in the same database you are reading from or writing to, whichever makes sense. With NiFi you can use PutSQL and GetSQL as Isha describes, or make use of the various cache services. Steve Hindmarch From: Isha Lamboo Sent: 1

RE: Unexpected Behaviour In LookupRecord With "Route To success" Strategy

Thanks Mark, Is there a JIRA open for this? Regards Steve From: Mark Payne Sent: 11 April 2022 14:34 To: users@nifi.apache.org Subject: Re: Unexpected Behaviour In LookupRecord With "Route To success" Strategy Steve, Thanks for the note. Ironically, I ran into this issue just yesterday. Un

Unexpected Behaviour In LookupRecord With "Route To success" Strategy

Hi all, I am trying to set up a simple enrichment pipeline where flow records get enriched from a Redis Distributed Map cache and I use a sequence of LookupRecord processors to gather the enrichment data. I am using the "Route to success" routing strategy because I would like to avoid fragmenti

Return JSON From Redis Lookup

Hi all, I am trying to enrich a JSON record payload with some extra JSON stored on a Redis server by doing a LookupRecord, backed up with a DistibutedMapCacheLookupService, RedisDistributionMapCacheClientService and a RedisConnectionPoolService. The JSON is stored as a string which I load into

RE: QueryRecord with Union type

Mark, I am using a Docker image of apache/nifi:latest which I pulled about 2 months ago. Image ID 0070c5c5d9fd. From the UI it says tag 1.15.3-RC1 and commit 753c311. I am guessing it must be this: GitHub - apache/nifi at nifi-1.15.3-RC1. Ju

RE: QueryRecord with Union type

Mark, Thank you for your response. I thought that was probably the case, but I tried a cast and it did not work. I got this error. Query: select * from flowfile where cast(flag_s as boolean) = true Error: org.apache.calcite.sql.validate.SqlValidatorException: Cast function cannot convert value

QueryRecord with Union type

I am having a play with QueryRecord to do some filtering but I have run across this problem. I have a schema for my records which includes a union type, so the relevant part of the schema is { "type":"record", "namespace":"blah", "name":"SimpleTraffic", "fields":[ {"name":"src_addres

RE: Records - Best Approach to Enrich Record From Cache

Redis does allow multiple gets in the one hit with MGET. If you search for all keys the response is an ordered list of matching values, with null in place where there is no match. Steve Hindmarch From: Nick Lange Sent: 07 March 2022 04:46 To: users@nifi.apache.org Subject: Records - Best Appro