Re: JOLTTransformRecord problem

2023-10-11 Thread Chris Sampson
You could use an AvroWriter to output the results of the JoltTransformRecord - it doesn’t need to be JSON (in or out), that’s one of the great things of NiFi’s Record processors - if there’s a Reader and Writer in the format you want, you can use that data and the Writer doesn’t need to be the

Re: JOLTTransformRecord problem

2023-10-11 Thread Mark Woodcock
Chris, 1) well, reassuring to learn that I've found an actual bug; and pleasing to know that I constructed an effective and illuminating test. hurrah. 2) So, I can certainly use the ReplaceText (is there a better choice?) processor to ditch any field that looks like "whatever": "", (and I

Question on the NiFi processor UpdateAttribute

2023-10-11 Thread E M
In the processor there is a field for Delete Attributes Expression which supports Regular Expression patterns. I'm trying to use a negative look ahead in order to get rid of a lot of attributes. Rather than to try and type out 50+ other attributes I don't want I want to use negative lookahead in

Re: JOLTTransformRecord problem

2023-10-11 Thread Chris Sampson
FYI - original thread in the archives for reference [1]. Thanks for your more complete example, this does indeed fail with the error you indicate. I think it’s related to NIFI-8135 [2], which identified a deficiency in the way Records are converted to Java Maps, particularly where CHOICE types