RE: Converting Records

2021-02-28 Thread nathan.english
Hey Mark, The Validate Record Processor was what I was looking for! As we are using the _0_10 version of the produce record processor, we don’t seem to have any of the transactional properties listed? I’m guessing this is on the newer Kafka API processors? Kind regards, Nathan From: Mark

Re: NiFI fronend disconnects after some time

2021-02-28 Thread Vibhath Ileperuma
Hi, I have configured heap size to 25GB On Mon, 1 Mar 2021, 12:18 pm Jorge Machado, wrote: > How much memory do you have on your instance? > I would say the fetch size should be bigger then the Max Rows… > > > On 1. Mar 2021, at 06:37, Vibhath Ileperuma > wrote: > > Hi all, > > I tried to

Re: NiFI fronend disconnects after some time

2021-02-28 Thread Jorge Machado
How much memory do you have on your instance? I would say the fetch size should be bigger then the Max Rows… > On 1. Mar 2021, at 06:37, Vibhath Ileperuma > wrote: > > Hi all, > > I tried to fetch a large dataset from postgresql using the ExcureSQL > processor. > The configurations I

NiFI fronend disconnects after some time

2021-02-28 Thread Vibhath Ileperuma
Hi all, I tried to fetch a large dataset from postgresql using the ExcureSQL processor. The configurations I used is, Fetch Size : 100 Max Rows per flow file 20 Output Batch Size 1 When I start the processor, after some time, NIFI web frontend disconnects. I checked the app log, but there

Peers list empty for older Nifi instances

2021-02-28 Thread Simon
Hi I'm in the process of transitioning an old version of Nifi (0.6.1) to the latest version (have tried 1.12 and now 1.13). When setting up a remote process group to another instance ( have tried to a standalone 0.6.1 instance and a clustered 0.7.1 instance), the flow files will just sit in the