My team designed a NiFi flow to handle CSV files of size around 15GB. But
later we realised that files can be upto 500 GB. I set the queue size limit
to 25GB. This is a one time data load to S3. I'm converting each CSV file
to parquet in NiFi using a convert record processor. What happens in these
I put dots in there...its just 261 or later than 271.
if you have oracles i think latest is 271 and you should downgrade.
thanks
On Tue, Dec 15, 2020 at 6:41 AM Joe Witt wrote:
> Hello
>
> I recommend downgrading the jvm to 2.6.1 or upgrading to after 2.7.1.
>
> It is a known issue with that j
Hello
I recommend downgrading the jvm to 2.6.1 or upgrading to after 2.7.1.
It is a known issue with that jvm.
thanks
On Tue, Dec 15, 2020 at 6:35 AM Marel, J. van der (Jasper) <
jasper.van.der.ma...@ing.com> wrote:
> Hi,
>
>
>
> I am using this java version :
>
>
>
> java -version
>
> java ve
Hi,
I am using this java version :
java -version
java version "1.8.0_271"
Java(TM) SE Runtime Environment (build 1.8.0_271-b25)
Java HotSpot(TM) 64-Bit Server VM (build 25.271-b25, mixed mode)
From: Joe Witt
Sent: dinsdag 15 december 2020 14:34
To: users@nifi.apache.org
Subject: Re: Nifi 1.1.14
No known leak.
Which JVM are you using?
On Tue, Dec 15, 2020 at 6:18 AM Marel, J. van der (Jasper) <
jasper.van.der.ma...@ing.com> wrote:
> Hi,
>
>
>
> I have installed nifi 1.1.14 on a CentOS7 machine. Ulimits are set to
> 5 open files for the user.
>
> However after a while a lot of open f
Hi,
I have installed nifi 1.1.14 on a CentOS7 machine. Ulimits are set to 5
open files for the user.
However after a while a lot of open files are reported, mostly related to an
increasing number of sockets. The Apache nifi canvas is almost blank.
Is this a know issue ?
Version : nifi_3_5_1
