Re: java.lang.OutOfMemoryError: Java heap space : NIFI 1.23.2

2024-03-19 Thread e-sociaux
Hello Joe,   Thanks for the response. But I found the solution.    Like the table size is around 7,6GB (avro) for 161000 rows  And I setup Fetch size : 20 so the processor ExecuteSQL try to fetch all datas.   Like the heap size is setup to 8GB I have reduced the "Fetch Size" to 1

Re: java.lang.OutOfMemoryError: Java heap space : NIFI 1.23.2

2024-03-19 Thread Matt Burgess
Specifically set Fetch Size to something like 1000, by default setting Fetch Size to zero will cause Postgres to fetch the entire ResultSet into memory [1]. We should probably change that default to avoid problems like this and with other drivers (for example, Oracle's default is 10 rows which is

Re: java.lang.OutOfMemoryError: Java heap space : NIFI 1.23.2

2024-03-19 Thread Joe Witt
Hello The key output is java.lang.OutOfMemoryError: Java heap space Review batch property options to limit response sizes in the database calls. Thanks On Tue, Mar 19, 2024 at 6:15 AM wrote: > Hello > > I got the executeSQL processor does the sql command "select * from > public.table1" >

java.lang.OutOfMemoryError: Java heap space : NIFI 1.23.2

2024-03-19 Thread e-sociaux
Hello    I got the executeSQL processor does the sql command "select * from public.table1" It is a postgresql database.   Here the end of properties of processor.   Max Wait Time 0 seconds Normalize Table/Column Names false Use Avro Logical Types false Compression Format NONE