Hello all,
We got a cluster with 10 nodes (4CPU/16Go) - NIFI 1.25 - jdk-11.0.19
We use this cluster to send the datas to GCP bucket, the datas are sent by others clusters, so we do S2S betweens them.
I can't determine where is the issue. This message could by raise by EvaluateJsonPath/ExecuteGroovyScript/UpdateAttribute
We have around 100.000 flowfiles (160Go datas)
We need configure more than 1 tasks for each processor to run more faster but we have always this error
- Caused by: java.io.IOException: Cannot update journal file /data/nifi/flowfile_repository/journals/130511810.journal because this journal has already encountered a failure when attempting to write to the file. If the repository is able to checkpoint, then this problem will resolve itself. However, if the repository is unable to be checkpointed (for example, due to being out of storage space or having too many open files), then this issue may require manual intervention. - Caused by: java.lang.OutOfMemoryError: Java heap space
Could you give me some informations to find the root cause ?
Thanks
Minh
