[ https://issues.apache.org/jira/browse/NIFI-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477120#comment-17477120 ]
mayki commented on NIFI-9572: ----------------------------- [~joewitt] thanks for your comment but I'm already check these things: {code:java} -bash-4.2$ id uid=1001(nifi) gid=1001(nifi) groups=1001(nifi) -bash-4.2$ ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 63278 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 50000 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 10000 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited -bash-4.2$ ps -ef|grep nifi nifi 2317374 1 0 11:39 ? 00:00:00 /bin/sh /appl/nifi/nifi-current/bin/nifi.sh start nifi 2317376 2317374 0 11:39 ? 00:00:03 /appl/pkg/jdk-1.8.0_311/bin/java -cp /appl/nifi/nifi-1.15.2/conf:/appl/nifi/nifi-1.15.2/lib/bootstrap/* -Xms12m -Xmx24m -Dorg.apache.nifi.bootstrap.config.log.dir=/logs/nifi -Dorg.apache.nifi.bootstrap.config.pid.dir=/var/run/nifi -Dorg.apache.nifi.bootstrap.config.file=/appl/nifi/nifi-1.15.2/conf/bootstrap.conf org.apache.nifi.bootstrap.RunNiFi start nifi 2317425 2317376 57 11:39 ? 00:05:02 /appl/pkg/jdk-1.8.0_311/bin/java -classpath /appl/nifi/nifi-current/conf:/appl nifi/nifi-current/lib/javax.servlet-api-3.1.0.jar:/appl/nifi/nifi-current/lib/jetty-schemas-3.1.jar:/appl/nifi/nifi-current/lib/logback-classic-1.2.9.jar:/appl/nifi/nifi-current/lib/logback-core-1.2.9.jar:/appl/nifi/nifi-current/lib/jcl-over-slf4j-1.7.32.jar:/appl/nifi/nifi-current/lib/jul-to-slf4j-1.7.32.jar:/appl/nifi/nifi-current/lib/log4j-over-slf4j-1.7.32.jar:/appl/nifi/nifi-current/lib/slf4j-api-1.7.32.jar:/appl/nifi/nifi-current/lib/nifi-api-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-framework-api-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-server-api-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-runtime-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-nar-utils-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-properties-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-property-utils-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-stateless-bootstrap-1.15.2.jar:/appl/nifi/nifi-current/lib/nifi-stateless-api-1.15.2.jar -Dorg.apache.jasper.compiler.disablejsr199=true -Xmx8192m -Xms8192m -Djavax.security.auth.useSubjectCredsOnly=true -Djava.security.egd=file:/dev/urandom -Dzookeeper.admin.enableServer=false -Dsun.net.http.allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Djava.protocol.handler.pkgs=sun.net.www.protocol -Dnifi.properties.file.path=/appl/nifi/nifi-current/conf/nifi.properties -Dnifi.bootstrap.listen.port=20995 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=/logs/nifi org.apache.nifi.NiFi -K /appl/nifi/nifi-current/conf/sensitive.key {code} During running : {code:java} -bash-4.2$ lsof -p 2317425 | wc -l 7139 -bash-4.2$ ls -l /proc/2317425/fd | wc -l 3618 {code} > Failed to index Provenance Events and (Too many Files) > ------------------------------------------------------ > > Key: NIFI-9572 > URL: https://issues.apache.org/jira/browse/NIFI-9572 > Project: Apache NiFi > Issue Type: Bug > Components: Core UI > Affects Versions: 1.15.2 > Reporter: mayki > Priority: Major > > Hello > I have upgraded NIFI 1.15.2 since 2022/01/05 > No issue until this night 2022/01/13 > * nifi version 1.15.2 > * jdk-1.8.0_311 > And the limit is high > {code:java} > Last login: Fri Jan 14 09:57:06 CET 2022 on pts/2 > -bash-4.2@nifi$ ulimit -a > core file size (blocks, -c) 0 > data seg size (kbytes, -d) unlimited > scheduling priority (-e) 0 > file size (blocks, -f) rg > pending signals (-i) 63278 > max locked memory (kbytes, -l) 64 > max memory size (kbytes, -m) unlimited > open files (-n) 50000 > pipe size (512 bytes, -p) 8 > POSIX message queues (bytes, -q) 819200 > real-time priority (-r) 0 > stack size (kbytes, -s) 8192 > cpu time (seconds, -t) unlimited > max user processes (-u) 10000 > virtual memory (kbytes, -v) unlimited > file locks (-x) unlimited > {code} > > We got a lot error about provenance_repository, it fill our filesystem logs .. > > {code:java} > 2022-01-14 10:19:00,963 ERROR [Index Provenance Events-2] > o.a.n.p.index.lucene.EventIndexTask Failed to index Provenance Events > org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed > at > org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:877) > at > org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:891) > at > org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1468) > at > org.apache.lucene.index.IndexWriter.addDocuments(IndexWriter.java:1444) > at > org.apache.nifi.provenance.lucene.LuceneEventIndexWriter.index(LuceneEventIndexWriter.java:70) > at > org.apache.nifi.provenance.index.lucene.EventIndexTask.index(EventIndexTask.java:202) > at > org.apache.nifi.provenance.index.lucene.EventIndexTask.run(EventIndexTask.java:113) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > at java.lang.Thread.run(Thread.java:748) > Caused by: java.nio.file.FileSystemException: > /data/nifi/provenance_repository/lucene-8-index-1642145908399/_4_Lucene80_0.dvd: > Too many open files > {code} > > > We expect upgrade all nifi instances to 1.15.2 to avoid log4j vulnerability. > But it is impossible to do that if we got this error. > > Thanks for you help. > > Regards > > > -- This message was sent by Atlassian Jira (v8.20.1#820001)