[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17458680#comment-17458680 ] Jason Zondor commented on NIFI-8541: We ran into something similar. We learned that linux (RHEL) counts tcp sockets as open file descriptors and a new flow we had developed was "holding" open tcp sessions. We ended up tuning linux's network settings to time out and kill tcp sessions that were truly idle. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344307#comment-17344307 ] thang nguyen dinh commented on NIFI-8541: - thank [~joewitt], I will create new Jira to describe the ListFTP problem i got. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344033#comment-17344033 ] Joe Witt commented on NIFI-8541: Ok.lets maybe slow down a bit and focus on the specific problem statement of what you need to solve rather than the symptoms you might be seeing. "ListFTP processor on centos 7 cluster. It work well before can not list file." That appears to be the root issue that led you to look at other aspects. I see no sign of a real leak yet. The lsof -p output is pretty authoritative and looks normal as far as I can tell. The flow/logs you show reflect nothing abnormal at all but that makes sense since it is an empty flow/default started node. Lets go back to ListSFTP.before centos7 it worked great. Now it doesn't. What does NiFi see when listing now? Nothing? What errors happen? If it is not working there should be errors or there should be nothing which means it is connecting and looking and getting no results. So...please share what you're seeing for that issue itself. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[
https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344019#comment-17344019
]
thang nguyen dinh commented on NIFI-8541:
-
we have a problem with ListFTP processor on centos 7 cluster. It work well
before can not list file.
I checked Redis cluster, FTP server, it is normal and has files, create new
ListFTP, change listing strategy but not work. So I must restart nifi cluster.
It does not happen on other cluster.
I turn debug in processor but did not find any problem, only message "Returning
CLUSTER State: StandardStateMap[version=-1, values={}]".
The difference I can see between 2 cluster is the number of opened files.
> NiFi open too many library files on centos 7
>
>
> Key: NIFI-8541
> URL: https://issues.apache.org/jira/browse/NIFI-8541
> Project: Apache NiFi
> Issue Type: Bug
>Affects Versions: 1.11.4, 1.13.2
> Environment: CentOS Linux release 7.7.1908 (Core)
>Reporter: thang nguyen dinh
>Assignee: Joe Witt
>Priority: Blocker
> Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt,
> nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png,
> stop-nifi.png
>
>
> when i run nifi-1.11.4 without any configuration anh data-flow on centos 7,
> it open too many duplicate librarys, about 800K files. centos 6 does not have
> this issue.
> !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400!
> when stop nifi
> !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400!
>
> i have same issue with nifi-1.13.2
> !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400!
> almost of opened files is nifi library
> example:
> !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400!
>
> LINK lsof output and flow.xml.gz:
> [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344003#comment-17344003 ] Joe Witt commented on NIFI-8541: I looked at the logs. They look perfect. If you do 'lsof -p ' the results suggest totally normal file counts. What is the problem you really need solved? Is something erroring? If so what? > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343996#comment-17343996 ] thang nguyen dinh commented on NIFI-8541: - I've add conf and log folder of nifi-1.13.2 at share-link: [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] I tried setup on some centos 7 servers and have same issue. I think you can easily reproduce it. Thank you. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343991#comment-17343991 ] Joe Witt commented on NIFI-8541: No. Definitely not normal. Can you please look at the nifi-bootstrap and nifi-app logs? Please share them. Right now I dont see anything actually wrong/obvious here. Just output which doesn't make sense. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343987#comment-17343987 ] thang nguyen dinh commented on NIFI-8541: - we're have 2 NiFi cluster * one has 5 server on centos 6 , lsof | wc -l show normal with about 12k opened file * one has 3 server on centos 7 and there are more than 800K opened file related to nifi, i don't understand I setup new standalone nifi which I show lsof to you, I think this issue is not relate to flow.xml.gz And if " It seems like the parent process id and the child process id are repeating in patterns as if tons and tons and tons of instances are being launched", is it normal? Thank you. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343983#comment-17343983 ] Joe Witt commented on NIFI-8541: the output of the broad lsof if you pick a single thing shows a repeating pattern. Note the first few columns. It seems like the parent process id and the child process id are repeating in patterns as if tons and tons and tons of instances are being launched. java 32691 admin mem REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 admin 170r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 admin 2861r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32695 admin mem REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32695 admin 170r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32695 admin 2861r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32696 admin mem REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32696 admin 170r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32696 admin 2861r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32697 admin mem REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32697 admin 170r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32697 admin 2861r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32698 admin mem REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32698 admin 170r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar java 32691 32698 admin 2861r REG 253,0277351 2613849 /home/admin/nifi-1.11.4/work/nar/framework/nifi-framework-nar-1.11.4.nar-unpacked/NAR-INF/bundled-dependencies/netty-buffer-4.1.42.Final.jar > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi >
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343979#comment-17343979 ] Joe Witt commented on NIFI-8541: and the flow definition shows there is nothing there...so you're just starting nifi and seeing how many open files there are? > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343977#comment-17343977 ] Joe Witt commented on NIFI-8541: >From the 1.13.2 lsof output tied to the pid there is no indication of anything >abnormal. 6000 or so open files most of which are our libs. This is >fine/normal. Why do you believe there is a leak? > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! > > LINK lsof output and flow.xml.gz: > [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343939#comment-17343939 ] thang nguyen dinh commented on NIFI-8541: - i run nifi right after extract without any configuration link lsof and flow.xml.gz [https://drive.google.com/drive/folders/1V2Y_DHfiivJfGlYsgm68AelL3By3EBcB?usp=sharing] > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343917#comment-17343917 ] Joe Witt commented on NIFI-8541: And we need to see what the flow.xml.gz has and/or need a detailed written description of it. Also we need the output of 'lsof -p ' exclusively. If you want to also provide it with the greop that is fine but please share them uniquely. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343916#comment-17343916 ] Joe Witt commented on NIFI-8541: Thanks - same output for 1.13.2 please. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, lsof-20210513-32691-2000-sample.txt, > nifi-1.13.png, nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, > stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343913#comment-17343913 ] thang nguyen dinh commented on NIFI-8541: - [~joewitt] "lsof -p nifi_pid" does not list all file nifi open. so I added the out put of cmd "lsof | grep 32691", 32691 is nifi pid. Thank you. full log: [https://drive.google.com/file/d/1t0mkVNTz45ODjZqY8bz14I7ihO-MiFnE/view?usp=sharing] > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, nifi-1.13.png, > nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343901#comment-17343901 ] Joe Witt commented on NIFI-8541: Ok then we need the full output of the lsof -p output for the nifi pid. Please send that as text. Remove/replace whatever sensitive dirnames you need but we need the text. > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, nifi-1.13.png, > nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343898#comment-17343898 ] thang nguyen dinh commented on NIFI-8541: - Im using jdk1.8.0_281 list of java versions i have tried (same issue): openjdk-11.0.11.0.9-1 openjdk-1.8.0.292 jdk1.8.0_281 jdk1.8.0_261 jdk1.8.0_51 !nifi-ps-jdk-281.png! > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, nifi-1.13.png, > nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343897#comment-17343897 ] Joe Witt commented on NIFI-8541: we think this issue was in JDK 8 281 and 271 from the oracle distro > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Assignee: Joe Witt >Priority: Blocker > Attachments: dupliate-lib.png, nifi-1.13.png, > nifi-open-too-many-libs-centos7.png, nifi-ps-jdk-281.png, stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files on centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343866#comment-17343866 ] Pierre Villard commented on NIFI-8541: -- Version of Java? > NiFi open too many library files on centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Priority: Blocker > Attachments: dupliate-lib.png, nifi-1.13.png, > nifi-open-too-many-libs-centos7.png, stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow on centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (NIFI-8541) NiFi open too many library files in centos 7
[ https://issues.apache.org/jira/browse/NIFI-8541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343804#comment-17343804 ] Duong Pham commented on NIFI-8541: -- I got the same > NiFi open too many library files in centos 7 > > > Key: NIFI-8541 > URL: https://issues.apache.org/jira/browse/NIFI-8541 > Project: Apache NiFi > Issue Type: Bug >Affects Versions: 1.11.4, 1.13.2 > Environment: CentOS Linux release 7.7.1908 (Core) >Reporter: thang nguyen dinh >Priority: Blocker > Attachments: dupliate-lib.png, nifi-1.13.png, > nifi-open-too-many-libs-centos7.png, stop-nifi.png > > > when i run nifi-1.11.4 without any configuration anh data-flow in centos 7, > it open too many duplicate librarys, about 800K files. centos 6 does not have > this issue. > !https://community.cloudera.com/t5/image/serverpage/image-id/31161iAD2A4726623B08EE/image-size/medium?v=1.0=400! > when stop nifi > !https://community.cloudera.com/t5/image/serverpage/image-id/31165i8D6E7C394AE26C6F/image-size/medium?v=1.0=400! > > i have same issue with nifi-1.13.2 > !https://community.cloudera.com/t5/image/serverpage/image-id/31163i2901E83C543D3691/image-size/medium?v=1.0=400! > almost of opened files is nifi library > example: > !https://community.cloudera.com/t5/image/serverpage/image-id/31164i401AE378E2B259E9/image-size/medium?v=1.0=400! -- This message was sent by Atlassian Jira (v8.3.4#803005)
