uot;
Subject: Re: Listing a folder with millions of files
Hi Jeremy,
In this case I don't think there is an easy answer here.
You may have some luck with adjusting the max runtime of the processor but
without checking the the processors implementation I couldn't know for ce
From: Edward Armes
Reply-To: "users@nifi.apache.org"
Date: Monday, March 9, 2020 at 4:43 AM
To: "users@nifi.apache.org"
Subject: Re: Listing a folder with millions of files
Hi Jeremy,
In this case I don't think there is an easy answer here.
You may have some luck with adj
Hi Jeremy,
In this case I don't think there is an easy answer here.
You may have some luck with adjusting the max runtime of the processor but
without checking the the processors implementation I couldn't know for
certain if that would have any effect.
Edward
On Mon, 9 Mar 2020, 06:34 Jeremy Pe
Hi,
I need to list a sub-set (few 100,000) of files in a folder with millions
of files (to do some historical processing). What's the best way I can do
that? ListFiles is taking way too long and seems to try to dump the entire
list to the flow when I test it on a smaller folder list. It would b
