Re: NIFI-4715 : ListS3 list duplicate files when incoming file throughput to S3 is high

Hi Milan, Thanks for your contribution! I reviewed the PR and posted a comment there. Would you check that? Koji On Sat, Dec 23, 2017 at 7:15 AM, Milan Das wrote: > I have logged a defect in NIFI. ListS3 is generation duplicate flows when > S3 throughput is high. > > > >

NIFI-4715 : ListS3 list duplicate files when incoming file throughput to S3 is high

I have logged a defect in NIFI. ListS3 is generation duplicate flows  when S3 throughput is high. Root cause is: When the file gets uploaded to S3 simultaneously when List S3 is in progress. onTrigger--> maxTimestamp is initiated as 0L. This is clearing keys as per the code below When