Re: FetchSFTP Failed to fetch content for StandardFlowFileRecord

2020-08-13 Thread Valentina Ivanova
! Valentina From: Joe Witt Sent: Thursday, 13 August 2020 05:36 To: users@nifi.apache.org Subject: Re: FetchSFTP Failed to fetch content for StandardFlowFileRecord These scenarios are ripe for io race conditions between the sending process (the thing putting files

Re: FetchSFTP Failed to fetch content for StandardFlowFileRecord

2020-08-12 Thread Joe Witt
Thanks & all the best > > > > > > > > > > > > Valentina > > > > > > > -- > > > *From:* Phillip Grenier > > > *Sent:* Wednesday, 12 August 2020 16:02 > > > *To:* users@nifi.apache.org > &g

Re: FetchSFTP Failed to fetch content for StandardFlowFileRecord

2020-08-12 Thread Valentina Ivanova
Sent: Wednesday, 12 August 2020 16:02 To: users@nifi.apache.org Subject: Re: FetchSFTP Failed to fetch content for StandardFlowFileRecord Valentina, I have seen cases where the server will delete files after being touched by the list(S)FTP processor, so if the fetch processor isn't fast en

Re: FetchSFTP Failed to fetch content for StandardFlowFileRecord

2020-08-12 Thread Phillip Grenier
Valentina, I have seen cases where the server will delete files after being touched by the list(S)FTP processor, so if the fetch processor isn't fast enough it gets deleted and causes that issue. If the file really does still exist on the server then I would try a simple retry loop and see if a

FetchSFTP Failed to fetch content for StandardFlowFileRecord

2020-08-12 Thread Valentina Ivanova
Hi all! I am retrieving files thousands of files with FetchSFTP and from time to time (say 1 per 10 min) I receive the following error. FetchSFTP[id=e19a32eb-f9c6-13a0-38b4-45a726ec4273] Failed to fetch content for