Re: NiFi copying windows .part files

2017-12-06 Thread Ravi Papisetti (rpapiset)
File names are ending with .part (.part is getting suffixed to filename, not prefixed). In case of files from linux file system, “.” (dot) getting prefixed while transfer is in progress. Thanks, Ravi Papisetti On 06/12/17, 1:47 AM, "Joe Witt" wrote: Imagine a

Re: NiFi copying windows .part files

2017-12-05 Thread Joe Witt
Imagine a filename construct where you wanted to pick up any file that begins with the phrase 'start' but does NOT end in the phrase 'part'. The name is of a form 'begin.middle.end'. This filename start.middle.ok would get picked up. This filename start.middle.part would not. The pattern for

Re: NiFi copying windows .part files

2017-12-05 Thread Joe Witt
Ravi Please use the 'File Filter' property of ListFile to control ignoring filenames until they no longer end in 'part'. Thanks On Wed, Dec 6, 2017 at 2:14 AM, Ravi Papisetti (rpapiset) wrote: > Hi, > > > > We are using Apache NiFi 1.3.0 > > > > We have a process flow to

NiFi copying windows .part files

2017-12-05 Thread Ravi Papisetti (rpapiset)
Hi, We are using Apache NiFi 1.3.0 We have a process flow to copy files from NFS to HDFS (with processors ListFile, FetchFile and PutHDFS) In the NiFi process flow, ListFile is configured to listen to a directory on NFS. When a file (ex: x.csv) is being copied from a windows machine to NFS