[ 
https://issues.apache.org/jira/browse/NIFI-5751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16663910#comment-16663910
 ] 

Joseph Witt commented on NIFI-5751:
-----------------------------------

Hello.  This appears to be a classic race condition configuration.  If the 
process writing the file and the processing reading the file (nifi) have no way 
of sharing information on readiness then this will happen as you describe it.

You must choose one of the following styles:
- filename based waiting (usually a '.' prepending to the filename marks it as 
'hidden' by intent but you could us other naming).  Once writing completes 
change to the name without the . or whatever pattern.  GetFile supports this 
with ignore hidden files and pattern based pulling.
- waiting for mod time to be a certain age.  GetFile supports this with min 
file age.


> Use the GetFile Processor can't get a complete file
> ---------------------------------------------------
>
>                 Key: NIFI-5751
>                 URL: https://issues.apache.org/jira/browse/NIFI-5751
>             Project: Apache NiFi
>          Issue Type: Bug
>    Affects Versions: 1.7.1
>         Environment: centos7
>            Reporter: weijia.hao
>            Priority: Major
>         Attachments: filesize.png, input.png, output.png, processer.png, 
> putfile.png
>
>
> I use getFile and putFile processor to realize mv function. All 
> configurations are default. when I mv a file to the GetFile processor's Input 
> directory.This file will be completely moved to the putFile processor's 
> output Directory. But when I cp a file to processor's Input Directory 
> slowly,this file will be cut into pieces . for example,I put a 1.2G file into 
> Input directory, When the process is over,there are only 2M of files in the 
> output directory.How do I move a complete file?  
> !input.png!!output.png!!processer.png!
>  
> !putfile.png!!filesize.png!



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to