It looks like a bug in the FS (fuse and/or hdfs) which also hits rsync:
https://groups.google.com/a/cloudera.org/forum/#!msg/cdh-user/R1GR2Asj_lc/f_uuIjG5R1UJ

Please try this workaround.

2014-10-28 10:29 GMT+03:00 akshay gupta <akshaygupta...@gmail.com>:

> will giving --delete-first option in lftp mirror help in my case? I think
> its not working in case of use-temp-file option. As per the man page its
> suppose to delete the old version of the file before it start downloading
> the new one. Its not doing anything. Please help.
>
>
> On Mon, Oct 27, 2014 at 11:50 PM, akshay gupta <akshaygupta...@gmail.com>
> wrote:
>
>> I am using fuse mounted hadoop distributed file system(HDFS). Can you
>> suggest what changes need to be done to make it work as this is a very
>> critical requirement for my project. Will deleting file and then renaming
>> temp file help? how to achieve that?
>>
>> On Mon, Oct 27, 2014 at 7:38 PM, Alexander V. Lukyanov <l...@netis.ru>
>> wrote:
>>
>>> On Mon, Oct 27, 2014 at 05:53:19PM +0530, akshay gupta wrote:
>>> > now its producing 0 byte files and i am also getting input/output error
>>> > here are the debug logs:
>>> >
>>> > copy: renaming `/mount/user/tom/test.txt_tmp_' to `test.txt'
>>> > mirror: rename(/mount/user/tom/test.txt_tmp_,
>>> /mount/user/tom/test.txt):
>>> > Input/output error
>>>
>>> Which filesystem do you use? Maybe it is necessary to unlink target file
>>> before renaming, although rename should do it automatically.
>>>
>>>        If  newpath already exists it will be atomically replaced
>>> (subject to a
>>>        few conditions; see ERRORS below), so that there is no point  at
>>> which
>>>        another process attempting to access newpath will find it missing.
>>>
>>> And man page for rename(2) does not list EIO error.
>>>
>>> --
>>>    Alexander.
>>>
>>
>>
>


-- 
   Alexander.

Attachment: diff
Description: Binary data

_______________________________________________
lftp mailing list
lftp@uniyar.ac.ru
http://univ.uniyar.ac.ru/mailman/listinfo/lftp

Reply via email to