[ 
https://issues.apache.org/jira/browse/MAPREDUCE-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13637716#comment-13637716
 ] 

Arun C Murthy commented on MAPREDUCE-4737:
------------------------------------------

[~daijy] I started looking closely at this and see that we need a lot more work 
to get this right (lots of existing exception handling for o.a.h.mapred is 
broken too). Do you mind if I take this over, fix related issues and add tests 
etc.? Thanks!
                
>  Hadoop does not close output file / does not call Mapper.cleanup if 
> exception in map
> -------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4737
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4737
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 1-win
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: HADOOP-23-2.patch, HADOOP-8904-1.patch
>
>
> Find this in Pig unit test TestStore under Windows. There are dangling files 
> because map does not close the file when exception happens in map(). In 
> Windows, Hadoop will not remove a file if it is not closed. This happens in 
> reduce() as well.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to