[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Allen Wittenauer updated MAPREDUCE-5860:
----------------------------------------
    Labels: BB2015-05-TBR  (was: )

> Hadoop pipes Combiner is closed before all of its reduce calls
> --------------------------------------------------------------
>
>                 Key: MAPREDUCE-5860
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5860
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: pipes
>    Affects Versions: 0.23.0
>         Environment: 0.23.0 on 64 bit linux
>            Reporter: Joe Mudd
>              Labels: BB2015-05-TBR
>         Attachments: MAPREDUCE-5860.patch
>
>
> When a Combiner is specified to runTask() its reduce() method may be called 
> after its close() method has been called due to how the Combiner's containing 
> object, CombineRunner, is closed after the TaskContextImpl's reducer member 
> is closed (see TaskContextImpl::closeAll()).
> I believe the fix is to delegate the Combiner's ownership to CombineRunner, 
> making it responsible for calling the Combiner's close() method and deleting 
> the Combiner instance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to