[ https://issues.apache.org/jira/browse/MAPREDUCE-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Allen Wittenauer updated MAPREDUCE-5860: ---------------------------------------- Labels: BB2015-05-TBR (was: ) > Hadoop pipes Combiner is closed before all of its reduce calls > -------------------------------------------------------------- > > Key: MAPREDUCE-5860 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5860 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: pipes > Affects Versions: 0.23.0 > Environment: 0.23.0 on 64 bit linux > Reporter: Joe Mudd > Labels: BB2015-05-TBR > Attachments: MAPREDUCE-5860.patch > > > When a Combiner is specified to runTask() its reduce() method may be called > after its close() method has been called due to how the Combiner's containing > object, CombineRunner, is closed after the TaskContextImpl's reducer member > is closed (see TaskContextImpl::closeAll()). > I believe the fix is to delegate the Combiner's ownership to CombineRunner, > making it responsible for calling the Combiner's close() method and deleting > the Combiner instance. -- This message was sent by Atlassian JIRA (v6.3.4#6332)