[ https://issues.apache.org/jira/browse/MAPREDUCE-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590292#comment-14590292 ]
Akira AJISAKA commented on MAPREDUCE-6400: ------------------------------------------ bq. A good pattern is when the stream open API consumer closes the stream. In IFlileInputStream for shuffle, the stream is opened outside, and therefore should be and is closed outside. Thanks [~jira.shegalov] for the comment. I agree with you that the pattern is good. However, before MAPREDUCE-6174, the stream is closed when IOException occurs. Can we create a separate jira for improving the pattern? > TestReduceFetchFromPartialMem fails > ----------------------------------- > > Key: MAPREDUCE-6400 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-6400 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: task > Affects Versions: 2.8.0 > Reporter: Akira AJISAKA > Assignee: Gera Shegalov > Priority: Blocker > Attachments: MAPREDUCE-6400.001.patch, MAPREDUCE-6400.patch > > > TestReduceFetchFromPartialMem fails. > {noformat} > Running org.apache.hadoop.mapred.TestReduceFetchFromPartialMem > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 132.978 sec > <<< FAILURE! - in org.apache.hadoop.mapred.TestReduceFetchFromPartialMem > testReduceFromPartialMem(org.apache.hadoop.mapred.TestReduceFetchFromPartialMem) > Time elapsed: 69.214 sec <<< ERROR! > java.io.IOException: Job failed! > at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:867) > at > org.apache.hadoop.mapred.TestReduceFetchFromPartialMem.runJob(TestReduceFetchFromPartialMem.java:300) > at > org.apache.hadoop.mapred.TestReduceFetchFromPartialMem.testReduceFromPartialMem(TestReduceFetchFromPartialMem.java:93) > Results : > Tests in error: > TestReduceFetchFromPartialMem.testReduceFromPartialMem:93->runJob:300 ยป IO > Job... > Tests run: 1, Failures: 0, Errors: 1, Skipped: 0 > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)