[ https://issues.apache.org/jira/browse/HADOOP-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238473#comment-13238473 ]
Kumar Ravi commented on HADOOP-8192: ------------------------------------ I think it would be extremely useful to understand if CombineFileInputFormat's getSplits() is working as designed -- Should the method exit out of the loop as soon as all blocks are accounted for. If so, the next question is - Is this is a testcase scenario issue? -- In a production environment are there scenarios where a Datanode will contain all the blocks in a cluster? We would like to make sure that we are not fixing a non-existent problem to pass a test case, and inadvertently break the split functionality when it is working without issues. If this just happens to be a behavior issue between two JVMs for a given scenario then it might be more prudent to create separate test paths for each JVM. > Fix unit test failures with IBM's JDK > ------------------------------------- > > Key: HADOOP-8192 > URL: https://issues.apache.org/jira/browse/HADOOP-8192 > Project: Hadoop Common > Issue Type: Bug > Environment: java version "1.6.0" > Java(TM) SE Runtime Environment (build pxi3260sr10-20111208_01(SR10)) > IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux x86-32 > jvmxi3260sr10-20111207_96808 (JIT enabled, AOT enabled) > J9VM - 20111207_096808 > JIT - r9_20111107_21307ifx1 > GC - 20110519_AA) > JCL - 20111104_02 > Reporter: Devaraj Das > > Some tests fail with IBM's JDK. They are > org.apache.hadoop.mapred.lib.TestCombineFileInputFormat, > org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat, > org.apache.hadoop.streaming.TestStreamingBadRecords, > org.apache.hadoop.mapred.TestCapacityScheduler. This jira is to track fixing > these. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira