[ 
https://issues.apache.org/jira/browse/HADOOP-8192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238473#comment-13238473
 ] 

Kumar Ravi commented on HADOOP-8192:
------------------------------------

 I think it would be extremely useful to understand if CombineFileInputFormat's 
getSplits() is working as designed -- Should the method  exit out of the loop 
as soon as all blocks are accounted for. If so, the next question is - Is this 
is a testcase scenario issue? --  In a production environment are there 
scenarios where a Datanode will contain all the blocks in a cluster?

 We would like to make sure that we are not fixing a non-existent problem to 
pass a test case, and inadvertently break the split functionality when it is 
working without issues. If this just happens to be a behavior issue between two 
JVMs for a given scenario then it might be more prudent to create separate test 
paths for each JVM. 

                
> Fix unit test failures with IBM's JDK
> -------------------------------------
>
>                 Key: HADOOP-8192
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8192
>             Project: Hadoop Common
>          Issue Type: Bug
>         Environment: java version "1.6.0"
> Java(TM) SE Runtime Environment (build pxi3260sr10-20111208_01(SR10))
> IBM J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux x86-32 
> jvmxi3260sr10-20111207_96808 (JIT enabled, AOT enabled)
> J9VM - 20111207_096808
> JIT  - r9_20111107_21307ifx1
> GC   - 20110519_AA)
> JCL  - 20111104_02
>            Reporter: Devaraj Das
>
> Some tests fail with IBM's JDK. They are 
> org.apache.hadoop.mapred.lib.TestCombineFileInputFormat, 
> org.apache.hadoop.mapreduce.lib.input.TestCombineFileInputFormat, 
> org.apache.hadoop.streaming.TestStreamingBadRecords, 
> org.apache.hadoop.mapred.TestCapacityScheduler. This jira is to track fixing 
> these.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to