[
https://issues.apache.org/jira/browse/MAPREDUCE-735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12731359#action_12731359
]
Iyappan Srinivasan commented on MAPREDUCE-735:
----------------------------------------------
Some more testing on these scenarios and found them to pass:
1) No exception should occur and job succeed when the
-Dmapred.text.key.comparator.options is set to any negative value or any
positive value which is out of bound of the data.
2) No exception should occur and job succeed when the seperator has strange
values which are not present in the data.
3) Taking out some parameters and stil lsee if it does not get exception.
> ArrayIndexOutOfBoundsException is thrown by KeyFieldBasedPartitioner
> --------------------------------------------------------------------
>
> Key: MAPREDUCE-735
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-735
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Suman Sehgal
> Assignee: Amar Kamat
> Attachments: HADOOP-6130-v1.0.patch, MAPREDUCE-735-v1.2.patch,
> MAPREDUCE-735-v1.4-branch-0.20.patch, MAPREDUCE-735-v1.4.patch,
> MAPREDUCE-735-v1.5.patch
>
>
> KeyFieldBasedPartitioner throws "KeyFieldBasedPartitioner" when some part of
> the specified key is missing.
> Scenario :
> =======
> when value of num.key.fields.for.partition is greater than the separators
> provided in the input.
> Command:
> ========
> hadoop jar streaming.jar -Dmapred.reduce.tasks=3
> -Dnum.key.fields.for.partition=5 -input <input-dir> -output <output-dir>
> -mapper org.apache.hadoop.mapred.lib.IdentityMapper -reducer
> org.apache.hadoop.mapred.lib.IdentityReducer -inputformat
> org.apache.hadoop.mapred.KeyValueTextInputFormat -partitioner
> org.apache.hadoop.mapred.lib.KeyFieldBasedPartitioner
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
