Incorrect number of map tasks when there are multiple input files
-----------------------------------------------------------------
Key: HADOOP-960
URL: https://issues.apache.org/jira/browse/HADOOP-960
Project: Hadoop
Issue Type: Bug
Affects Versions: 0.10.1
Reporter: Andrew McNabb
This problem happens with hadoop-streaming and possibly elsewhere. If there
are 5 input files, it will create 130 map tasks, even if mapred.map.tasks=128.
The number of map tasks is incorrectly set to a multiple of the number of
files. (I wrote a much more complete bug report, but Jira lost it when it had
an error, so I'm not in the mood to write it all again)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.