The motivation is to control the max # of mappers of a job. For example, the input data is 246MB, divided by 64M is 4. If by default there will be 4 mappers launched on the 4 blocks. What I want is to set its max # of mappers as 2, so that 2 mappers are launched first and when they completes on the first 2 blocks, another 2 mappers start on the rest 2 blocks. Does Hadoop provide a way?
- How can I control Number of Mappers of a job? Gopal Gandhi
- RE: How can I control Number of Mappers of a job? Goel, Ankur
- Re: How can I control Number of Mappers of a job? Gopal Gandhi
- Re: How can I control Number of Mappers of a j... Andreas Kostyrka
- Re: How can I control Number of Mappers of... Alejandro Abdelnur
- Re: How can I control Number of Mappers of a j... James Moore
- Re: How can I control Number of Mappers of... paul
- Re: How can I control Number of Mapper... Jason Venner
- RE: How can I control Number of M... Goel, Ankur