Re: partitioning the inputs to the mapper

2008-07-27 Thread lohit


>How do I partition the inputs to the mapper, such that a mapper  
>processes an entire file or files? What is happening now is that each  
>mapper receives only portions of a file and I want them to receive an  
>entire file. Is there a way to do that within the scope of the  
>framework?

http://wiki.apache.org/hadoop/FAQ#10

-Lohit



partitioning the inputs to the mapper

2008-07-27 Thread Shirley Cohen
How do I partition the inputs to the mapper, such that a mapper  
processes an entire file or files? What is happening now is that each  
mapper receives only portions of a file and I want them to receive an  
entire file. Is there a way to do that within the scope of the  
framework?


Thanks,

Shirley