Hi
I'm using FileInputFormat which will split files logically according to
their sizes into splits. Can the mapper get a pointer to these splits? and
know which split it is assigned ?
I tried looking up the Reporter class and see how is it printing the
logical splits on the UI for each
On Thu, May 12, 2011 at 8:59 PM, Mark question markq2...@gmail.com wrote:
Hi
I'm using FileInputFormat which will split files logically according to
their sizes into splits. Can the mapper get a pointer to these splits? and
know which split it is assigned ?
Look at
Thanks for the reply Owen, I only knew about map.input.file.
So there is no way I can see the other possible splits (start+length)? like
some function that returns strings of map.input.file and map.input.offset of
the other mappers ?
Thanks,
Mark
On Thu, May 12, 2011 at 9:08 PM, Owen O'Malley
On Thu, May 12, 2011 at 9:23 PM, Mark question markq2...@gmail.com wrote:
So there is no way I can see the other possible splits (start+length)?
like
some function that returns strings of map.input.file and map.input.offset
of
the other mappers ?
No, there isn't any way to do it using the
Then which class is filling the
Thanks again Owen, hopefully last but:
Who's filling the map.input.file and map.input.offset (ie. which class)
so I can extend it to have a function to return these strings.
Thanks,
Mark
On Thu, May 12, 2011 at 10:07 PM, Owen O'Malley omal...@apache.org wrote: