On Thu, May 12, 2011 at 10:16 PM, Mark question wrote:
> Who's filling the map.input.file and map.input.offset (ie. which class)
> so I can extend it to have a function to return these strings.
MapTask.updateJobWithSplit is the method doing the work.
-- Owen
Then which class is filling the
Thanks again Owen, hopefully last but:
Who's filling the map.input.file and map.input.offset (ie. which class)
so I can extend it to have a function to return these strings.
Thanks,
Mark
On Thu, May 12, 2011 at 10:07 PM, Owen O'Malley wrote:
> On Thu, May 12,
On Thu, May 12, 2011 at 9:23 PM, Mark question wrote:
> So there is no way I can see the other possible splits (start+length)?
> like
> some function that returns strings of map.input.file and map.input.offset
> of
> the other mappers ?
>
No, there isn't any way to do it using the public API.
Thanks for the reply Owen, I only knew about map.input.file.
So there is no way I can see the other possible splits (start+length)? like
some function that returns strings of map.input.file and map.input.offset of
the other mappers ?
Thanks,
Mark
On Thu, May 12, 2011 at 9:08 PM, Owen O'Malley
On Thu, May 12, 2011 at 8:59 PM, Mark question wrote:
> Hi
>
> I'm using FileInputFormat which will split files logically according to
> their sizes into splits. Can the mapper get a pointer to these splits? and
> know which split it is assigned ?
>
Look at
http://hadoop.apache.org/common/docs
Hi
I'm using FileInputFormat which will split files logically according to
their sizes into splits. Can the mapper get a pointer to these splits? and
know which split it is assigned ?
I tried looking up the Reporter class and see how is it printing the
logical splits on the UI for each mapp
