Steve,
Yes the object is known at start up and is read only. The mappers don't
touch it. I considered serializing to a string. I was wondering if there
wasn't a more excellent way.
Thanks
On 6 May 2011 10:55, Steve Lewis wrote:
> If possible serialize the object as XML then add it as a set
On 05/06/2011 01:12 PM, Geoffry Roberts wrote:
All,
I need for each one of my reducers to have read access to a certain object
or a clone thereof. I can instantiate this object a start up. How can I
give my reducers a copy?
Serialize it to a string, set it as a configuration setting on the j
If possible serialize the object as XML then add it as a set of lines to the
config - alternatively serialize it (maybe xml) to a known spot in HDFS and
read it in in the setup code in the reducer - I assume this is an object
known at the start of the job and not modified by the mapper
On Fri, May
All,
I need for each one of my reducers to have read access to a certain object
or a clone thereof. I can instantiate this object a start up. How can I
give my reducers a copy?
--
Geoffry Roberts
