Re: Passing a Global Variable into a Mapper

[Wellington Chevreuil]

Hi Arko,

you can do that using the org.apache.hadoop.filecache.DistributedCache class.

You just need to put the file in the distributed cache, in your driver class:
        ...
        DistributedCache.addCacheFile(new
Path(YOUR_FILE_PATH).toUri(), job.getConfiguration());
        ...

Then get it from the Distributed Cache, on your map class:
        ...
        Path[] cacheFiles =
DistributedCache.getLocalCacheFiles(context.getConfiguration());
        ...

Hope this helps you.

Regards,
Wellington.

2011/9/15 Arko Provo Mukherjee <arkoprovomukher...@gmail.com>:
> Hi,
>
> Is there a way to pass some data from the driver class to the Mapper
> class without going through the HDFS?
>
> Does the API provide us with some functionality to pass some variables?
>
> Thanks a lot in advance!
> Warm regards
> Arko
>