There are several ways you can pass static information to tasks in
Hadoop. The first is to store it in conf via DefaultStringifier, which
needs the object to be serialized either through Writable or
Serializable interfaces. Second way would be to save/serialize the data
to a file and send it via DistributedCache. Another way would be to save
the file in the jar, and read from there.
forbbs forbbs wrote:
It seems that JobConf doesn't help. Do I have to write the object into DFS?