Another way to do this would be to set a property in the Hadoop config itself.
In the job launcher you would have something like:
JobConf conf = ...
conf.setProperty("foo", "test");
Then you can read the property in your map or reduce task.
Tom
On Thu, Apr 30, 2009 at 3:25 PM, Aaron Kimball w
So you want a different "-Dfoo=test" on each node? It's probably grabbing
the setting from the node where the job was submitted, and this overrides
the settings on each task node.
Try adding true to the block on the tasktrackers,
then restart Hadoop and try again. This will prevent the job from o
I'm trying to set a System Property in the Hadoop config, so my jobs will know
which cluster they are running on. I think I should be able to do this with
-Dname=value in "mapred.child.java.opts" (example below), but the setting is
ignored.
In hadoop-site.xml I have:
mapred.child.java.opts
-Xm
