It took me a while to track this down, Todd is half right (at least for
18.3)...
mapred.task.partition actually turns into $mapred_task_partition (note it
is lowercase)
for example, to get the filename in the mapper of a python streaming job:
--
import sys, os
filename = os.environ["ma
Hi Steve,
The variables are transformed before going to the mappers.
mapred.task.partition turns into $MAPRED_TASK_PARTITION to be more unix-y
-Todd
On Fri, May 15, 2009 at 4:52 PM, Steve Gao wrote:
> I am using streaming with perl, and I want to get jobconf variable values.
> As many tutorial
I am using streaming with perl, and I want to get jobconf variable values. As
many tutorials say they are in environment, but I can not get them.
For example, in reducer:
while (){
my $part = $ENV{"mapred.task.partition"};
print ("$part\n");
}
It turns out that $ENV{"mapred.task.partition"
