Jane, i think you have mapred.tasktracker.reduce.tasks.maximum or
mapred.reduce.tasks set to 1 in your local, and have them set to some other
values in the emr, that's why you always get one reducer in your local and not
on the emr. CheersRamon
Date: Thu, 8 Mar 2012 21:30:26 -0500
Subject:
I have a 2 node cluster running hadoop 0.20.205. There is only one user ,
username: hadoop of group: hadoop.
What is the easiest way to add one more user say hadoop1 with DFS
permissions set as true?
I did the following to create a user in the master node.
sudo adduser --ingroup hadoop hadoop1
Austin,
1. Enable HDFS Permissions. In hdfs-site.xml, set dfs.permissions as true.
2. To commission any new user, as HDFS admin (the user who runs the
NameNode process), run:
hadoop fs -mkdir /user/username
hadoop fs -chown username:username /user/username
3. For default file/dir permissions to
Thanks Harsh :)
On Sat, Mar 10, 2012 at 10:12 PM, Harsh J ha...@cloudera.com wrote:
Austin,
1. Enable HDFS Permissions. In hdfs-site.xml, set dfs.permissions as
true.
2. To commission any new user, as HDFS admin (the user who runs the
NameNode process), run:
hadoop fs -mkdir
Thanks. Looks like there are some parameters that I can use at client level
and others need cluster wide setting. Is there a place where I can see all
the config parameters with description of level of changes that can be done
at client level vs at cluster level?
On Fri, Mar 9, 2012 at 10:39 PM,
Sorry for the duplicate, i have sent this mail to map/reduce mail list but
haven't got any useful response yet, so i think maybe i can get some
suggestions here, thanks.
Hi All
I'm using Hadoop-0.20-append, the cluster contains 3 nodes, for each node I
have 14 map and 14 reduce slots, here
