I setup the cluster configuration in masters, slaves, core-site.xml,
hdfs-site.xml, mapred-site.xml and copy to all the machines.
And I login to one of the machines and use the following to start the cluster.
for service in /etc/init.d/hadoop-0.20-*; do sudo $service start; done
I expect this
Hi Ricky,
Which hadoop version are you using? I am using hadoop-0.20.2 apache
version, and I generally just run the $HADOOP_HOME/bin/start-dfs.sh and
start-mapred.sh script on my master node. If passwordless ssh is configured,
this script will start the required services on each node.
Thanks for pointing me to the right command. I am using the CDH3 distribution.
I figure out no matter what I put in the masters file, it always start the
NamedNode at the machine where I issue the start-all.sh command. And always
start a SecondaryNamedNode in all other machines. Any clue ?
Hi Ricky,
Yes, that's how it is meant to be. The machine where you run
start-dfs.sh will become the namenode, and the machine whihc you specify in
you masters file becomes the secondary namenode.
Hari
On Wed, Nov 24, 2010 at 2:13 AM, Ricky Ho rickyphyl...@yahoo.com wrote:
Thanks for
hi Hary,
when i try to start hadoop daemons by /usr/lib/hadoop# bin/start-dfs.sh on
name node it is giving this error:*May not run daemons as root. Please
specify HADOOP_NAMENODE_USER(*same for other daemons*)*
but when i try to start it using */etc/init.d/hadoop-0.20-namenode start *
it* *gets
hi Ricky,
for installing CDH3 you can refer this tutorial:
http://cloudera-tutorial.blogspot.com/2010/11/running-cloudera-in-distributed-mode.html
all the steps in this tutorial are well tested.(*in case of any query please
leave a comment*)
On Wed, Nov 24, 2010 at 11:48 AM, rahul patodi
Hi Raul,
I am not sure about CDH, but I have created a separate hadoop
user to run my ASF hadoop version, and it works fine. Maybe you can also try
creating a new hadoop user, make hadoop the owner of hadoop root directory.
HTH,
Hari
On Wed, Nov 24, 2010 at 11:51 AM, rahul patodi
Hi everyone,
Since this question is CDH-specific, it's better to ask on the cdh-user
mailing list:
https://groups.google.com/a/cloudera.org/group/cdh-user/topics?pli=1
Thanks
-Todd
On Wed, Nov 24, 2010 at 1:26 AM, Hari Sreekumar hsreeku...@clickable.comwrote:
Hi Raul,
I am not sure
