Replying to my own thread here.
While we got a good handle on the IP based hadoop cluster by using the
settings mentioned above, we are now upgrading the Cloudera 5.1.0 packages
and Yarn.
So far most everything seemed to work well, except that for some reason Yarn
insists on making use of DNS
will have to put the master ip in /etc/hosts but it
would be a lot less trouble than maintaining an entry for every single node.
Still it would be great to have an option to force that name to be the ip
address.
--
View this message in context:
http://hadoop.6.n7.nabble.com/IP-based-hadoop-cluster
takes
just a few seconds (12s to deploy 3 machines last time I measured).
--
View this message in context:
http://hadoop.6.n7.nabble.com/IP-based-hadoop-cluster-tp70191p70241.html
Sent from the common-user mailing list archive at Nabble.com.
to verify identities or some
such.
From: sodul
To: common-user@hadoop.apache.org
Sent: Tuesday, October 1, 2013 4:13 AM
Subject: IP based hadoop cluster
For various reasons I need to setup hadoop without the need for hostnames or
/etc/hosts files.
I
ess like
&nnaddr=1.2.3.4:54310, then it works.
I've tried to set dfs.datanode.hostname, slave.host.name, dfs.http.address,
fs.default.name, fs.defaultFS ... nothing worked so far.
The version of hadoop is 2.0.0-cdh4.1.2.
--
View this message in context:
http://hadoop.6.n7.nabble.co
