Thanks, Allen, for responding.
So, if I understand you correctly, the dfs.datanode.dns.interface and
mapred.tasktracker.dns.interface options may be used to define inbound
connections only?
Concerning the OS configuration, my /etc/hosts files assign unique host
names to the ethernet and IB interfaces. However, even if I specify the
IB host names in the masters and slaves files, communication still
occurs via ethernet, not via IB.
Your recommendation would therefore be to define IB instead of ethernet
as the default network interface connection, right?
Thanks,
Russ
On 06/14/10 12:32 PM, Allen Wittenauer wrote:
On Jun 14, 2010, at 10:57 AM, Russell Brown wrote:
I'm a new user of Hadoop. I have a Linux cluster with both gigabit ethernet
and InfiniBand communications interfaces. Could someone please tell me how to
switch IP communication from ethernet (the default) to InfiniBand? Thanks.
Hadoop will bind inbound connections via the interface settings in the various
hadoop configuration files. Outbound connections are unbound and based solely
on OS configuration. I filed a jira to fix this, but it is obviously low
priority since few people run multi-nic boxes. Best bet is to down the
ethernet and up the IB, changing routing, etc, as necessary.
--
------------------------------------------------------------
Russell A. Brown | Oracle
russ.br...@oracle.com | UMPK14-260
(650) 786-3011 (office) | 14 Network Circle
(650) 786-3453 (fax) | Menlo Park, CA 94025
------------------------------------------------------------
