Re: names or ips in rack awareness script?

2009-11-19 Thread Edward Capriolo
Feel free to add this here: http://wiki.apache.org/hadoop/topology_rack_awareness_scripts On Thu, Nov 19, 2009 at 11:18 AM, Michael Thomas wrote: > Steve Loughran wrote: >> Michael Thomas wrote: >>> IPs are passed to the rack awareness script.  We use 'dig' to do the >>> reverse lookup to find t

Re: names or ips in rack awareness script?

2009-11-19 Thread Michael Thomas
Steve Loughran wrote: > Michael Thomas wrote: >> IPs are passed to the rack awareness script. We use 'dig' to do the >> reverse lookup to find the hostname, as we also embed the rack id in >> the worker node hostnames. >> > > It might be nice to have some example scripts up on the wiki, to give >

Re: names or ips in rack awareness script?

2009-11-19 Thread Steve Loughran
Michael Thomas wrote: IPs are passed to the rack awareness script. We use 'dig' to do the reverse lookup to find the hostname, as we also embed the rack id in the worker node hostnames. It might be nice to have some example scripts up on the wiki, to give people a good starting place

Re: names or ips in rack awareness script?

2009-11-18 Thread Allen Wittenauer
On 11/18/09 10:02 AM, "Edward Capriolo" wrote: > It was never clear to me what would be needed ip vs hostname. I > specified ip, short hostnames, and long hostnames just to be safe. And > you know things sometimes change with hadoop ::wink-wink:: IIRC, everything is pretty much passed around as I

Re: names or ips in rack awareness script?

2009-11-18 Thread Edward Capriolo
On Wed, Nov 18, 2009 at 11:28 AM, Michael Thomas wrote: > IPs are passed to the rack awareness script.  We use 'dig' to do the reverse > lookup to find the hostname, as we also embed the rack id in the worker node > hostnames. > > --Mike > > On 11/18/2009 08:20 AM, David J. O'Dell wrote: >> >> I'm

Re: names or ips in rack awareness script?

2009-11-18 Thread Michael Thomas
IPs are passed to the rack awareness script. We use 'dig' to do the reverse lookup to find the hostname, as we also embed the rack id in the worker node hostnames. --Mike On 11/18/2009 08:20 AM, David J. O'Dell wrote: I'm trying to figure out if I should use ip addresses or dns names in my r

names or ips in rack awareness script?

2009-11-18 Thread David J. O'Dell
I'm trying to figure out if I should use ip addresses or dns names in my rack awareness script. Its easier for me to use dns names because we have the row and rack number in the name which means I can dynamically determine the rack without having to manually update the list when adding nodes.