Re: Zeroconf for hadoop

2009-02-14 Thread Sanjay Radia
- Original Message - From: Ted Dunning To: core-dev@hadoop.apache.org Sent: Wed Jan 28 11:51:54 2009 Subject: Re: Zeroconf for hadoop A big positive vote for Zookeeper. The most salient aspect of my experience using zookeeper is that coordination and heartbeats and discovery and

Re: Zeroconf for hadoop

2009-01-28 Thread Ted Dunning
A big positive vote for Zookeeper. The most salient aspect of my experience using zookeeper is that coordination and heartbeats and discovery and failure notifications all become nearly trivial. The most amazing thing about ZK isn't the code that you write, it is all the code that you never have

Re: Zeroconf for hadoop

2009-01-28 Thread Patrick Hunt
Owen O'Malley wrote: On Jan 25, 2009, at 2:02 PM, nitesh bhatia wrote: Apple provides opensource discovery service called Bonjour (zeroconf). I don't know enough about Zeroconf to be able to answer definitively, but I suspect the hardest bit would be figuring out the approach. Of course Had

Re: Zeroconf for hadoop

2009-01-27 Thread Steve Loughran
Doug Cutting wrote: Owen O'Malley wrote: allssh -h node1000-3000 bin/hadoop-daemon.sh start tasktracker and it will use ssh in parallel to connect to every node between node1000 and node3000. Our's is a mess, but it would be great if someone contributed a script like that. *smile* It would

Re: Zeroconf for hadoop

2009-01-26 Thread Doug Cutting
Owen O'Malley wrote: allssh -h node1000-3000 bin/hadoop-daemon.sh start tasktracker and it will use ssh in parallel to connect to every node between node1000 and node3000. Our's is a mess, but it would be great if someone contributed a script like that. *smile* It would be a one-line change

Re: Zeroconf for hadoop

2009-01-26 Thread Owen O'Malley
On Jan 25, 2009, at 2:02 PM, nitesh bhatia wrote: Apple provides opensource discovery service called Bonjour (zeroconf). I don't know enough about Zeroconf to be able to answer definitively, but I suspect the hardest bit would be figuring out the approach. Of course Hadoop has to continue

Zeroconf for hadoop

2009-01-25 Thread nitesh bhatia
Hi Apple provides opensource discovery service called Bonjour (zeroconf). Is it possible to integrate Zeroconf with Hadoop so that discovery of nodes become automatic ? Presently for setting up multi-node cluster we need to add IPs manually. Integrating it with bonjour can make this process automat