- Original Message -
From: Ted Dunning
To: core-dev@hadoop.apache.org
Sent: Wed Jan 28 11:51:54 2009
Subject: Re: Zeroconf for hadoop
A big positive vote for Zookeeper.
The most salient aspect of my experience using zookeeper is that
coordination and heartbeats and discovery and
A big positive vote for Zookeeper.
The most salient aspect of my experience using zookeeper is that
coordination and heartbeats and discovery and failure notifications all
become nearly trivial. The most amazing thing about ZK isn't the code that
you write, it is all the code that you never have
Owen O'Malley wrote:
On Jan 25, 2009, at 2:02 PM, nitesh bhatia wrote:
Apple provides opensource discovery service called Bonjour (zeroconf).
I don't know enough about Zeroconf to be able to answer definitively,
but I suspect the hardest bit would be figuring out the approach. Of
course Had
Doug Cutting wrote:
Owen O'Malley wrote:
allssh -h node1000-3000 bin/hadoop-daemon.sh start tasktracker
and it will use ssh in parallel to connect to every node between
node1000 and node3000. Our's is a mess, but it would be great if
someone contributed a script like that. *smile*
It would
Owen O'Malley wrote:
allssh -h node1000-3000 bin/hadoop-daemon.sh start tasktracker
and it will use ssh in parallel to connect to every node between
node1000 and node3000. Our's is a mess, but it would be great if someone
contributed a script like that. *smile*
It would be a one-line change
On Jan 25, 2009, at 2:02 PM, nitesh bhatia wrote:
Apple provides opensource discovery service called Bonjour (zeroconf).
I don't know enough about Zeroconf to be able to answer definitively,
but I suspect the hardest bit would be figuring out the approach. Of
course Hadoop has to continue
Hi
Apple provides opensource discovery service called Bonjour (zeroconf). Is it
possible to integrate Zeroconf with Hadoop so that discovery of nodes become
automatic ? Presently for setting up multi-node cluster we need to add IPs
manually. Integrating it with bonjour can make this process automat