Re: Hadoop internal details

2009-05-07 Thread Nitay
This is better directed at the Hadoop mailing lists. I've added hadoop core user mailing list to your query. Cheers, -n On Thu, May 7, 2009 at 1:11 AM, monty123 wrote: > > My query is how hadoop manages map files, files etc. stuffs. What is the > internal data structure is uses to manage things

Re: Zeroconf for hadoop

2009-01-26 Thread Nitay
Why not use the distributed coordination service ZooKeeper? When nodes come up they write some ephemeral file in a known ZooKeeper directory and anyone who's interested, i.e. NameNode, can put a watch on the directory and get notified when new children come up. On Mon, Jan 26, 2009 at 10:59 AM, Al