Any daemon?

2011-11-07 Thread kartheek muthyala
Hi all, I am interested in knowing, if there is any background daemon in hadoop which runs for regular periods checking if all the data copies(blocks as listed in block map) do exist and are not corrupted?. Can you please point me to that piece of code in hadoop? Thanks, Kartheek.

Re: Any daemon?

2011-11-07 Thread Uma Maheswara Rao G 72686
You can look at BlockPoolSliceScanner#scan method. This is in trunk code. You can find this logic in DataBlockScanner#run in earlier versions. Regards, Uma - Original Message - From: kartheek muthyala kartheek0...@gmail.com Date: Monday, November 7, 2011 7:31 pm Subject: Any daemon?

Re: mapred.map.tasks getting set, but not sure where

2011-11-07 Thread Robert Evans
It seems logical too that launching 4000 map tasks on a 20 node cluster is going to have a lot of overhead with it. 20 does not seem like the ideal number, but I don't really know the internals of Cassandra that well. You might want to post this question on the Cassandra list to see if they

Re: Building hadoop 0.21.0 from the source

2011-11-07 Thread rreddy
This is a reply to an old message, but I have started working on this only recently. Just creating the lib directory that it is complaining about gets you further. -- View this message in context: http://lucene.472066.n3.nabble.com/Building-hadoop-0-21-0-from-the-source-tp1647589p3480731.html

Hadoop Fuse issue

2011-11-07 Thread Willson Kwok
Hello, I'm using Fuse to mount HDFS /tmp/samba, after mounted has ? ? ? ?issue, please see screenshot. Thanks !

Re: Hadoop Fuse issue

2011-11-07 Thread Harsh J
Hey Willson, Unfortunately, the mailing lists strip away attachments from a mail. It would be better if you posted it on imgur.com/imageshack.us/etc. services and sent the list a link. Same for logs -- pastebin.com/gist/etc. them than attach them on the email. On Sun, Nov 6, 2011 at 10:46 AM,

OceanSync

2011-11-07 Thread DesignerSmoke
Does anyone have BETA access into the OceanSync's Hadoop Management Software? The website is http://www.oceansync.com and sourceforge page is http://sourceforge.net/p/oceansync/ Is there other software like this somewhere? -- View this message in context: