Re: Sync and Data Replication

2012-06-09 Thread Harsh J
Hi Mohit, In this scenario is data also replicated as defined by the replication factor to other nodes as well? I am wondering if at this point if crash occurs do I have data in other nodes? What kind of crash are you talking about here? A client crash or a cluster crash? If a cluster, is

Re: memory usage tasks

2012-06-09 Thread Harsh J
Hey Koert, Do you have JVM reuse enabled? It may be a bug related to that. If its still around, can you jstack the idle JVMs (i.e. the JVMs that lie around when no jobs are running) and attach them somewhere to look at their state? You'll need to run jstack on their PID as the mapred user (sudo

Re: hbase client security (cluster is secure)

2012-06-09 Thread Harsh J
Hi again Tony, Moving this to u...@hbase.apache.org (bcc'd common-user@hadoop.apache.org). Please use the right user group lists for best responses. I've added you to CC in case you aren't subscribed to the HBase user lists. Can you share the whole error/stacktrace-if-any/logs you get at the

Re: Sync and Data Replication

2012-06-09 Thread Mohit Anchlia
Thanks Harsh for detailed info. It clears things up. Only thing from those page is concerning is what happens when client crashes. It says you could lose upto a block worth of information. Is this still true given that NN would auto close the file? Is it a good practice to reduce NN default value

Re: master and slaves are running but they seem disconnected

2012-06-09 Thread Joey Krabacher
Not sure, but I did notice that safe mode is still. I would investigate that and see if the other nodes show up. /* Joey */ On Jun 9, 2012 2:52 PM, Pierre Antoine DuBoDeNa pad...@gmail.com wrote: Hello everyone.. I have a cluster of 5 VMs, 1 as master/slave the rest are slaves. I run

Re: master and slaves are running but they seem disconnected

2012-06-09 Thread shashwat shriparv
Please send the content of all the hosts file from all the machines. and master and slaves contents from all the machines from master and the slave machines. On Sun, Jun 10, 2012 at 1:39 AM, Joey Krabacher jkrabac...@gmail.comwrote: Not sure, but I did notice that safe mode is still. I would

Re: master and slaves are running but they seem disconnected

2012-06-09 Thread Pierre Antoine DuBoDeNa
Oh i fixed the problem.. I changed for another application the hosts files to include localhost at 127.0.0.1 .. that seems to have destroyed everything.. Thanks for the quick responses guys. 2012/6/9 shashwat shriparv dwivedishash...@gmail.com Please send the content of all the hosts file from