RE: Handling read failures during recovery

2011-08-04 Thread Ramkrishna S Vasudevan
Hi As Laxman pointed out, there is a potential problem here. We expect the Namenode recovery to happen within a specified time and we tend to sleep for one second in the splitLogs logic. But we carry on with reading the HLog file which will result in failure. So if the logs are not split prope

Patches for review

2011-07-05 Thread Ramkrishna S Vasudevan
Hi Could you pls review the patches for HDFS-1981 HADOOP-7256 HDFS-1949 Regards Ram *** This e-mail and attachments contain confidential information from HUAWEI, which is intended only for the p

HADOOP-7221

2011-06-21 Thread Ramkrishna S Vasudevan
Hi Any suggestions on HADOOP-7221. It is reg the DFSClient retrys. Regards Ram *** This e-mail and attachments contain confidential information from HUAWEI, which is intended only for the person or e

FW: Scripts to make the SSH password generation easier while trying to start a cluster

2011-05-02 Thread Ramkrishna S Vasudevan
Hi Sometimes when we have a large number of clusters we may have to specify the password of the different machines that we are using as slaves (datanodes). If the cluster is very huge we may have to repeat this everytime. So we would to suggest a way to avoid this 1. Generate a SSH