Pankil, I used to be very confused by hadoop and SSH keys. SSH is NOT required. Each component can be started by hand. This gem of knowledge is hidden away in the hundreds of DIGG style articles entitled 'HOW TO RUN A HADOOP MULTI-MASTER CLUSTER!!!!!'
The SSH keys are only required by the shell scripts that are contained with Hadoop like start-all. They are wrappers to kick off other scripts on a list of nodes. I PERSONALLY dislike using SSH keys as a software component and believe they should only be used by administrators. We chose the cloudera distribution. http://www.cloudera.com/distribution. A big factor behind this was the simple init.d scripts they provided. Each hadoop component has its own start scripts hadoop-namenode, hadoop-datanode, etc. My suggestion is taking a look at the Cloudera startup scripts. Even if you decide not to use the distribution you can take a look at their start up scripts and fit them to your needs. On Fri, May 22, 2009 at 10:34 AM, <hmar...@umbc.edu> wrote: > Steve, > > Security through obscurity is always a good practice from a development > standpoint and one of the reasons why tricking you out is an easy task. > Please, keep hiding relevant details from people in order to keep everyone > smiling. > > Hal > >> Pankil Doshi wrote: >>> Well i made ssh with passphares. as the system in which i need to login >>> requires ssh with pass phrases and those systems have to be part of my >>> cluster. and so I need a way where I can specify -i path/to key/ and >>> passphrase to hadoop in before hand. >>> >>> Pankil >>> >> >> Well, are trying to manage a system whose security policy is >> incompatible with hadoop's current shell scripts. If you push out the >> configs and manage the lifecycle using other tools, this becomes a >> non-issue. Dont raise the topic of HDFS security to your ops team >> though, as they will probably be unhappy about what is currently on offer. >> >> -steve >> >> > > >
