Starting up hadoop cluster programatically

2011-01-19 Thread praveen.peddi
Hi all, I am trying to create a cluster dynamically using a Java Program. I wrote a program similar to HadoopServiceController in trunk code. I also added proxy information as system property (since I am inside my company network). I saw the cluster got created but the configuration fails. Here

RE: Starting up hadoop cluster programatically

2011-01-19 Thread Andrei Savu
I don't think it's possible to open SSH connections over a HTTP/HTTPS company proxy. I believe you need a SOCKS proxy but unfortunately, as far as I know, jsch does not support proxy connections. I believe that you need to find a way to have direct SSH access to the Amazon Cloud. Maybe there

Re: Starting up hadoop cluster programatically

2011-01-19 Thread Tom White
The Jsch source doesn't have any references to "proxyHost", so I'm guessing these properties don't have any effect. However, the Jsch home page does mention "connection through HTTP proxy". Perhaps you could ask on the Jsch list how to achieve this? Cheers, Tom On Wed, Jan 19, 2011 at 6:40 AM, An