All the code for launching and proxy is built into my java class. So the proxy has to be running. The failure is occurring before mapred job. I was using JobConf similar to HadoopService controller class in Whirr to create Configuration object.
I will try with cli mode to avoid any issues in my code. Praveen On Feb 23, 2011, at 7:06 AM, "ext Andrei Savu" <savu.and...@gmail.com<mailto:savu.and...@gmail.com>> wrote: Are you sure the proxy is running? Can you check this without running the MR job? On Wed, Feb 23, 2011 at 2:02 PM, <<mailto:praveen.pe...@nokia.com>praveen.pe...@nokia.com<mailto:praveen.pe...@nokia.com>> wrote: I have retry logic on my side. I try it for 3 times before giving up. We are in the verge of releasing and I would need to get approval in order to use unreleased code. Also it was working fine when I used 1 month old trunk which I thought should be close to 0.3 release. Just looking at the error message can you make out anything? I will try with 4gb cluster and see if that fails too. Praveen On Feb 23, 2011, at 4:01 AM, "ext Andrei Savu" <<mailto:savu.and...@gmail.com>savu.and...@gmail.com<mailto:savu.and...@gmail.com>> wrote: Did you try starting a cluster multiple times? Sometimes the failures you are seeing are not related to Whirr. You should probably try the latest trunk. We have improved the bootstrap process (automatic retry building nodes on failures, retry downloading tarballs on failure + no longer needs to have scripts on S3). On Wed, Feb 23, 2011 at 3:03 AM, <<mailto:praveen.pe...@nokia.com><mailto:praveen.pe...@nokia.com>praveen.pe...@nokia.com<mailto:praveen.pe...@nokia.com>> wrote: Hello all, I was able to create hadoop cluster successfully with 1 month old trunk code (built locally). I recently got 0.3 release version and started using it. I am getting following error when I tried launching 5 node 8GB hadoop cluster. Wondering if anyone else has seen this issue? Caused by: java.io.IOException: Call to <http://xx-xx-xx-xxx.static.cloud-ips.com/xx.xx.xx.xxx:8021> <http://xx-xx-xx-xxx.static.cloud-ips.com/xx.xx.xx.xxx:8021> xx-xx-xx-xxx.static.cloud-ips.com/xx.xx.xx.xxx:8021<http://xx-xx-xx-xxx.static.cloud-ips.com/xx.xx.xx.xxx:8021> failed on local exception: java.net.SocketException: Reply from SOCKS server has bad version at org.apache.hadoop.ipc.Client.wrapException(Client.java:775) at org.apache.hadoop.ipc.Client.call(Client.java:743) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220) at org.apache.hadoop.mapred.$Proxy226.getProtocolVersion(Unknown Source) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359) at org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:429) at org.apache.hadoop.mapred.JobClient.init(JobClient.java:423) at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:410) at com.nokia.relevancy.util.hadoop.HadoopServiceController.startup(HadoopServiceController.java:164) ... 5 more Caused by: java.net.SocketException: Reply from SOCKS server has bad version at java.net.SocksSocketImpl.connectV4(SocksSocketImpl.java:269) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:437) at java.net.Socket.connect(Socket.java:529) at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:402)
