[
https://issues.apache.org/jira/browse/WHIRR-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13147106#comment-13147106
]
Alex Heneveld commented on WHIRR-427:
-------------------------------------
I have tried changing the hadoop+hb+zk versions used by tests in the
{{pom.xml}} but no joy. (Running {{u0}} and {{u1}} against an explicit
{{REPO}} version installed on the servers, and running {{u2}} versions against
the default {{cdh3}} aka {{u2}} -- all give the above problem.)
I've also noticed various ssh messages:
{code}
Warning: Permanently added
'ec2-107-22-77-118.compute-1.amazonaws.com,107.22.77.118' (RSA) to the list of
known hosts.
channel 2: open failed: connect failed: Connection refused
channel 2: open failed: connect failed: Connection refused
channel 2: open failed: connect failed: Connection refused
{code}
These are sandwiched between the following timestamped messages (from
whirr.log):
{code}
2011-11-09 13:22:44,329 INFO
[org.apache.whirr.service.hadoop.HadoopDataNodeClusterActionHandler] (main)
Completed configuration of hadoopcdhclustertest role hadoop-datanode
2011-11-09 13:22:44,330 INFO
[org.apache.whirr.service.hadoop.HadoopTaskTrackerClusterActionHandler] (main)
Completed configuration of hadoopcdhclustertest role hadoop-tasktracker
2011-11-09 13:22:44,442 INFO [org.apache.whirr.service.FileClusterStateStore]
(main) Wrote instances file /Users/alex/.whirr/hadoopcdhclustertest/instances
2011-11-09 13:22:56,527 INFO
[org.apache.whirr.actions.ScriptBasedClusterAction] (main) Starting to run
scripts on cluster for phase destroyinstances: us-east-1/i-1b20a578
{code}
The jclouds-ssh log has the following content at that time, not sure whether
the shutdown is expected or premature:
{code}
2011-11-09 13:22:44,318 DEBUG [jclouds.ssh] (user thread 9) <<
(alex:rsa[fingerprint(d4:28:19:cd:1c:b0:44:bc:4f:8e:8f:b5:12:8a:27:37),sha1(f8:6a:24:ca:ea:9
b:30:1d:e0:8b:a8:14:6e:6d:75:5d:6a:b5:3c:e8)]@107.22.77.118:22) acquired
[output=11/11/09 13:22:06 INFO namenode.FSNamesystem: isPermissionEnabled=true
11/11/09 13:22:06 INFO namenode.FSNamesystem: dfs.block.invalidate.limit=1000
11/11/09 13:22:06 INFO namenode.FSNamesystem: isAccessTokenEnabled=false
accessKeyUpdateInterval=0 min(s), accessTokenLifetime=0 min(s)
11/11/09 13:22:06 INFO common.Storage: Image file of size 110 saved in 0
seconds.
11/11/09 13:22:06 INFO common.Storage: Storage directory /data/hadoop/hdfs/name
has been successfully formatted.
11/11/09 13:22:06 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at
ip-10-205-2-215.ec2.internal/10.205.2.215
************************************************************/
11/11/09 13:22:13 INFO ipc.Client: Retrying connect to server:
ec2-107-22-77-118.compute1.amazonaws.com/10.205.2.215:8020. Already tried 0
time(s).
, error=, exitCode=0]
{code}
> CDH Hadoop integration test fails with malformed reply from SOCKS, may be
> version issue
> ---------------------------------------------------------------------------------------
>
> Key: WHIRR-427
> URL: https://issues.apache.org/jira/browse/WHIRR-427
> Project: Whirr
> Issue Type: Bug
> Reporter: Alex Heneveld
>
> CdhHadoopServiceTest is failing on trunk.
> {code}
> java.io.IOException: Call to
> ec2-174-129-167-130.compute-1.amazonaws.com/174.129.167.130:8021 failed on
> local exception: java.net.SocketException: Malformed reply from SOCKS server
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1139)
> at org.apache.hadoop.ipc.Client.call(Client.java:1107)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
> at org.apache.hadoop.mapred.$Proxy85.getProtocolVersion(Unknown
> Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
> at
> org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:501)
> at org.apache.hadoop.mapred.JobClient.init(JobClient.java:486)
> at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:469)
> at
> org.apache.whirr.service.cdh.integration.CdhHadoopServiceTest.test(CdhHadoopServiceTest.java:86)
> {code}
> I am running this with {{mvn -Pintegration install
> -Dtest=CdhHadoopServiceTest -DargLine="-Dwhirr.test.provider=aws-ec2
> -Dwhirr.test.identity=... -Dwhirr.test.credential=..."}} in {{services/cdh}}.
> The corresponding HadoopServiceTest is passing.
> Also see WHIRR-227 and WHIRR-415.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
