[
https://issues.apache.org/jira/browse/WHIRR-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13152855#comment-13152855
]
Andrei Savu commented on WHIRR-427:
-----------------------------------
Here are some relevant bits from the job tracker log file:
{noformat}
2011-11-18 12:36:01,364 INFO org.apache.hadoop.mapred.JobTracker: Creating the
system directory
2011-11-18 12:36:01,381 WARN org.apache.hadoop.mapred.JobTracker: Failed to
operate on mapred.system.dir
(hdfs://ec2-107-20-78-76.compute-1.amazonaws.com/hadoop/system/mapred)
because of permissions.
2011-11-18 12:36:01,381 WARN org.apache.hadoop.mapred.JobTracker: This
directory should be owned by the user 'mapred'
2011-11-18 12:36:01,382 WARN org.apache.hadoop.mapred.JobTracker: Bailing out
...
org.apache.hadoop.security.AccessControlException:
org.apache.hadoop.security.AccessControlException: Permission denied:
user=mapred, access=WRITE, inode="":hdfs:supergroup:rwx
r-xr-x
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
at
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:57)
at org.apache.hadoop.hdfs.DFSClient.mkdirs(DFSClient.java:1004)
at
org.apache.hadoop.hdfs.DistributedFileSystem.mkdirs(DistributedFileSystem.java:342)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:1226)
at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:364)
{noformat}
What is strange that I have been able to start the job tracker as expected over
SSH:
/etc/init.d/hadoop-0.20-jobtracker start
I'm now reviewing the configuration script on the remote machine.
> CDH Hadoop integration test fails with malformed reply from SOCKS, may be
> version issue
> ---------------------------------------------------------------------------------------
>
> Key: WHIRR-427
> URL: https://issues.apache.org/jira/browse/WHIRR-427
> Project: Whirr
> Issue Type: Bug
> Reporter: Alex Heneveld
> Priority: Blocker
> Fix For: 0.7.0
>
>
> CdhHadoopServiceTest is failing on trunk.
> {code}
> java.io.IOException: Call to
> ec2-174-129-167-130.compute-1.amazonaws.com/174.129.167.130:8021 failed on
> local exception: java.net.SocketException: Malformed reply from SOCKS server
> at org.apache.hadoop.ipc.Client.wrapException(Client.java:1139)
> at org.apache.hadoop.ipc.Client.call(Client.java:1107)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
> at org.apache.hadoop.mapred.$Proxy85.getProtocolVersion(Unknown
> Source)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:398)
> at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:384)
> at
> org.apache.hadoop.mapred.JobClient.createRPCProxy(JobClient.java:501)
> at org.apache.hadoop.mapred.JobClient.init(JobClient.java:486)
> at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:469)
> at
> org.apache.whirr.service.cdh.integration.CdhHadoopServiceTest.test(CdhHadoopServiceTest.java:86)
> {code}
> I am running this with {{mvn -Pintegration install
> -Dtest=CdhHadoopServiceTest -DargLine="-Dwhirr.test.provider=aws-ec2
> -Dwhirr.test.identity=... -Dwhirr.test.credential=..."}} in {{services/cdh}}.
> The corresponding HadoopServiceTest is passing.
> Also see WHIRR-227 and WHIRR-415.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
