Hi,
I am using spark standalone on EC2. I can access ephemeral hdfs from
spark-shell interface but I can't access hdfs in standalone application. I am
using spark 1.2.0 with hadoop 2.4.0 and launched cluster from ec2 folder from
my local machine. In my pom file I have given hadoop client as 2.4.0.
<dependency> <groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>2.4.0</version> </dependency>
The error is as fallows:
java.io.IOException: Failed on local exception: java.io.EOFException; Host
Details : local host is: "ip-10-40-121-200/10.40.121.200"; destination host is:
"ec2-23-21-113-136.compute-1.amazonaws.com":9000;
Regards,Laeeq