Re: EOFException while reading from HDFS

2016-04-28 Thread Saurav Sinha
Are you able to connect to Name node UI on MACHINE_IP:50070. Check what is URI there. If UI does't open it means your hdfs is not up ,try to start it using start.dfs.sh. On Thu, Apr 28, 2016 at 2:59 AM, Bibudh Lahiri wrote: > Hi, > I installed Hadoop 2.6.0 today on

Re: EOFException while reading from HDFS

2016-04-27 Thread Bibudh Lahiri
Hi, I installed Hadoop 2.6.0 today on one of the machines (172.26.49.156), got HDFS running on it (both Namenode and Datanode on the same machine) and copied the files to HDFS. However, from the same machine, when I try to load the same CSV with the following statement:

Re: EOFException while reading from HDFS

2016-04-26 Thread Davies Liu
The Spark package you are using is packaged with Hadoop 2.6, but the HDFS is Hadoop 1.0.4, they are not compatible. On Tue, Apr 26, 2016 at 11:18 AM, Bibudh Lahiri wrote: > Hi, > I am trying to load a CSV file which is on HDFS. I have two machines: > IMPETUS-1466

EOFException while reading from HDFS

2016-04-26 Thread Bibudh Lahiri
Hi, I am trying to load a CSV file which is on HDFS. I have two machines: IMPETUS-1466 (172.26.49.156) and IMPETUS-1325 (172.26.49.55). Both have Spark 1.6.0 pre-built for Hadoop 2.6 and later, but for both, I had existing Hadoop clusters running Hadoop 1.0.4. I have launched HDFS from