Hi Jasbir,
As a first note, please if you are using a vendor distribution, please
contact the vendor for any issue you are facing. This mailing list is for
the community so we focus on the community edition of Spark.
Anyway, the error seems to be quite clear: your file on HDFS has a missing
block
i am using HDP2.6.3 and 2.6.4 and using the below code –
1. Creating sparkContext object
2. Reading a text file using – rdd
=sc.textFile(“hdfs://192.168.142.129:8020/abc/test1.txt”);
3. println(rdd.count);
After executing the 3rd line i am getting the below error –
Caused by: org.apache.hadoo