If you look at the file 400k.output, you'll see the string
file:/newdisk1/praveshj/pravesh/data/input/testing4lk.txt
This file contains 0.4 mn records. So the file is being picked up but the
app goes on to hang later on.
Also you mentioned the term "Standalone cluster" in your previous reply
which i would like to clarify - I am running spark in clustered mode (over a
3 node cluster).
--
Thanks
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7602.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
