Well i was able to get it to work by running spark over mesos. But it looks like a bug while running spark alone.
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7382.html Sent from the Apache Spark User List mailing list archive at Nabble.com.