Re: Spark Streaming not processing file with particular number of entries

n your previous reply which i would like to clarify - I am running spark in clustered mode (over a 3 node cluster). -- Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7602.htm

Re: Spark Streaming not processing file with particular number of entries

iew this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7599.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Re: Spark Streaming not processing file with particular number of entries

cked up by the app but it is not starting the tasks that are supposed to begin. -- Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7599.html Sent from the Apache Spark User Li

Re: Spark Streaming not processing file with particular number of entries

alone. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7382.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Re: Spark Streaming not processing file with particular number of entries

Well i was able to get it to work by running spark over mesos. But it looks like a bug while running spark alone. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7382.html Sent

Re: Spark Streaming not processing file with particular number of entries

4945000 ms: 14/06/06 11:39:05 INFO JobScheduler: Added jobs for time 1402034945000 ms 14/06/06 11:39:06 INFO FileInputDStream: Finding new files took 1 ms 14/06/06 11:39:06 INFO FileInputDStream: New files at time 1402034946000 ms: 14/06/06 11:39:06 INFO JobScheduler: Added

Re: Spark Streaming not processing file with particular number of entries

The same issue persists in spark-1.0.0 as well (was using 0.9.1 earlier). Any suggestions are welcomed. -- Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-particular-number-of-entries-tp6694p7056.html Sent

Spark Streaming not processing file with particular number of entries

fine. I've tried using different files that have that many number of entries but none of them work. Any ideas why such a wierd issue could occur? Thanks -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-not-processing-file-with-parti