Hi,
For QueueRDD, have a look here.
https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/streaming/QueueStream.scala
Regards,
Laeeq
On Friday, May 23, 2014 10:33 AM, Mayur Rustagi wrote:
Well its hard to use text data as time of input.
But if
Well its hard to use text data as time of input.
But if you are adament here's what you would do.
Have a Dstream object which works in on a folder using filestream/textstream
Then have another process (spark streaming or cron) read through the files
you receive & push them into the folder in order
Hi.
I'm writing a pilot project, and plan on using spark's streaming app for it.
To start with I have a dump of some access logs with their own timestamps,
and am using the textFileStream and some old files to test it with.
One of the issues I've come across is simulating the windows. I would li
