Since you are using the latest Spark code and not Spark 0.9.1 (guessed from
the log messages), you can actually do graceful shutdown of a streaming
context. This ensures that the receivers are properly stopped and all
received data is processed and then the system terminates (stop() stays
blocked u
Hello,
I am trying to implement something like "process a stream for N
seconds, then return a result" with Spark Streaming (built from git
head). My approach (which is probably not very elegant) is
val ssc = new StreamingContext(...)
ssc.start()
future {
Thread.sleep(Seconds(N))
