Hi,

I am having the following error when using checkpoint in a spark streamming
app :

java.io.NotSerializableException: DStream checkpointing has been enabled
but the DStreams with their functions are not serializable

I am following the example available in
https://github.com/apache/spark/blob/master/examples/src/main/scala/org/apache/spark/examples/streaming/RecoverableNetworkWordCount.scala
with Spark 1.6 .

I wonder if there is any one that can share experiences on handling this
kind of errors when using the checkpoint feature of spark streamming.

Thanks,
Natu

Reply via email to