In Spark Streaming, when using updateStateByKey, it requires the generated DStream to be checkpointed.
It seems that it always use JavaSerializer, no matter what I set for spark.serializer. Can I use KryoSerializer for checkpointing? If not, I assume the key and value types have to be Serializable? Chen