Re: QueueStream doesn't support checkpoint makes it difficult to do unit test

Never mind. I've found a PR and it merged: https://github.com/apache/spark/pull/8624/commits Bin Wang 于2015年9月17日周四 下午4:50写道： > I'm using spark streaming and use updateStateByKey, which forced to use > checkpoint. In my unit test, I create a queueStream to test. But in spark > 1.5, QueueStream wi

QueueStream doesn't support checkpoint makes it difficult to do unit test

I'm using spark streaming and use updateStateByKey, which forced to use checkpoint. In my unit test, I create a queueStream to test. But in spark 1.5, QueueStream will throw an exception while use it with checkpoint, it makes difficult to do unit test. Is there an option to disable this? Though I k