Re: "bootstrapping" DStream state

Ha! So easy, how could I miss it?! Thanks! Sent with AquaMail for Android http://www.aqua-mail.com On March 10, 2016 9:32:38 PM Todd Nist wrote: The updateStateByKey can be supplied an initialRDD to populate it with. Per code

Re: "bootstrapping" DStream state

The updateStateByKey can be supplied an initialRDD to populate it with. Per code ( https://github.com/apache/spark/blob/v1.4.0/streaming/src/main/scala/org/apache/spark/streaming/dstream/PairDStreamFunctions.scala#L435-L445 ). Provided here for your convenience. /** * Return a new "state"

"bootstrapping" DStream state

Hi, I have a spark-streaming application that basically keeps track of a string->string dictionary. So I have messages coming in with updates, like: "A"->"B" And I need to update the dictionary. This seems like a simple use case for the updateStateByKey method. However, my issue is that when