Re: Example of updateStateByKey with initial RDD?

Ohh I see. You could have to add underscore after ProbabilityCalculator.updateCountsOfProcessGivenRole. Try: dstream.map(x => (x.keyWithTime, x)) .updateStateByKey(ProbabilityCalculator.updateCountsOfProcessGivenRole _, new HashPartitioner(3), initialProcessGivenRoleRdd) Here is an example: def

Re: Example of updateStateByKey with initial RDD?

Aniket, Thank you for the example - but that's not quite what I'm looking for. I've got a call to updateStateByKey that looks like the following: dstream.map(x => (x.keyWithTime, x)) .updateStateByKey(ProbabilityCalculator.updateCountsOfProcessGivenRole) def updateCountsOfProcessGivenRole(a :

Re: Example of updateStateByKey with initial RDD?

Honestly, that's what I already did - I am working to test it now. It looked like 'add an underscore' was ignoring some implicit argument that I was failing to provide. On Thu, Oct 8, 2015 at 8:34 AM, Aniket Bhatnagar wrote: > Ohh I see. You could have to add