We've a Spark Streaming job that calculates some values in each batch. What we need to do now is aggregate values across ALL batches. What is the best strategy to do this in Spark Streaming. Should we use 'Spark Accumulators' for this?
- Spark Streaming: Aggregating values across batches Something Something
- Re: Spark Streaming: Aggregating values across ba... Tathagata Das
