Re: Accumulators of Spark 1.x no longer work with Spark 2.x

at 12:55 AM, Sergey Zhemzhitsky <szh.s...@gmail.com> wrote: > Hi there, > > I've noticed that accumulators of Spark 1.x no longer work with Spark > 2.x failing with > java.lang.AssertionError: assertion failed: copyAndReset must return a > zero value copy > > It happens wh

Accumulators of Spark 1.x no longer work with Spark 2.x

Hi there, I've noticed that accumulators of Spark 1.x no longer work with Spark 2.x failing with java.lang.AssertionError: assertion failed: copyAndReset must return a zero value copy It happens while serializing an accumulator here [1] although copyAndReset returns zero-value copy for sure