The official document said " In transformations, users should be aware of that each task’s update may be applied more than once if tasks or job stages are re-executed." I don't quite understand what is this mean. is that meas if i use the accumulator in transformations(i.e. map() operation), this operation will be execuated more than once if the task restarte? And then the final result will be many times of the real result?
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Questions-about-Accumulators-tp22746.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
