Negative Accumulators

2015-01-30 Thread Peter Thai
this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Negative-Accumulators-tp21441.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr

Re: Negative Accumulators

2015-01-30 Thread francois . garillot
) myRDD.foreach(x={ capped_numpings_accu+=BigInt(x._1).min(threshold_var)}) When I remove the min() condition, I no longer see negative values. Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Negative-Accumulators-tp21441.html Sent from the Apache Spark

Re: Negative Accumulators

2014-12-02 Thread Peter Thai
={ myAccumulator+=math.min(x._1, 100) }) //works someRDD.foreach(x={ myAccumulator+=x._1+100 }) Any ideas? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Negative-Accumulators-tp19706p20183.html Sent from the Apache Spark User List mailing list archive

Re: Negative Accumulators

2014-12-02 Thread Peter Thai
: org.apache.spark.Accumulator[scala.math.BigInt] = 0 scala accu += 100 scala accu.value res1: scala.math.BigInt = 100 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Negative-Accumulators-tp19706p20199.html Sent from the Apache Spark User List mailing list archive

Negative Accumulators

2014-11-24 Thread Peter Thai
Hello! Does anyone know why I may be receiving negative final accumulator values? Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Negative-Accumulators-tp19706.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Negative Accumulators

2014-11-24 Thread Shixiong Zhu
/Negative-Accumulators-tp19706.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org

Re: Negative Accumulators

2014-11-24 Thread Peter Thai
accumulator values? Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Negative-Accumulators-tp19706.html Sent from the Apache Spark User List mailing list archive at Nabble.com