Re: Bug in Accumulators...

2014-11-23 Thread Aaron Davidson
.n3.nabble.com/Bug-in-Accumulators-tp17263p19579.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h

Re: Bug in Accumulators...

2014-11-23 Thread Sean Owen
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p19579.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user

Re: Bug in Accumulators...

2014-11-22 Thread octavian.ganea
that uses accumulators. Otherwise, you have to change their code such that the above issue does not appear anymore. Best, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p19567.html Sent from the Apache Spark User List mailing list

Re: Bug in Accumulators...

2014-11-22 Thread Sean Owen
to change their code such that the above issue does not appear anymore. Best, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p19567.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Bug in Accumulators...

2014-11-22 Thread octavian.ganea
) at org.apache.spark.util.ClosureCleaner$.ensureSerializable(ClosureCleaner.scala:164) ... 14 more Seems that there is a problem with mapPartitions ... Thanks for your suggestion, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators

Re: Bug in Accumulators...

2014-11-22 Thread lordjoe
in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p19579.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr

Re: Bug in Accumulators...

2014-11-22 Thread Mohit Jaggi
.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p19579.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user

Re: Bug in Accumulators...

2014-11-19 Thread Jake Mannix
... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p17372.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user

Re: Bug in Accumulators...

2014-11-07 Thread Shixiong Zhu
.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p17372.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail

Re: Bug in Accumulators...

2014-11-07 Thread Aaron Davidson
maintain Spark is willing to solve or at least to tell us about ... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p17372.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Bug in Accumulators...

2014-10-27 Thread octavian.ganea
that no one from the people who maintain Spark is willing to solve or at least to tell us about ... -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p17372.html Sent from the Apache Spark User List mailing list archive at Nabble.com

Re: Bug in Accumulators...

2014-10-26 Thread octavian.ganea
Sorry, I forgot to say that this gives the above error just when run on a cluster, not in local mode. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Bug-in-Accumulators-tp17263p17277.html Sent from the Apache Spark User List mailing list archive

Bug in Accumulators...

2014-10-25 Thread octavian.ganea
There is for sure a bug in the Accumulators code. More specifically, the following code works well as expected: def main(args: Array[String]) { val conf = new SparkConf().setAppName(EL LBP SPARK) val sc = new SparkContext(conf) val accum = sc.accumulator(0) sc.parallelize

Re: Bug in Accumulators...

2014-10-25 Thread Rishi Yadav
works fine. Spark 1.1.0 on REPL On Sat, Oct 25, 2014 at 1:41 PM, octavian.ganea octavian.ga...@inf.ethz.ch wrote: There is for sure a bug in the Accumulators code. More specifically, the following code works well as expected: def main(args: Array[String]) { val conf = new SparkConf