NegativeArraySizeException when doing joins on skewed data

2015-02-25 Thread soila
ge in context: http://apache-spark-user-list.1001560.n3.nabble.com/NegativeArraySizeException-when-doing-joins-on-skewed-data-tp21802.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e

Re: NegativeArraySizeException when doing joins on skewed data

2015-05-21 Thread jstripit
0.n3.nabble.com/NegativeArraySizeException-when-doing-joins-on-skewed-data-tp21802p22986.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional command

Re: NegativeArraySizeException when doing joins on skewed data

2015-02-25 Thread Tristan Blakers
ntityObjectIntMap.push(IdentityObjectIntMap.java:221) > at > > com.esotericsoftware.kryo.util.IdentityObjectIntMap.put(IdentityObjectIntMap.java:117) > at > > com.esotericsoftware.kryo.util.MapReferenceResolver.addWrittenObject(MapReferenceResolver.java:23) >

Re: NegativeArraySizeException when doing joins on skewed data

2015-02-26 Thread Imran Rashid
.IdentityObjectIntMap.putStash(IdentityObjectIntMap.java:227) >> at >> >> com.esotericsoftware.kryo.util.IdentityObjectIntMap.push(IdentityObjectIntMap.java:221) >> at >> >> com.esotericsoftware.kryo.util.IdentityObjectIntMap.put(IdentityObjectIntMap.

Re: NegativeArraySizeException when doing joins on skewed data

2015-02-26 Thread Tristan Blakers
ator(RDD.scala:230) >>> at >>> >>> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68) >>> at >>> >>> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41) >>> at org.apache.sp

Re: NegativeArraySizeException when doing joins on skewed data

2015-03-12 Thread Soila Pertet Kavulya
at >> >> org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:263) >> >> at org.apache.spark.rdd.RDD.iterator(RDD.scala:230) >> >> at >> >> org.apache.spark.rdd.MappedValuesRDD.compute(MappedValuesRDD.scala:31) >> >> at >> >> org.apache.spark.rdd.RDD.c