calling persist would cause java.util.NoSuchElementException: key not found:

2015-10-01 Thread Eyad Sibai
Hi I am trying to call .persist() on a dataframe but once I execute the next line I am getting java.util.NoSuchElementException: key not found: …. I tried to do persist on disk also the same thing. I am using: pyspark with python3 spark 1.5 Thanks! EYAD SIBAI Risk Engineer iZettle

Join two dataframe - Timeout after 5 minutes

2015-09-24 Thread Eyad Sibai
$$anonfun$run$3.apply(PythonRDD.scala:249)  at org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1699)  at org.apache.spark.api.python.PythonRDD$WriterThread.run(PythonRDD.scala:208) EYAD SIBAI Risk Engineer iZettle ® –– Mobile: +46 72 911 60 54 Web: www.izettle.com