Re: Spark 1.3 UDF ClassNotFoundException

2015-04-03 Thread Markus Ganter
My apologizes. I was running this locally and the JAR I was building using Intellij had some issues. This was not related to UDFs. All works fine now. On Thu, Apr 2, 2015 at 2:58 PM, Ted Yu yuzhih...@gmail.com wrote: Can you show more code in CreateMasterData ? How do you run your code ?

Spark 1.3 UDF ClassNotFoundException

2015-04-02 Thread ganterm
Hello, I started to use the dataframe API in Spark 1.3 with Scala. I am trying to implement a UDF and am following the sample here: https://spark.apache.org/docs/1.3.0/api/scala/index.html#org.apache.spark.sql.UserDefinedFunction meaning val predict = udf((score: Double) = if (score 0.5)