Re: UDTRegistration (in Java)

Well, it is perplexing - as I am able to simply call UDTRegistration from Java. And maybe it is not working properly? I was able to put in a class/String through the register function. And when I call exists(..) it returns true. So, it appears to work, but has issues :-) Regards, Raghu -- View

UDTRegistration (in Java)

Hi, After moving to Spark 2.0, the UDTRegistration is giving me some issues. I am trying the following (in Java): UDTRegistration.register(userclassName, udtclassName); After this, when I try creating a DataFrame, it throws an exception that the userclassName is not registered. Can anyone point

Spark SQL joins taking too long

Hi, I create two tables, one counties with just one row (it actually has 2k rows, but I used only one) and another hospitals, which has 6k rows. The join command I use is as follows, which takes way too long to run and has never finished successfully (even after nearly 10mins). The following is

Scala MatchError in Spark SQL

Hi, I created a custom UserDefinedType in Java as follows: SQLPoint = new UserDefinedType() { //overriding serialize, deserialize, sqlType, userClass functions here } When creating a dataframe, I am following the manual mapping, I have a constructor for JavaPoint - JavaPoint(double x, double y)

Spark SQL create table

Is creating a table using the SparkSQLContext currently supported? Regards, Raghu -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-create-table-tp25996.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

SQL UDF problem (with re to types)

While registering and using SQL UDFs, I am running into the following problem: UDF registered: ctx.udf().register("Test", new UDF1() { /** * */ private static final long