Re: RDD registerAsTable gives error on regular scala class records

2014-07-10 Thread Thomas Robert
Hi, I'm quite a Spark newbie so I might be wrong but I think that registerAsTable works either on case classes or on classes extending Product. You find this info in an example on the doc page of Spark SQL: http://spark.apache.org/docs/latest/sql-programming-guide.html // Define the schema using

RDD registerAsTable gives error on regular scala class records

2014-07-10 Thread Kefah Issa
Hi, SQL on spark 1.0 is an interesting feature. It works fine when the "record" is made of a case-class. The issue I have is that I have around 50 attributes per record. scala Case-class can not handle that (hard-coded limit is 22 for some reason). So I created a regular class and defined the att