Re: Convert SchemaRDD to RDD

2015-10-16 Thread Ted Yu
case 1 => val1 > case 2 => val2 > //... cases up to 26 > } > } > ​ > hence expecting an approach to convert SchemaRDD to RDD without using > Tuple or Case Class as we have restrictions in Scala 2.10 > > Regards > Satish Chandra >

Convert SchemaRDD to RDD

2015-10-16 Thread satish chandra j
Hi All, To convert SchemaRDD to RDD below snipped is working if SQL statement has columns in a row are less than 22 as per tuple restriction rdd.map(row => row.toString) But if SQL statement has columns more than 22 than the above snippet will error "*object Tuple27 is not a member of

Re: Convert SchemaRDD to RDD

2015-10-16 Thread Ted Yu
Have you seen this thread ? http://search-hadoop.com/m/q3RTt9YBFr17u8j8=Scala+Limitation+Case+Class+definition+with+more+than+22+arguments On Fri, Oct 16, 2015 at 7:41 AM, satish chandra j <jsatishchan...@gmail.com> wrote: > Hi All, > To convert SchemaRDD to RDD below snipped is wo

Re: Convert SchemaRDD to RDD

2015-10-16 Thread satish chandra j
(that: Any): Boolean = that.isInstanceOf[MyRecord] def productArity: Int = 26 // example value, it is amount of arguments def productElement(n: Int): Serializable = n match { case 1 => val1 case 2 => val2 //... cases up to 26 } } ​ hence expecting an approach to convert