Ok, Cheng.
Thank you!
Un saludo
Jorge López-Malla Matute
Big Data Developer
Vía de las Dos Castillas, 33. Ática 4. 3ª Planta
28224 Pozuelo de Alarcón, Madrid
Tel: 91 828 64 73 // @stratiobd
2015-01-28 19:44 GMT+01:00 Cheng Lian lian.cs@gmail.com:
Hey Jorge,
This is expected.
Hello,
We are trying to insert a case class in Parquet using SparkSql. When i'm
creating the SchemaRDD, that include a Set, i have the following exception:
sqc.createSchemaRDD(r)
scala.MatchError: Set[(scala.Int, scala.Int)] (of class
scala.reflect.internal.Types$TypeRef$$anon$1)
at
Hey Jorge,
This is expected. Because there isn’t an obvious mapping from |Set[T]|
to any SQL types. Currently we have complex types like array, map, and
struct, which are inherited from Hive. In your case, I’d transform the
|Set[T]| into a |Seq[T]| first, then Spark SQL can map it to an
