[ https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Grandjean updated SPARK-6875: ------------------------------------- Description: The need comes from the following use case: val objs: RDD[MyClass] = [...] val sqlC = new org.apache.spark.sql.SQLContext(sc) import sqlC._ objs.saveAsParquetFile("parquet") MyClass contains joda-time fields. When saving to parquet file, an exception is thrown (matchError in ScalaReflection.scala). Spark SQL supports java SQL date/time types. This request is to add support for Joda-time types. Another alternative would be, in addition to annotations, to be able to programmatically and dynamically add UDTs. was: The need comes from the following use case: val objs: RDD[MyClass] = [...] val sqlC = new org.apache.spark.sql.SQLContext(sc) import sqlC._ objs.saveAsParquetFile("parquet") MyClass contains joda-time fields. When saving to parquet file, an exception is thrown (matchError in ScalaReflection.scala). Spark SQL supports java SQL date/time types. This request is to add support for Joda-time types. > Add support for Joda-time types > ------------------------------- > > Key: SPARK-6875 > URL: https://issues.apache.org/jira/browse/SPARK-6875 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Patrick Grandjean > > The need comes from the following use case: > val objs: RDD[MyClass] = [...] > val sqlC = new org.apache.spark.sql.SQLContext(sc) > import sqlC._ > objs.saveAsParquetFile("parquet") > MyClass contains joda-time fields. When saving to parquet file, an exception > is thrown (matchError in ScalaReflection.scala). > Spark SQL supports java SQL date/time types. This request is to add support > for Joda-time types. > Another alternative would be, in addition to annotations, to be able to > programmatically and dynamically add UDTs. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org