[ https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113770#comment-15113770 ]
Patrick Grandjean commented on SPARK-6875: ------------------------------------------ SPARK-7768 > Add support for Joda-time types > ------------------------------- > > Key: SPARK-6875 > URL: https://issues.apache.org/jira/browse/SPARK-6875 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Patrick Grandjean > > The need comes from the following use case: > val objs: RDD[MyClass] = [...] > val sqlC = new org.apache.spark.sql.SQLContext(sc) > import sqlC._ > objs.saveAsParquetFile("parquet") > MyClass contains joda-time fields. When saving to parquet file, an exception > is thrown (matchError in ScalaReflection.scala). > Spark SQL supports java SQL date/time types. This request is to add support > for Joda-time types. > It is possible to define UDT's using the @SQLUserDefinedType annotation. > However, in addition to annotations, it would be nice to be able to > programmatically/dynamically add UDTs. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org