[jira] [Updated] (SPARK-6875) Add support for Joda-time types

2015-04-13 Thread Patrick Grandjean (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Patrick Grandjean updated SPARK-6875:
-
Description: 
The need comes from the following use case:

val objs: RDD[MyClass] = [...]

val sqlC = new org.apache.spark.sql.SQLContext(sc)
import sqlC._

objs.saveAsParquetFile(parquet)

MyClass contains joda-time fields. When saving to parquet file, an exception is 
thrown (matchError in ScalaReflection.scala).

Spark SQL supports java SQL date/time types. This request is to add support for 
Joda-time types. 

It is possible to define UDT's using the @SQLUserDefinedType annotation. 
However, in addition to annotations, it would be nice to be able to 
programmatically/dynamically add UDTs.

  was:
The need comes from the following use case:

val objs: RDD[MyClass] = [...]

val sqlC = new org.apache.spark.sql.SQLContext(sc)
import sqlC._

objs.saveAsParquetFile(parquet)

MyClass contains joda-time fields. When saving to parquet file, an exception is 
thrown (matchError in ScalaReflection.scala).

Spark SQL supports java SQL date/time types. This request is to add support for 
Joda-time types. 

Another alternative would be, in addition to annotations, to be able to 
programmatically and dynamically add UDTs.


 Add support for Joda-time types
 ---

 Key: SPARK-6875
 URL: https://issues.apache.org/jira/browse/SPARK-6875
 Project: Spark
  Issue Type: Improvement
  Components: SQL
Reporter: Patrick Grandjean

 The need comes from the following use case:
 val objs: RDD[MyClass] = [...]
 val sqlC = new org.apache.spark.sql.SQLContext(sc)
 import sqlC._
 objs.saveAsParquetFile(parquet)
 MyClass contains joda-time fields. When saving to parquet file, an exception 
 is thrown (matchError in ScalaReflection.scala).
 Spark SQL supports java SQL date/time types. This request is to add support 
 for Joda-time types. 
 It is possible to define UDT's using the @SQLUserDefinedType annotation. 
 However, in addition to annotations, it would be nice to be able to 
 programmatically/dynamically add UDTs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Updated] (SPARK-6875) Add support for Joda-time types

2015-04-13 Thread Patrick Grandjean (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Patrick Grandjean updated SPARK-6875:
-
Description: 
The need comes from the following use case:

val objs: RDD[MyClass] = [...]

val sqlC = new org.apache.spark.sql.SQLContext(sc)
import sqlC._

objs.saveAsParquetFile(parquet)

MyClass contains joda-time fields. When saving to parquet file, an exception is 
thrown (matchError in ScalaReflection.scala).

Spark SQL supports java SQL date/time types. This request is to add support for 
Joda-time types. 

Another alternative would be, in addition to annotations, to be able to 
programmatically and dynamically add UDTs.

  was:
The need comes from the following use case:

val objs: RDD[MyClass] = [...]

val sqlC = new org.apache.spark.sql.SQLContext(sc)
import sqlC._

objs.saveAsParquetFile(parquet)

MyClass contains joda-time fields. When saving to parquet file, an exception is 
thrown (matchError in ScalaReflection.scala).

Spark SQL supports java SQL date/time types. This request is to add support for 
Joda-time types.


 Add support for Joda-time types
 ---

 Key: SPARK-6875
 URL: https://issues.apache.org/jira/browse/SPARK-6875
 Project: Spark
  Issue Type: Improvement
  Components: SQL
Reporter: Patrick Grandjean

 The need comes from the following use case:
 val objs: RDD[MyClass] = [...]
 val sqlC = new org.apache.spark.sql.SQLContext(sc)
 import sqlC._
 objs.saveAsParquetFile(parquet)
 MyClass contains joda-time fields. When saving to parquet file, an exception 
 is thrown (matchError in ScalaReflection.scala).
 Spark SQL supports java SQL date/time types. This request is to add support 
 for Joda-time types. 
 Another alternative would be, in addition to annotations, to be able to 
 programmatically and dynamically add UDTs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org