Re: SparkSQL implicit conversion on insert

2015-11-03 Thread Michael Armbrust
Today you have to do an explicit conversion. I'd really like to open up a public UDT interface as part of Spark Datasets (SPARK-) that would allow you to register custom classes with conversions, but this won't happen till Spark 1.7 likely. On Mon, Nov 2, 2015 at 8:40 PM, Bryan Jeffrey

SparkSQL implicit conversion on insert

2015-11-02 Thread Bryan Jeffrey
All, I have an object Joda DateTime fields. I would prefer to continue to use the DateTime in my application. When I am inserting into Hive I need to cast to a Timestamp field (DateTime is not supported). I added an implicit conversion from DateTime to Timestamp - but it does not appear to be