Hi Mich,
Take a look
https://spark.apache.org/docs/1.6.1/api/java/org/apache/spark/sql/functions.html#unix_timestamp(org.apache.spark.sql.Column,%20java.lang.String)
cheers,
Tamas
On 24 March 2016 at 14:29, Mich Talebzadeh <mich.talebza...@gmail.com>
wrote:
>
> Hi,
>
> I am trying to convert a date in Spark temporary table
>
> Tried few approaches.
>
> scala> sql("select paymentdate, to_date(paymentdate) from tmp")
> res21: org.apache.spark.sql.DataFrame = [paymentdate: string, _c1: date]
>
>
> scala> sql("select paymentdate, to_date(paymentdate) from tmp").first
> *res22: org.apache.spark.sql.Row = [10/02/2014,null]*
>
> My date is stored as String dd/MM/yyyy as shown above. However, to_date()
> returns null!
>
>
> Thanks
>
>
> Dr Mich Talebzadeh
>
>
>
> LinkedIn *
> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*
>
>
>
> http://talebzadehmich.wordpress.com
>
>
>
