Hi, I need to add 8 hours to from_unixtimestamp df.withColumn(from_unixtime(col("unix_timestamp"),fmt)) as "date_time"
I am try to joda time function def unixToDateTime (unix_timestamp : String) : DateTime = { val utcTS = new DateTime(unix_timestamp.toLong * 1000L)+ 8.hours return utcTS } Its throwing error : java.lang.UnsupportedOperationException: Schema for type com.github.nscala_time.time.Imports.DateTime is not supported Would really appreciate the help. Thanks, Divya