Spark internally stores timestamps as UTC values, so cearteDataFrame will covert from local time zone to UTC. I think there was a Jira to correct parquet output. Are the values you are seeing offset from your local time zone?
On Jan 11, 2018 4:49 PM, "sk skk" <spark.s...@gmail.com> wrote: > Hello, > > I am using createDataframe and passing java row rdd and schema . But it is > changing the time value when I write that data frame to a parquet file. > > Can any one help . > > Thank you, > Sudhir >
