Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21169 @michal-databricks My understanding aligns with yours. I think `to/from_utc_timestamp` doesn't make sense in Spark because of the way Spark define timestamp. Since Spark already has these 2 functions and document it as `Given a timestamp like '2017-07-14 02:40:00.0', interprets it as a time in UTC ...`, we should try our best to simulate this semantic. If the input is a timestamp value, we are not able to simulate this semantic because Spark timestamp doesn't have timezone. If the input is string, we have a chance to simulate it, by shifting the timezone to local timezone when casting string to timestamp. This PR improves this simulation.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org