Maxim Gekk created SPARK-31630:
----------------------------------
Summary: Skip timestamp rebasing after 1900-01-01
Key: SPARK-31630
URL: https://issues.apache.org/jira/browse/SPARK-31630
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.0.0, 3.1.0
Reporter: Maxim Gekk
The conversions of Catalyst's DATE/TIMESTAMPS to/from Java's types
java.sql.Date/java.sql.Timestamps have almost the same implementation except
addition rebasing op. If we look at switch and diffs arrays of all available
time zones, we can detect that there is a time point when all diffs are 0. This
is 1900-01-01 00:00:00Z. So, we can compare input micros with the time point
and skip conversion for modern timestamps.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
