Maxim Gekk created SPARK-30788:
----------------------------------
Summary: Support `SimpleDateFormat` and `FastDateFormat` as legacy
date/timestamp formatters
Key: SPARK-30788
URL: https://issues.apache.org/jira/browse/SPARK-30788
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.0
Reporter: Maxim Gekk
To be absolutely sure that Spark 3.0 is compatible with 2.4 when
spark.sql.legacy.timeParser.enabled is set to true, need to support
SimpleDateFormat and FastDateFormat as legacy parsers/formatters in
TimestampFormatter.
Spark 2.4.x uses the following parsers for parsing/formatting date/timestamp
strings:
# DateTimeFormat in CSV/JSON datasource
# SimpleDateFormat - is used in JDBC datasource, in partitions parsing.
# SimpleDateFormat in strong mode (lenient = false). It is used by the
date_format, from_unixtime, unix_timestamp and to_unix_timestamp functions.
Spark 3.0 should use the same parsers in those cases.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
