[ https://issues.apache.org/jira/browse/SPARK-31408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan updated SPARK-31408: -------------------------------- Summary: Build Spark’s own datetime pattern definition (was: Build Spark’s own Datetime patterns) > Build Spark’s own datetime pattern definition > --------------------------------------------- > > Key: SPARK-31408 > URL: https://issues.apache.org/jira/browse/SPARK-31408 > Project: Spark > Issue Type: Umbrella > Components: SQL > Affects Versions: 3.0.0 > Reporter: Yuanjian Li > Priority: Major > Fix For: 3.0.0 > > > This is an umbrella ticket for building Spark's own Datetime patterns and > related works. > In Spark version 2.4 and earlier, datetime parsing and formatting are > performed by the old Java 7 `SimpleDateFormat` API. Since Spark 3.0, we > switch to the new Java 8 `DateTimeFormatter` to use the Proleptic Gregorian > calendar, which is required by the ISO and SQL standards. > However, there are some datetime patterns not compatible between Java 8 and > Java 7 APIs, and it's fragile to rely on the JDK API to define Spark's > behavior. We should build our own Datetime patterns, which is compatible with > Spark 2.4 (the old Java 7 `SimpleDateFormat` API). -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org