[
https://issues.apache.org/jira/browse/SPARK-27008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-27008:
------------------------------------
Assignee: Apache Spark
> Support java.time.LocalDate as an external type of DateType
> -----------------------------------------------------------
>
> Key: SPARK-27008
> URL: https://issues.apache.org/jira/browse/SPARK-27008
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.4.0
> Reporter: Maxim Gekk
> Assignee: Apache Spark
> Priority: Major
>
> Currently, Spark supports the java.sql.Date as external types for Catalyst's
> DateType. It accepts and produces values of such types. Since Java 8, base
> classes for dates are java.time.Instant, java.time.LocalDate/LocalDateTime,
> and java.time.ZonedDateTime. Need to add new converters from/to LocalDate.
> The LocalDate type holds epoch days, and directly reflects to Catalyst's
> DateType.
> Main motivations for the changes:
> - Smoothly support Java 8 time API
> - Avoid inconsistency of calendars used inside Spark 3.0 (Proleptic Gregorian
> calendar) and inside of java.sql.Date (hybrid calendar - Julian + Gregorian).
> - Make conversion independent from current system timezone.
> In case of collecting values of DateType, the following SQL config can
> control types of returned values:
> - spark.sql.catalyst.dateType with supported values "Date" (by default,
> java.sql.Date) and "Instant" (java.time.LocalDate)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
