Bill Schneider created SPARK-28955: -------------------------------------- Summary: Support for LocalDateTime semantics Key: SPARK-28955 URL: https://issues.apache.org/jira/browse/SPARK-28955 Project: Spark Issue Type: Wish Components: SQL Affects Versions: 2.3.0 Reporter: Bill Schneider
It would be great if Spark supported local times in DataFrames, rather than only instants. The specific use case I have in mind is something like * parse "2019-01-01 17:00" (no timezone) from CSV -> LocalDateTime in dataframe * save to Parquet: LocalDateTime is stored with same integer value as 2019-01-01 17:00 UTC, but with isAdjustedToUTC=false. (Currently Spark saves either INT96 or TIME_MILLIS/TIME_MICROS which has isAdjustedToUTC=true) -- This message was sent by Atlassian Jira (v8.3.2#803003) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org