[ https://issues.apache.org/jira/browse/SPARK-33210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17218563#comment-17218563 ]
Apache Spark commented on SPARK-33210: -------------------------------------- User 'MaxGekk' has created a pull request for this issue: https://github.com/apache/spark/pull/30121 > Set the rebasing mode for parquet INT96 type to `EXCEPTION` by default > ---------------------------------------------------------------------- > > Key: SPARK-33210 > URL: https://issues.apache.org/jira/browse/SPARK-33210 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.1.0 > Reporter: Maxim Gekk > Priority: Major > > The ticket aims to set the following SQL configs: > - spark.sql.legacy.parquet.int96RebaseModeInWrite > - spark.sql.legacy.parquet.int96RebaseModeInRead > to EXCEPTION by default. > The reason is let users to decide should Spark modify loaded/saved timestamps > instead of silently shifting timestamps while rebasing. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org