[
https://issues.apache.org/jira/browse/HIVE-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Szehon Ho updated HIVE-9482:
----------------------------
Attachment: HIVE-9482.patch
> Hive parquet timestamp compatibility
> ------------------------------------
>
> Key: HIVE-9482
> URL: https://issues.apache.org/jira/browse/HIVE-9482
> Project: Hive
> Issue Type: Bug
> Components: File Formats
> Affects Versions: 0.15.0
> Reporter: Szehon Ho
> Assignee: Szehon Ho
> Fix For: 0.15.0
>
> Attachments: HIVE-9482.patch
>
>
> In current Hive implementation, timestamps are stored in UTC (converted from
> current timezone), based on original parquet timestamp spec.
> However, we find this is not compatibility with other tools, and after some
> investigation it is not the way of the other file formats, or even some
> databases (Hive Timestamp is more equivalent of 'timestamp without timezone'
> datatype).
> This is the first part of the fix, which will restore compatibility with
> parquet-timestamp files generated by external tools by skipping conversion on
> reading.
> Later fix will change the write path to not convert, and stop the
> read-conversion even for files written by Hive itself.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
