[ 
https://issues.apache.org/jira/browse/HIVE-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299695#comment-14299695
 ] 

Lefty Leverenz commented on HIVE-9482:
--------------------------------------

Got your back, [~szehon] -- I changed the version number from 0.14.0 to 1.2.0 
(probably a copy-&-paste error).

* [hive.parquet.timestamp.skip.conversion | 
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.parquet.timestamp.skip.conversion]

> Hive parquet timestamp compatibility
> ------------------------------------
>
>                 Key: HIVE-9482
>                 URL: https://issues.apache.org/jira/browse/HIVE-9482
>             Project: Hive
>          Issue Type: Bug
>          Components: File Formats
>    Affects Versions: 0.15.0
>            Reporter: Szehon Ho
>            Assignee: Szehon Ho
>             Fix For: 1.2.0
>
>         Attachments: HIVE-9482.2.patch, HIVE-9482.patch, HIVE-9482.patch, 
> parquet_external_time.parq
>
>
> In current Hive implementation, timestamps are stored in UTC (converted from 
> current timezone), based on original parquet timestamp spec.
> However, we find this is not compatibility with other tools, and after some 
> investigation it is not the way of the other file formats, or even some 
> databases (Hive Timestamp is more equivalent of 'timestamp without timezone' 
> datatype).
> This is the first part of the fix, which will restore compatibility with 
> parquet-timestamp files generated by external tools by skipping conversion on 
> reading.
> Later fix will change the write path to not convert, and stop the 
> read-conversion even for files written by Hive itself.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to