[jira] [Created] (HIVE-12194) Incorrect result when using from_utc_timestamp with the local time zone.

Ryan Blue created HIVE-12194: Summary: Incorrect result when using from_utc_timestamp with the local time zone. Key: HIVE-12194 URL: https://issues.apache.org/jira/browse/HIVE-12194 Project: Hive

[jira] [Created] (HIVE-12192) Hive should carry out timestamp computations in UTC

Ryan Blue created HIVE-12192: Summary: Hive should carry out timestamp computations in UTC Key: HIVE-12192 URL: https://issues.apache.org/jira/browse/HIVE-12192 Project: Hive Issue Type:

[jira] [Created] (HIVE-12196) NPE when converting bad timestamp value

Ryan Blue created HIVE-12196: Summary: NPE when converting bad timestamp value Key: HIVE-12196 URL: https://issues.apache.org/jira/browse/HIVE-12196 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12191) Hive timestamp problems

Ryan Blue created HIVE-12191: Summary: Hive timestamp problems Key: HIVE-12191 URL: https://issues.apache.org/jira/browse/HIVE-12191 Project: Hive Issue Type: Bug Components: Hive

[jira] [Created] (HIVE-12195) Unknown zones should cause an error instead of silently failing

Ryan Blue created HIVE-12195: Summary: Unknown zones should cause an error instead of silently failing Key: HIVE-12195 URL: https://issues.apache.org/jira/browse/HIVE-12195 Project: Hive Issue

[jira] [Created] (HIVE-12193) Add a consistent unix_timestamp function.

Ryan Blue created HIVE-12193: Summary: Add a consistent unix_timestamp function. Key: HIVE-12193 URL: https://issues.apache.org/jira/browse/HIVE-12193 Project: Hive Issue Type: Sub-task

[jira] [Created] (HIVE-12197) Parquet timestamps differ between Hive and Impala

Ryan Blue created HIVE-12197: Summary: Parquet timestamps differ between Hive and Impala Key: HIVE-12197 URL: https://issues.apache.org/jira/browse/HIVE-12197 Project: Hive Issue Type: Sub-task

[jira] [Commented] (HIVE-8119) Implement Date in ParquetSerde

[ https://issues.apache.org/jira/browse/HIVE-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312604#comment-14312604 ] Ryan Blue commented on HIVE-8119: - [~mohitsabharwal], yes, I'll take a look in the next day

[jira] [Commented] (HIVE-8949) Test for PARQUET-26

[ https://issues.apache.org/jira/browse/HIVE-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298903#comment-14298903 ] Ryan Blue commented on HIVE-8949: - [~brocknoland], I lost track of this ticket until now.

[jira] [Updated] (HIVE-7787) Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError

[ https://issues.apache.org/jira/browse/HIVE-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-7787: Resolution: Not a Problem Status: Resolved (was: Patch Available) I'm closing this per discussion

[jira] [Commented] (HIVE-8950) Add support in ParquetHiveSerde to create table schema from a parquet file

[ https://issues.apache.org/jira/browse/HIVE-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240318#comment-14240318 ] Ryan Blue commented on HIVE-8950: - [~singhashish], I think the preferred option is to fix

[jira] [Updated] (HIVE-8949) Test for PARQUET-26

[ https://issues.apache.org/jira/browse/HIVE-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8949: Status: Patch Available (was: Open) Submitting the above patch to get tests to run. Test for PARQUET-26

[jira] [Commented] (HIVE-7787) Reading Parquet file with enum in Thrift Encoding throws NoSuchFieldError

[ https://issues.apache.org/jira/browse/HIVE-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14236363#comment-14236363 ] Ryan Blue commented on HIVE-7787: - [~amalakar], HIVE-8909 recently fixed the

[jira] [Resolved] (HIVE-8419) Hive doesn't properly write NULL values in Parquet files when the type is struct....

[ https://issues.apache.org/jira/browse/HIVE-8419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue resolved HIVE-8419. - Resolution: Fixed Assignee: Sergio Peña I think that this was fixed by Sergio's recent work, as he

[jira] [Commented] (HIVE-6914) parquet-hive cannot write nested map (map value is map)

[ https://issues.apache.org/jira/browse/HIVE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14224898#comment-14224898 ] Ryan Blue commented on HIVE-6914: - Thanks for fixing the test [~spena]! Looks like it is

[jira] [Commented] (HIVE-6994) parquet-hive createArray strips null elements

[ https://issues.apache.org/jira/browse/HIVE-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223622#comment-14223622 ] Ryan Blue commented on HIVE-6994: - [~mickaellcr], has this issue been addressed by

[jira] [Commented] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221138#comment-14221138 ] Ryan Blue commented on HIVE-8909: - Subversion can handle binaries if they're checked in

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Attachment: HIVE-8909.4.patch Adding patch without the data files. Hive doesn't correctly read Parquet

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Attachment: HIVE-8909.5.patch Fixed projection bug and added tests for map structures. Hive doesn't

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Attachment: HIVE-8909.6.patch Fixed typo in new map tests (thanks Sergio!) Hive doesn't correctly read

[jira] [Commented] (HIVE-6914) parquet-hive cannot write nested map (map value is map)

[ https://issues.apache.org/jira/browse/HIVE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14221600#comment-14221600 ] Ryan Blue commented on HIVE-6914: - HIVE-8909 tests that parquet-hive can now read this case

[jira] [Assigned] (HIVE-6914) parquet-hive cannot write nested map (map value is map)

[ https://issues.apache.org/jira/browse/HIVE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue reassigned HIVE-6914: --- Assignee: Sergio Peña parquet-hive cannot write nested map (map value is map)

[jira] [Updated] (HIVE-6914) parquet-hive cannot write nested map (map value is map)

[ https://issues.apache.org/jira/browse/HIVE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-6914: Attachment: NestedMap.parquet HIVE-6914.1.patch Attaching a qtest and data file that

[jira] [Updated] (HIVE-6914) parquet-hive cannot write nested map (map value is map)

[ https://issues.apache.org/jira/browse/HIVE-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-6914: Attachment: HIVE-6914.3.patch Updating qtest patch to drop all created tables. parquet-hive cannot write

[jira] [Created] (HIVE-8949) Test for PARQUET-26

Ryan Blue created HIVE-8949: --- Summary: Test for PARQUET-26 Key: HIVE-8949 URL: https://issues.apache.org/jira/browse/HIVE-8949 Project: Hive Issue Type: Test Reporter: Ryan Blue

[jira] [Updated] (HIVE-8949) Test for PARQUET-26

[ https://issues.apache.org/jira/browse/HIVE-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8949: Attachment: StringMapOfOptionalIntArray.parquet HIVE-8949.1.patch Adding qtest and source

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Attachment: parquet-test-data.tar.gz I'm attaching a tarball with all of the files from the array

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Attachment: HIVE-8909.3.patch Updated patch with q tests for all of the cases in TestArrayCompatibility. I

[jira] [Commented] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218286#comment-14218286 ] Ryan Blue commented on HIVE-8909: - Yes. It implements the rules for reading lists in

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Attachment: HIVE-8909-2.patch Rebased patch on Sergio's changes. This didn't conflict except for the change

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Affects Version/s: 0.13.1 Status: Patch Available (was: Open) Hive doesn't correctly read

[jira] [Commented] (HIVE-8359) Map containing null values are not correctly written in Parquet files

[ https://issues.apache.org/jira/browse/HIVE-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14216579#comment-14216579 ] Ryan Blue commented on HIVE-8359: - I think with [~mickaellcr]'s addition, this is ready to

[jira] [Created] (HIVE-8909) Hive doesn't correctly read Parquet nested types

Ryan Blue created HIVE-8909: --- Summary: Hive doesn't correctly read Parquet nested types Key: HIVE-8909 URL: https://issues.apache.org/jira/browse/HIVE-8909 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-8909: Attachment: HIVE-8909-1.patch This patch implements the rules from PARQUET-113, which required some

[jira] [Commented] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217179#comment-14217179 ] Ryan Blue commented on HIVE-8909: - [~spena], [~brocknoland], and [~mickaellcr], I think you

[jira] [Commented] (HIVE-8909) Hive doesn't correctly read Parquet nested types

[ https://issues.apache.org/jira/browse/HIVE-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217199#comment-14217199 ] Ryan Blue commented on HIVE-8909: - Yes, HIVE-8359 should go in first. This should also be

[jira] [Commented] (HIVE-8359) Map containing null values are not correctly written in Parquet files

[ https://issues.apache.org/jira/browse/HIVE-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217203#comment-14217203 ] Ryan Blue commented on HIVE-8359: - Yes. +1 on this change and we'll clean up the rest in a

[jira] [Commented] (HIVE-8359) Map containing null values are not correctly written in Parquet files

[ https://issues.apache.org/jira/browse/HIVE-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14212639#comment-14212639 ] Ryan Blue commented on HIVE-8359: - [~mickaellcr], it looks HIVE-6994 fixes the read and

[jira] [Commented] (HIVE-8359) Map containing null values are not correctly written in Parquet files

[ https://issues.apache.org/jira/browse/HIVE-8359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211431#comment-14211431 ] Ryan Blue commented on HIVE-8359: - Thanks, Brock. De-duplicating this and HIVE-6994 is on

[jira] [Commented] (HIVE-8380) NanoTime class serializes and deserializes Timestamp incorrectly

[ https://issues.apache.org/jira/browse/HIVE-8380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14162173#comment-14162173 ] Ryan Blue commented on HIVE-8380: - +1 (non-binding) Looks good to me. NanoTime class

[jira] [Commented] (HIVE-7850) Hive Query failed if the data type is arraystring with parquet files

[ https://issues.apache.org/jira/browse/HIVE-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110922#comment-14110922 ] Ryan Blue commented on HIVE-7850: - The array fix is something we need to do on the

[jira] [Commented] (HIVE-7850) Hive Query failed if the data type is arraystring with parquet files

[ https://issues.apache.org/jira/browse/HIVE-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109315#comment-14109315 ] Ryan Blue commented on HIVE-7850: - Looking at just the changes to the schema conversion,

[jira] [Commented] (HIVE-7850) Hive Query failed if the data type is arraystring with parquet files

[ https://issues.apache.org/jira/browse/HIVE-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109347#comment-14109347 ] Ryan Blue commented on HIVE-7850: - It looks like {{ArrayWritableGroupConverter}} is only

[jira] [Commented] (HIVE-7459) Fix NPE when an empty file is included in a Hive query that uses CombineHiveInputFormat

[ https://issues.apache.org/jira/browse/HIVE-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075497#comment-14075497 ] Ryan Blue commented on HIVE-7459: - I don't think there's much chance that those test

[jira] [Updated] (HIVE-7459) Fix NPE when an empty file is included in a Hive query that uses CombineHiveInputFormat

[ https://issues.apache.org/jira/browse/HIVE-7459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated HIVE-7459: Attachment: 0001-HIVE-7459-Fix-Hive-NPE-when-using-CombineHiveInputFo.patch Matt Martin's patch, applied to