[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Resolution: Fixed Status: Resolved (was: Patch Available) > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Fix For: 3.0.0, 2.4.0 > > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch, > HIVE-17874.05.patch, HIVE-17874.06.patch, HIVE-17874.07-branch-2.patch, > HIVE-17874.08-branch-2.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Fix Version/s: 2.4.0 Status: Patch Available (was: Reopened) > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar >Priority: Major > Fix For: 3.0.0, 2.4.0 > > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch, > HIVE-17874.05.patch, HIVE-17874.06.patch, HIVE-17874.07-branch-2.patch, > HIVE-17874.08-branch-2.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.08-branch-2.patch > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar >Priority: Major > Fix For: 3.0.0 > > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch, > HIVE-17874.05.patch, HIVE-17874.06.patch, HIVE-17874.07-branch-2.patch, > HIVE-17874.08-branch-2.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.07-branch-2.patch attaching branch-2 patch. > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Fix For: 3.0.0 > > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch, > HIVE-17874.05.patch, HIVE-17874.06.patch, HIVE-17874.07-branch-2.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-17874: Resolution: Fixed Fix Version/s: 3.0.0 Status: Resolved (was: Patch Available) > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Fix For: 3.0.0 > > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch, > HIVE-17874.05.patch, HIVE-17874.06.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.06.patch Rebased and synced to the top. Attaching version 6 patch. > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch, > HIVE-17874.05.patch, HIVE-17874.06.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.05.patch Fixed TestVectorizedColumnReader test failure. > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch, > HIVE-17874.05.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.04.patch Attaching it one more time to trigger precommit. > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch, HIVE-17874.04.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.03.patch The tests are working for me locally. I added {{--SORT_QUERY_RESULTS}} to make sure these are not flaky failures. Attaching the patch one more time. > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch, HIVE-17874.03.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.02.patch > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch, > HIVE-17874.02.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Status: Patch Available (was: Open) > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Attachment: HIVE-17874.01.patch HIVE-17874.01-branch-2.patch > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Updated] (HIVE-17874) Parquet vectorization fails on tables with complex columns when there are no projected columns
[ https://issues.apache.org/jira/browse/HIVE-17874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vihang Karajgaonkar updated HIVE-17874: --- Affects Version/s: 2.2.0 > Parquet vectorization fails on tables with complex columns when there are no > projected columns > -- > > Key: HIVE-17874 > URL: https://issues.apache.org/jira/browse/HIVE-17874 > Project: Hive > Issue Type: Sub-task >Affects Versions: 2.2.0 >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar > Attachments: HIVE-17874.01-branch-2.patch, HIVE-17874.01.patch > > > When a parquet table contains an unsupported type like {{Map}}, {{LIST}} or > {{UNION}} simple queries like {{select count(*) from table}} fails with > {{unsupported type exception}} even though vectorized reader doesn't really > need read the complex type into batches. -- This message was sent by Atlassian JIRA (v6.4.14#64029)