[jira] [Work logged] (HIVE-27258) Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client
[ https://issues.apache.org/jira/browse/HIVE-27258?focusedWorklogId=856635&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856635 ] ASF GitHub Bot logged work on HIVE-27258: - Author: ASF GitHub Bot Created on: 13/Apr/23 04:45 Start Date: 13/Apr/23 04:45 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #4227: URL: https://github.com/apache/hive/pull/4227#issuecomment-1506338668 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4227) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4227&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4227&resolved=false&types=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4227&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4227&metric=coverage&view=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4227&metric=duplicated_lines_density&view=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 856635) Time Spent: 0.5h (was: 20m) > Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client > --- > > Key: HIVE-27258 > URL: https://issues.apache.org/jira/browse/HIVE-27258 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar >Priority: Minor > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > In HIVE-27129 we added support to add additional headers to be sent to the > metastore. However, it uses Splitter.splitToList API from Guava API which is > in beta and is not available in older guava releases. It is simpler to avoid > using this API to avoid issues when a different version of guava is in > classpath. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27163) Column stats are not getting published after an insert query into an external table with custom location
[
https://issues.apache.org/jira/browse/HIVE-27163?focusedWorklogId=856629&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856629
]
ASF GitHub Bot logged work on HIVE-27163:
-
Author: ASF GitHub Bot
Created on: 13/Apr/23 03:42
Start Date: 13/Apr/23 03:42
Worklog Time Spent: 10m
Work Description: sonarcloud[bot] commented on PR #4228:
URL: https://github.com/apache/hive/pull/4228#issuecomment-1506291668
Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4228)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=BUG)
[0
Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=VULNERABILITY)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=VULNERABILITY)
[0
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=VULNERABILITY)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4228&resolved=false&types=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4228&resolved=false&types=SECURITY_HOTSPOT)
[0 Security
Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4228&resolved=false&types=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=CODE_SMELL)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=CODE_SMELL)
[3 Code
Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4228&resolved=false&types=CODE_SMELL)
[](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4228&metric=coverage&view=list)
No Coverage information
[](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4228&metric=duplicated_lines_density&view=list)
No Duplication information
Issue Time Tracking
---
Worklog Id: (was: 856629)
Time Spent: 20m (was: 10m)
> Column stats are not getting published after an insert query into an external
> table with custom location
>
>
> Key: HIVE-27163
> URL: https://issues.apache.org/jira/browse/HIVE-27163
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Taraka Rama Rao Lethavadla
>Assignee: Zhihua Deng
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Test case details are below
> *test.q*
> {noformat}
> set hive.stats.column.autogather=true;
> set hive.stats.autogather=true;
> dfs ${system:test.dfs.mkdir} ${system:test.tmp.dir}/test;
> create external table test_custom(age int, name string) stored as orc
> location '/tmp/test';
> insert into test_custom select 1, 'test';
> desc formatted test_custom age;{noformat}
> *test.q.out*
>
>
> {noformat}
> A masked pattern was here
> PREHOOK: type: CREATETABLE
>
[jira] [Work logged] (HIVE-27163) Column stats are not getting published after an insert query into an external table with custom location
[
https://issues.apache.org/jira/browse/HIVE-27163?focusedWorklogId=856623&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856623
]
ASF GitHub Bot logged work on HIVE-27163:
-
Author: ASF GitHub Bot
Created on: 13/Apr/23 02:55
Start Date: 13/Apr/23 02:55
Worklog Time Spent: 10m
Work Description: dengzhhu653 opened a new pull request, #4228:
URL: https://github.com/apache/hive/pull/4228
…ery into an external table with custom location
### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
Issue Time Tracking
---
Worklog Id: (was: 856623)
Remaining Estimate: 0h
Time Spent: 10m
> Column stats are not getting published after an insert query into an external
> table with custom location
>
>
> Key: HIVE-27163
> URL: https://issues.apache.org/jira/browse/HIVE-27163
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Taraka Rama Rao Lethavadla
>Assignee: Zhihua Deng
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Test case details are below
> *test.q*
> {noformat}
> set hive.stats.column.autogather=true;
> set hive.stats.autogather=true;
> dfs ${system:test.dfs.mkdir} ${system:test.tmp.dir}/test;
> create external table test_custom(age int, name string) stored as orc
> location '/tmp/test';
> insert into test_custom select 1, 'test';
> desc formatted test_custom age;{noformat}
> *test.q.out*
>
>
> {noformat}
> A masked pattern was here
> PREHOOK: type: CREATETABLE
> A masked pattern was here
> PREHOOK: Output: database:default
> PREHOOK: Output: default@test_custom
> A masked pattern was here
> POSTHOOK: type: CREATETABLE
> A masked pattern was here
> POSTHOOK: Output: database:default
> POSTHOOK: Output: default@test_custom
> PREHOOK: query: insert into test_custom select 1, 'test'
> PREHOOK: type: QUERY
> PREHOOK: Input: _dummy_database@_dummy_table
> PREHOOK: Output: default@test_custom
> POSTHOOK: query: insert into test_custom select 1, 'test'
> POSTHOOK: type: QUERY
> POSTHOOK: Input: _dummy_database@_dummy_table
> POSTHOOK: Output: default@test_custom
> POSTHOOK: Lineage: test_custom.age SIMPLE []
> POSTHOOK: Lineage: test_custom.name SIMPLE []
> PREHOOK: query: desc formatted test_custom age
> PREHOOK: type: DESCTABLE
> PREHOOK: Input: default@test_custom
> POSTHOOK: query: desc formatted test_custom age
> POSTHOOK: type: DESCTABLE
> POSTHOOK: Input: default@test_custom
> col_name age
> data_type int
> min
> max
> num_nulls
> distinct_count
> avg_col_len
> max_col_len
> num_trues
> num_falses
> bit_vector
> comment from deserializer{noformat}
> As we can see from desc formatted output, column stats were not populated
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-27163) Column stats are not getting published after an insert query into an external table with custom location
[
https://issues.apache.org/jira/browse/HIVE-27163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-27163:
--
Labels: pull-request-available (was: )
> Column stats are not getting published after an insert query into an external
> table with custom location
>
>
> Key: HIVE-27163
> URL: https://issues.apache.org/jira/browse/HIVE-27163
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Reporter: Taraka Rama Rao Lethavadla
>Assignee: Zhihua Deng
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Test case details are below
> *test.q*
> {noformat}
> set hive.stats.column.autogather=true;
> set hive.stats.autogather=true;
> dfs ${system:test.dfs.mkdir} ${system:test.tmp.dir}/test;
> create external table test_custom(age int, name string) stored as orc
> location '/tmp/test';
> insert into test_custom select 1, 'test';
> desc formatted test_custom age;{noformat}
> *test.q.out*
>
>
> {noformat}
> A masked pattern was here
> PREHOOK: type: CREATETABLE
> A masked pattern was here
> PREHOOK: Output: database:default
> PREHOOK: Output: default@test_custom
> A masked pattern was here
> POSTHOOK: type: CREATETABLE
> A masked pattern was here
> POSTHOOK: Output: database:default
> POSTHOOK: Output: default@test_custom
> PREHOOK: query: insert into test_custom select 1, 'test'
> PREHOOK: type: QUERY
> PREHOOK: Input: _dummy_database@_dummy_table
> PREHOOK: Output: default@test_custom
> POSTHOOK: query: insert into test_custom select 1, 'test'
> POSTHOOK: type: QUERY
> POSTHOOK: Input: _dummy_database@_dummy_table
> POSTHOOK: Output: default@test_custom
> POSTHOOK: Lineage: test_custom.age SIMPLE []
> POSTHOOK: Lineage: test_custom.name SIMPLE []
> PREHOOK: query: desc formatted test_custom age
> PREHOOK: type: DESCTABLE
> PREHOOK: Input: default@test_custom
> POSTHOOK: query: desc formatted test_custom age
> POSTHOOK: type: DESCTABLE
> POSTHOOK: Input: default@test_custom
> col_name age
> data_type int
> min
> max
> num_nulls
> distinct_count
> avg_col_len
> max_col_len
> num_trues
> num_falses
> bit_vector
> comment from deserializer{noformat}
> As we can see from desc formatted output, column stats were not populated
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27258) Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client
[ https://issues.apache.org/jira/browse/HIVE-27258?focusedWorklogId=856603&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856603 ] ASF GitHub Bot logged work on HIVE-27258: - Author: ASF GitHub Bot Created on: 13/Apr/23 00:00 Start Date: 13/Apr/23 00:00 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #4227: URL: https://github.com/apache/hive/pull/4227#issuecomment-1506115499 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4227) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4227&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4227&resolved=false&types=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4227&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=CODE_SMELL) [1 Code Smell](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4227&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4227&metric=coverage&view=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4227&metric=duplicated_lines_density&view=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 856603) Time Spent: 20m (was: 10m) > Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client > --- > > Key: HIVE-27258 > URL: https://issues.apache.org/jira/browse/HIVE-27258 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar >Priority: Minor > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > In HIVE-27129 we added support to add additional headers to be sent to the > metastore. However, it uses Splitter.splitToList API from Guava API which is > in beta and is not available in older guava releases. It is simpler to avoid > using this API to avoid issues when a different version of guava is in > classpath. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27258) Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client
[ https://issues.apache.org/jira/browse/HIVE-27258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27258: -- Labels: pull-request-available (was: ) > Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client > --- > > Key: HIVE-27258 > URL: https://issues.apache.org/jira/browse/HIVE-27258 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > In HIVE-27129 we added support to add additional headers to be sent to the > metastore. However, it uses Splitter.splitToList API from Guava API which is > in beta and is not available in older guava releases. It is simpler to avoid > using this API to avoid issues when a different version of guava is in > classpath. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27258) Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client
[ https://issues.apache.org/jira/browse/HIVE-27258?focusedWorklogId=856594&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856594 ] ASF GitHub Bot logged work on HIVE-27258: - Author: ASF GitHub Bot Created on: 12/Apr/23 23:05 Start Date: 12/Apr/23 23:05 Worklog Time Spent: 10m Work Description: vihangk1 opened a new pull request, #4227: URL: https://github.com/apache/hive/pull/4227 ### What changes were proposed in this pull request? This PR removes the call Splitter.splitToList from the metastore HTTP client and replaces it with a simple split call. ### Why are the changes needed? Some open source distributions have a different guava version which do not have this Splitter API. In such distributions the standalone hive metastore client code fails. ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Existing unit tests cover this change. Issue Time Tracking --- Worklog Id: (was: 856594) Remaining Estimate: 0h Time Spent: 10m > Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client > --- > > Key: HIVE-27258 > URL: https://issues.apache.org/jira/browse/HIVE-27258 > Project: Hive > Issue Type: Improvement >Reporter: Vihang Karajgaonkar >Assignee: Vihang Karajgaonkar >Priority: Minor > Time Spent: 10m > Remaining Estimate: 0h > > In HIVE-27129 we added support to add additional headers to be sent to the > metastore. However, it uses Splitter.splitToList API from Guava API which is > in beta and is not available in older guava releases. It is simpler to avoid > using this API to avoid issues when a different version of guava is in > classpath. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27258) Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client
Vihang Karajgaonkar created HIVE-27258: -- Summary: Remove usage of Splitter.splitToList in HiveMetaStoreClient HTTP client Key: HIVE-27258 URL: https://issues.apache.org/jira/browse/HIVE-27258 Project: Hive Issue Type: Improvement Reporter: Vihang Karajgaonkar Assignee: Vihang Karajgaonkar In HIVE-27129 we added support to add additional headers to be sent to the metastore. However, it uses Splitter.splitToList API from Guava API which is in beta and is not available in older guava releases. It is simpler to avoid using this API to avoid issues when a different version of guava is in classpath. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27158) Store hive columns stats in puffin files for iceberg tables
[ https://issues.apache.org/jira/browse/HIVE-27158?focusedWorklogId=856571&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856571 ] ASF GitHub Bot logged work on HIVE-27158: - Author: ASF GitHub Bot Created on: 12/Apr/23 21:03 Start Date: 12/Apr/23 21:03 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #4131: URL: https://github.com/apache/hive/pull/4131#issuecomment-1505941900 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4131) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4131&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4131&resolved=false&types=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4131&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=CODE_SMELL) [6 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4131&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4131&metric=coverage&view=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4131&metric=duplicated_lines_density&view=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 856571) Time Spent: 9h (was: 8h 50m) > Store hive columns stats in puffin files for iceberg tables > --- > > Key: HIVE-27158 > URL: https://issues.apache.org/jira/browse/HIVE-27158 > Project: Hive > Issue Type: Improvement >Reporter: Simhadri Govindappa >Assignee: Simhadri Govindappa >Priority: Major > Labels: pull-request-available > Time Spent: 9h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27186) A persistent property store
[ https://issues.apache.org/jira/browse/HIVE-27186?focusedWorklogId=856543&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856543 ] ASF GitHub Bot logged work on HIVE-27186: - Author: ASF GitHub Bot Created on: 12/Apr/23 18:43 Start Date: 12/Apr/23 18:43 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #4194: URL: https://github.com/apache/hive/pull/4194#issuecomment-1505757045 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4194) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=BUG) [4 Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4194&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4194&resolved=false&types=SECURITY_HOTSPOT) [1 Security Hotspot](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4194&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=CODE_SMELL) [85 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4194&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4194&metric=coverage&view=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4194&metric=duplicated_lines_density&view=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 856543) Time Spent: 1h 20m (was: 1h 10m) > A persistent property store > > > Key: HIVE-27186 > URL: https://issues.apache.org/jira/browse/HIVE-27186 > Project: Hive > Issue Type: Improvement > Components: Metastore >Affects Versions: 4.0.0-alpha-2 >Reporter: Henri Biestro >Priority: Major > Labels: pull-request-available > Time Spent: 1h 20m > Remaining Estimate: 0h > > WHAT > A persistent property store usable as a support facility for any metadata > augmentation feature. > WHY > When adding new meta-data oriented features, we usually need to persist > information linking the feature data and the HiveMetaStore objects it applies > to. Any information related to a database, a table or the cluster - like > statistics for example or any operational data state or data (think rolling > backup) - fall in this use-case. > Typically, accommodating such a feature requires modifying the Metastore > database schema by adding or altering a table. It also usually implies > modifying
[jira] [Work logged] (HIVE-27256) Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with dynamic partition
[ https://issues.apache.org/jira/browse/HIVE-27256?focusedWorklogId=856523&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856523 ] ASF GitHub Bot logged work on HIVE-27256: - Author: ASF GitHub Bot Created on: 12/Apr/23 18:03 Start Date: 12/Apr/23 18:03 Worklog Time Spent: 10m Work Description: amanraj2520 commented on PR #4226: URL: https://github.com/apache/hive/pull/4226#issuecomment-1505708862 @abstractdog @vihangk1 @zabetak Can you please review this Issue Time Tracking --- Worklog Id: (was: 856523) Time Spent: 20m (was: 10m) > Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with > dynamic partition > - > > Key: HIVE-27256 > URL: https://issues.apache.org/jira/browse/HIVE-27256 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27257) Database object is missing owner info in the CreateDatabaseRequest
Sai Hemanth Gantasala created HIVE-27257:
Summary: Database object is missing owner info in the
CreateDatabaseRequest
Key: HIVE-27257
URL: https://issues.apache.org/jira/browse/HIVE-27257
Project: Hive
Issue Type: Bug
Components: HiveServer2
Reporter: Sai Hemanth Gantasala
Assignee: Sai Hemanth Gantasala
CreateDatabaseRequest should have owner info so that \{OWNER} policies are
honoured in authorization services like ranger/sentry.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (HIVE-25073) Optimise HiveAlterHandler::alterPartitions
[
https://issues.apache.org/jira/browse/HIVE-25073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Naveen Gangam resolved HIVE-25073.
--
Resolution: Cannot Reproduce
Closing based on the comment above.
> Optimise HiveAlterHandler::alterPartitions
> --
>
> Key: HIVE-25073
> URL: https://issues.apache.org/jira/browse/HIVE-25073
> Project: Hive
> Issue Type: Improvement
> Components: Metastore
>Reporter: Rajesh Balamohan
>Assignee: Harshit Gupta
>Priority: Major
>
> Table details are populated again and again for each partition, which can be
> avoided.
> https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HMSHandler.java#L5892
> https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java#L808
> Following stacktrace may be relevant for apache master as well.
> {noformat}
> at org.datanucleus.store.query.Query.executeWithArray(Query.java:1744)
> at org.datanucleus.api.jdo.JDOQuery.executeInternal(JDOQuery.java:368)
> at org.datanucleus.api.jdo.JDOQuery.execute(JDOQuery.java:255)
> at
> org.apache.hadoop.hive.metastore.ObjectStore.getMTable(ObjectStore.java:2113)
> at
> org.apache.hadoop.hive.metastore.ObjectStore.getMTable(ObjectStore.java:2152)
> at
> org.apache.hadoop.hive.metastore.ObjectStore.alterPartitionNoTxn(ObjectStore.java:4951)
> at
> org.apache.hadoop.hive.metastore.ObjectStore.alterPartitions(ObjectStore.java:5057)
> at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
> at com.sun.proxy.$Proxy27.alterPartitions(Unknown Source)
> at
> org.apache.hadoop.hive.metastore.HiveAlterHandler.alterPartitions(HiveAlterHandler.java:798)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_with_environment_context(HiveMetaStore.java:5695)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_partitions_req(HiveMetaStore.java:5647)
> at sun.reflect.GeneratedMethodAccessor67.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
> at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
> at com.sun.proxy.$Proxy28.alter_partitions_req(Unknown Source)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_partitions_req.getResult(ThriftHiveMetastore.java:18557)
> at
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_partitions_req.getResult(ThriftHiveMetastore.java:18541)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:643)
> at
> org.apache.hadoop.hive.metastore.security.HadoopThriftAuthBridge$Server$TUGIAssumingProcessor$1.run(HadoopThriftAuthBridge.java:638)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27164) Create Temp Txn Table As Select is failing at tablePath validation
[
https://issues.apache.org/jira/browse/HIVE-27164?focusedWorklogId=856496&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856496
]
ASF GitHub Bot logged work on HIVE-27164:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 16:33
Start Date: 12/Apr/23 16:33
Worklog Time Spent: 10m
Work Description: saihemanth-cloudera merged PR #4176:
URL: https://github.com/apache/hive/pull/4176
Issue Time Tracking
---
Worklog Id: (was: 856496)
Time Spent: 3.5h (was: 3h 20m)
> Create Temp Txn Table As Select is failing at tablePath validation
> --
>
> Key: HIVE-27164
> URL: https://issues.apache.org/jira/browse/HIVE-27164
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, Metastore
>Reporter: Naresh P R
>Assignee: Venugopal Reddy K
>Priority: Major
> Labels: pull-request-available
> Attachments: mm_cttas.q
>
> Time Spent: 3.5h
> Remaining Estimate: 0h
>
> After HIVE-25303, every CTAS goes for
> HiveMetaStore$HMSHandler#translate_table_dryrun() call to fetch table
> location for CTAS queries which fails with following exception for temp
> tables if MetastoreDefaultTransformer is set.
> {code:java}
> 2023-03-17 16:41:23,390 INFO
> org.apache.hadoop.hive.metastore.MetastoreDefaultTransformer:
> [pool-6-thread-196]: Starting translation for CreateTable for processor
> HMSClient-@localhost with [EXTWRITE, EXTREAD, HIVEBUCKET2, HIVEFULLACIDREAD,
> HIVEFULLACIDWRITE, HIVECACHEINVALIDATE, HIVEMANAGESTATS,
> HIVEMANAGEDINSERTWRITE, HIVEMANAGEDINSERTREAD, HIVESQL, HIVEMQT,
> HIVEONLYMQTWRITE] on table test_temp
> 2023-03-17 16:41:23,392 ERROR
> org.apache.hadoop.hive.metastore.RetryingHMSHandler: [pool-6-thread-196]:
> MetaException(message:Illegal location for managed table, it has to be within
> database's managed location)
> at
> org.apache.hadoop.hive.metastore.MetastoreDefaultTransformer.validateTablePaths(MetastoreDefaultTransformer.java:886)
> at
> org.apache.hadoop.hive.metastore.MetastoreDefaultTransformer.transformCreateTable(MetastoreDefaultTransformer.java:666)
> at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.translate_table_dryrun(HiveMetaStore.java:2164)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) {code}
> I am able to repro this issue using attached testcase. [^mm_cttas.q]
>
> There are multiple ways to fix this issue
> * Have temp txn table path under db's managed location path. This will help
> with encryption zone paths as well.
> * Skip location check for temp tables at
> MetastoreDefaultTransformer#validateTablePaths()
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?focusedWorklogId=856486&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856486
]
ASF GitHub Bot logged work on HIVE-27253:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 15:53
Start Date: 12/Apr/23 15:53
Worklog Time Spent: 10m
Work Description: amansinha100 commented on code in PR #4223:
URL: https://github.com/apache/hive/pull/4223#discussion_r116413
##
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTConverter.java:
##
@@ -218,6 +218,13 @@ private static ASTNode createNullField(RelDataType
fieldType) {
return mapCallNode.node();
}
+if (fieldType.getSqlTypeName() == SqlTypeName.ARRAY) {
Review Comment:
Ah, missed that. Can we add q tests for struct and map as well ?
Issue Time Tracking
---
Worklog Id: (was: 856486)
Time Spent: 1h 10m (was: 1h)
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h 10m
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27256) Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with dynamic partition
[ https://issues.apache.org/jira/browse/HIVE-27256?focusedWorklogId=856484&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856484 ] ASF GitHub Bot logged work on HIVE-27256: - Author: ASF GitHub Bot Created on: 12/Apr/23 15:46 Start Date: 12/Apr/23 15:46 Worklog Time Spent: 10m Work Description: amanraj2520 opened a new pull request, #4226: URL: https://github.com/apache/hive/pull/4226 JIRA link : https://issues.apache.org/jira/browse/HIVE-27256 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Issue Time Tracking --- Worklog Id: (was: 856484) Remaining Estimate: 0h Time Spent: 10m > Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with > dynamic partition > - > > Key: HIVE-27256 > URL: https://issues.apache.org/jira/browse/HIVE-27256 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27256) Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with dynamic partition
[ https://issues.apache.org/jira/browse/HIVE-27256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27256: -- Labels: pull-request-available (was: ) > Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with > dynamic partition > - > > Key: HIVE-27256 > URL: https://issues.apache.org/jira/browse/HIVE-27256 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27256) Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with dynamic partition
Aman Raj created HIVE-27256: --- Summary: Backport of HIVE-24020 : Fix Automatic compaction for streaming ingest with dynamic partition Key: HIVE-27256 URL: https://issues.apache.org/jira/browse/HIVE-27256 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27255) Backport of HIVE-18786 "NPE in Hive windowing functions"
[ https://issues.apache.org/jira/browse/HIVE-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27255: -- Labels: pull-request-available (was: ) > Backport of HIVE-18786 "NPE in Hive windowing functions" > > > Key: HIVE-27255 > URL: https://issues.apache.org/jira/browse/HIVE-27255 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27255) Backport of HIVE-18786 "NPE in Hive windowing functions"
[ https://issues.apache.org/jira/browse/HIVE-27255?focusedWorklogId=856469&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856469 ] ASF GitHub Bot logged work on HIVE-27255: - Author: ASF GitHub Bot Created on: 12/Apr/23 15:01 Start Date: 12/Apr/23 15:01 Worklog Time Spent: 10m Work Description: amanraj2520 opened a new pull request, #4225: URL: https://github.com/apache/hive/pull/4225 JIRA link : https://issues.apache.org/jira/browse/HIVE-27255 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Issue Time Tracking --- Worklog Id: (was: 856469) Remaining Estimate: 0h Time Spent: 10m > Backport of HIVE-18786 "NPE in Hive windowing functions" > > > Key: HIVE-27255 > URL: https://issues.apache.org/jira/browse/HIVE-27255 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27255) Backport of HIVE-18786 "NPE in Hive windowing functions"
Aman Raj created HIVE-27255: --- Summary: Backport of HIVE-18786 "NPE in Hive windowing functions" Key: HIVE-27255 URL: https://issues.apache.org/jira/browse/HIVE-27255 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27254) Backport of HIVE-22136 Turn on tez.bucket.pruning
[ https://issues.apache.org/jira/browse/HIVE-27254?focusedWorklogId=856468&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856468 ] ASF GitHub Bot logged work on HIVE-27254: - Author: ASF GitHub Bot Created on: 12/Apr/23 14:49 Start Date: 12/Apr/23 14:49 Worklog Time Spent: 10m Work Description: amanraj2520 opened a new pull request, #4224: URL: https://github.com/apache/hive/pull/4224 JIRA link : https://issues.apache.org/jira/browse/HIVE-27254 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Issue Time Tracking --- Worklog Id: (was: 856468) Remaining Estimate: 0h Time Spent: 10m > Backport of HIVE-22136 Turn on tez.bucket.pruning > - > > Key: HIVE-27254 > URL: https://issues.apache.org/jira/browse/HIVE-27254 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27254) Backport of HIVE-22136 Turn on tez.bucket.pruning
Aman Raj created HIVE-27254: --- Summary: Backport of HIVE-22136 Turn on tez.bucket.pruning Key: HIVE-27254 URL: https://issues.apache.org/jira/browse/HIVE-27254 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27254) Backport of HIVE-22136 Turn on tez.bucket.pruning
[ https://issues.apache.org/jira/browse/HIVE-27254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27254: -- Labels: pull-request-available (was: ) > Backport of HIVE-22136 Turn on tez.bucket.pruning > - > > Key: HIVE-27254 > URL: https://issues.apache.org/jira/browse/HIVE-27254 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?focusedWorklogId=856466&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856466
]
ASF GitHub Bot logged work on HIVE-27253:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 14:36
Start Date: 12/Apr/23 14:36
Worklog Time Spent: 10m
Work Description: kasakrisz commented on code in PR #4223:
URL: https://github.com/apache/hive/pull/4223#discussion_r1164233550
##
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTConverter.java:
##
@@ -218,6 +218,13 @@ private static ASTNode createNullField(RelDataType
fieldType) {
return mapCallNode.node();
}
+if (fieldType.getSqlTypeName() == SqlTypeName.ARRAY) {
Review Comment:
those are handled above this change:
https://github.com/apache/hive/blob/53cb10347bec803008b17ff05c48536fe9e722e9/ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTConverter.java#L203-L219
Issue Time Tracking
---
Worklog Id: (was: 856466)
Time Spent: 1h (was: 50m)
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27249) Backport HIVE-23619 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27249?focusedWorklogId=856465&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856465 ] ASF GitHub Bot logged work on HIVE-27249: - Author: ASF GitHub Bot Created on: 12/Apr/23 14:35 Start Date: 12/Apr/23 14:35 Worklog Time Spent: 10m Work Description: amanraj2520 commented on PR #4220: URL: https://github.com/apache/hive/pull/4220#issuecomment-1505390186 @zabetak @vihangk1 @abstractdog Can you please review this. Issue Time Tracking --- Worklog Id: (was: 856465) Time Spent: 20m (was: 10m) > Backport HIVE-23619 to branch-3 > --- > > Key: HIVE-27249 > URL: https://issues.apache.org/jira/browse/HIVE-27249 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > Backport HIVE-23619 to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27250) Backport of HIVE-22599 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27250?focusedWorklogId=856464&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856464 ] ASF GitHub Bot logged work on HIVE-27250: - Author: ASF GitHub Bot Created on: 12/Apr/23 14:34 Start Date: 12/Apr/23 14:34 Worklog Time Spent: 10m Work Description: amanraj2520 commented on PR #4221: URL: https://github.com/apache/hive/pull/4221#issuecomment-1505388438 @vihangk1 Can you please approve this. Issue Time Tracking --- Worklog Id: (was: 856464) Time Spent: 20m (was: 10m) > Backport of HIVE-22599 to branch-3 > -- > > Key: HIVE-27250 > URL: https://issues.apache.org/jira/browse/HIVE-27250 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?focusedWorklogId=856458&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856458
]
ASF GitHub Bot logged work on HIVE-27253:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 14:21
Start Date: 12/Apr/23 14:21
Worklog Time Spent: 10m
Work Description: amansinha100 commented on code in PR #4223:
URL: https://github.com/apache/hive/pull/4223#discussion_r1164211860
##
ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/translator/ASTConverter.java:
##
@@ -218,6 +218,13 @@ private static ASTNode createNullField(RelDataType
fieldType) {
return mapCallNode.node();
}
+if (fieldType.getSqlTypeName() == SqlTypeName.ARRAY) {
Review Comment:
What about other complex types .. STRUCT and MAP ?
e.g create table t1 (c3 struct );
CREATE TABLE t2 (c1 int, c2 map);
A struct can also appear within an array but that might be handled by this
code change.
Issue Time Tracking
---
Worklog Id: (was: 856458)
Time Spent: 50m (was: 40m)
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?focusedWorklogId=856453&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856453
]
ASF GitHub Bot logged work on HIVE-27253:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 14:09
Start Date: 12/Apr/23 14:09
Worklog Time Spent: 10m
Work Description: sonarcloud[bot] commented on PR #4223:
URL: https://github.com/apache/hive/pull/4223#issuecomment-1505347378
Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4223)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=BUG)
[0
Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=BUG)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=VULNERABILITY)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=VULNERABILITY)
[0
Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=VULNERABILITY)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4223&resolved=false&types=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4223&resolved=false&types=SECURITY_HOTSPOT)
[0 Security
Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4223&resolved=false&types=SECURITY_HOTSPOT)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=CODE_SMELL)
[](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=CODE_SMELL)
[0 Code
Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4223&resolved=false&types=CODE_SMELL)
[](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4223&metric=coverage&view=list)
No Coverage information
[](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4223&metric=duplicated_lines_density&view=list)
No Duplication information
Issue Time Tracking
---
Worklog Id: (was: 856453)
Time Spent: 40m (was: 0.5h)
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?focusedWorklogId=856436&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856436
]
ASF GitHub Bot logged work on HIVE-27253:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 12:36
Start Date: 12/Apr/23 12:36
Worklog Time Spent: 10m
Work Description: kasakrisz commented on PR #4223:
URL: https://github.com/apache/hive/pull/4223#issuecomment-1505201267
@zabetak
Thanks for the review.
A1 is ok since one element is sufficient to represent the type and this is
what happens at the code level. Fixed the description.
Issue Time Tracking
---
Worklog Id: (was: 856436)
Time Spent: 0.5h (was: 20m)
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?focusedWorklogId=856422&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856422
]
ASF GitHub Bot logged work on HIVE-27253:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 12:11
Start Date: 12/Apr/23 12:11
Worklog Time Spent: 10m
Work Description: zabetak commented on PR #4223:
URL: https://github.com/apache/hive/pull/4223#issuecomment-1505163499
Also regarding the empty ARRAY representation should it be the A1 or A1?
**A1**
```
TOK_SELEXPR
TOK_FUNCTION
array
TOK_FUNCTION
TOK_INT
TOK_NULL
```
**A2**
```
TOK_SELEXPR
TOK_FUNCTION
array
TOK_FUNCTION
TOK_INT
TOK_NULL
TOK_FUNCTION
TOK_INT
TOK_NULL
```
I see that **A2** is mentioned in the description of the PR but I would
expect that it was **A1**.
Issue Time Tracking
---
Worklog Id: (was: 856422)
Time Spent: 20m (was: 10m)
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?focusedWorklogId=856405&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856405
]
ASF GitHub Bot logged work on HIVE-27253:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 11:03
Start Date: 12/Apr/23 11:03
Worklog Time Spent: 10m
Work Description: kasakrisz opened a new pull request, #4223:
URL: https://github.com/apache/hive/pull/4223
### What changes were proposed in this pull request?
When converting {{HiveValues([])}} which represents an operator never
produces rows to AST handle array types.
AST representation of an array of int with NULL elements should be
```
TOK_SELEXPR
TOK_FUNCTION
array
TOK_FUNCTION
TOK_INT
TOK_NULL
TOK_FUNCTION
TOK_INT
TOK_NULL
```
### Why are the changes needed?
Support array types
### Does this PR introduce _any_ user-facing change?
Yes. In case of CTAS statements when the query in the statement does not
produce any rows and the source table has an array type column where the
element type is other than string the target table still inherit the source
table schema.
### How was this patch tested?
```
vn test -Dtest.output.overwrite -Dtest=TestMiniLlapLocalCliDriver
-Dqfile=empty_result_ctas.q -pl itests/qtest -Pitests
```
Issue Time Tracking
---
Worklog Id: (was: 856405)
Remaining Estimate: 0h
Time Spent: 10m
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-27253:
--
Labels: pull-request-available (was: )
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-26400) Provide docker images for Hive
[ https://issues.apache.org/jira/browse/HIVE-26400?focusedWorklogId=856403&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856403 ] ASF GitHub Bot logged work on HIVE-26400: - Author: ASF GitHub Bot Created on: 12/Apr/23 10:53 Start Date: 12/Apr/23 10:53 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #3448: URL: https://github.com/apache/hive/pull/3448#issuecomment-1505067290 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=3448) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=3448&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=3448&resolved=false&types=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=3448&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=3448&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=3448&metric=coverage&view=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=3448&metric=duplicated_lines_density&view=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 856403) Time Spent: 13.5h (was: 13h 20m) > Provide docker images for Hive > -- > > Key: HIVE-26400 > URL: https://issues.apache.org/jira/browse/HIVE-26400 > Project: Hive > Issue Type: Sub-task > Components: Build Infrastructure >Reporter: Zhihua Deng >Assignee: Zhihua Deng >Priority: Blocker > Labels: hive-4.0.0-must, pull-request-available > Time Spent: 13.5h > Remaining Estimate: 0h > > Make Apache Hive be able to run inside docker container in pseudo-distributed > mode, with MySQL/Derby as its back database, provide the following: > * Quick-start/Debugging/Prepare a test env for Hive; > * Tools to build target image with specified version of Hive and its > dependencies; > * Images can be used as the basis for the Kubernetes operator. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27253) Support array type when query does not produce any rows
[
https://issues.apache.org/jira/browse/HIVE-27253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Krisztian Kasa updated HIVE-27253:
--
Summary: Support array type when query does not produce any rows (was:
Support array types when query does not produce any rows)
> Support array type when query does not produce any rows
> ---
>
> Key: HIVE-27253
> URL: https://issues.apache.org/jira/browse/HIVE-27253
> Project: Hive
> Issue Type: Improvement
> Components: CBO
>Reporter: Krisztian Kasa
>Assignee: Krisztian Kasa
>Priority: Major
>
> {code}
> CREATE TABLE T1 (c1 int, c2 array);
> CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
> describe formatted t2;
> {code}
> The new {{t2}} table schema should be
> {code}
> POSTHOOK: Input: default@t2
> # col_namedata_type comment
> c1int
> c2array
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HIVE-27253) Support array types when query does not produce any rows
Krisztian Kasa created HIVE-27253:
-
Summary: Support array types when query does not produce any rows
Key: HIVE-27253
URL: https://issues.apache.org/jira/browse/HIVE-27253
Project: Hive
Issue Type: Improvement
Components: CBO
Reporter: Krisztian Kasa
Assignee: Krisztian Kasa
{code}
CREATE TABLE T1 (c1 int, c2 array);
CREATE TABLE T2 AS SELECT * FROM T1 LIMIT 0;
describe formatted t2;
{code}
The new {{t2}} table schema should be
{code}
POSTHOOK: Input: default@t2
# col_name data_type comment
c1 int
c2 array
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-23548) TestActivePassiveHA is unstable
[
https://issues.apache.org/jira/browse/HIVE-23548?focusedWorklogId=856381&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856381
]
ASF GitHub Bot logged work on HIVE-23548:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 10:08
Start Date: 12/Apr/23 10:08
Worklog Time Spent: 10m
Work Description: rkirtir commented on code in PR #4214:
URL: https://github.com/apache/hive/pull/4214#discussion_r1163919706
##
itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestActivePassiveHA.java:
##
@@ -665,7 +666,18 @@ private String sendAuthMethod(HttpRequestBase method,
boolean enableAuth, boolea
httpResponse = client.execute(method);
- return EntityUtils.toString(httpResponse.getEntity());
+ if (httpResponse != null) {
+StatusLine statusLine = httpResponse.getStatusLine();
+if (statusLine != null) {
+ response = httpResponse.getStatusLine().getReasonPhrase();
+ statusCode = httpResponse.getStatusLine().getStatusCode();
+ if (statusCode == 200) {
+return EntityUtils.toString(httpResponse.getEntity());
+ }
Review Comment:
Only HTTP 200 contains response body other than this there is no/empty
response body. If we do not handle this
testManualFailoverUnauthorized() method fails at
assertTrue(sendDelete(url1, false).contains("Unauthorized"));
as it tries to get "Unauthorized" string from response body
Issue Time Tracking
---
Worklog Id: (was: 856381)
Time Spent: 1h (was: 50m)
> TestActivePassiveHA is unstable
> ---
>
> Key: HIVE-23548
> URL: https://issues.apache.org/jira/browse/HIVE-23548
> Project: Hive
> Issue Type: Sub-task
>Reporter: Zoltan Haindrich
>Assignee: KIRTI RUGE
>Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HIVE-27252) Fix build failure of Hive due to unresolved transitive dependency on javax.el
Masatake Iwasaki created HIVE-27252:
---
Summary: Fix build failure of Hive due to unresolved transitive
dependency on javax.el
Key: HIVE-27252
URL: https://issues.apache.org/jira/browse/HIVE-27252
Project: Hive
Issue Type: Bug
Reporter: Masatake Iwasaki
Assignee: Masatake Iwasaki
{noformat}
[ERROR] Failed to execute goal on project hive-hbase-handler: Could not resolve
dependencies for project org.apache.hive:hive-hbase-handler:jar:3.1.3: Failed
to collect dependencies at org.apache.hbase:hbase-server:jar:tests:2.4.13 ->
org.glassfish.web:javax.servlet.jsp:jar:2.3.2 ->
org.glassfish:javax.el:jar:3.0.1-b06-SNAPSHOT: Failed to read artifact
descriptor for org.glassfish:javax.el:jar:3.0.1-b06-SNAPSHOT: Could not
transfer artifact org.glassfish:javax.el:pom:3.0.1-b06-SNAPSHOT from/to
jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots):
Transfer failed for
https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom:
PKIX path building failed:
sun.security.provider.certpath.SunCertPathBuilderException: unable to find
valid certification path to requested target -> [Help 1]
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Work logged] (HIVE-27251) Backport of HIVE-22121 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27251?focusedWorklogId=856374&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856374 ] ASF GitHub Bot logged work on HIVE-27251: - Author: ASF GitHub Bot Created on: 12/Apr/23 09:46 Start Date: 12/Apr/23 09:46 Worklog Time Spent: 10m Work Description: amanraj2520 opened a new pull request, #4222: URL: https://github.com/apache/hive/pull/4222 JIRA link : https://issues.apache.org/jira/browse/HIVE-27251 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Issue Time Tracking --- Worklog Id: (was: 856374) Remaining Estimate: 0h Time Spent: 10m > Backport of HIVE-22121 to branch-3 > -- > > Key: HIVE-27251 > URL: https://issues.apache.org/jira/browse/HIVE-27251 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27251) Backport of HIVE-22121 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27251: -- Labels: pull-request-available (was: ) > Backport of HIVE-22121 to branch-3 > -- > > Key: HIVE-27251 > URL: https://issues.apache.org/jira/browse/HIVE-27251 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27251) Backport of HIVE-22121 to branch-3
Aman Raj created HIVE-27251: --- Summary: Backport of HIVE-22121 to branch-3 Key: HIVE-27251 URL: https://issues.apache.org/jira/browse/HIVE-27251 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27250) Backport of HIVE-22599 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27250: -- Labels: pull-request-available (was: ) > Backport of HIVE-22599 to branch-3 > -- > > Key: HIVE-27250 > URL: https://issues.apache.org/jira/browse/HIVE-27250 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27250) Backport of HIVE-22599 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27250?focusedWorklogId=856372&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856372 ] ASF GitHub Bot logged work on HIVE-27250: - Author: ASF GitHub Bot Created on: 12/Apr/23 09:40 Start Date: 12/Apr/23 09:40 Worklog Time Spent: 10m Work Description: amanraj2520 opened a new pull request, #4221: URL: https://github.com/apache/hive/pull/4221 JIRA link : https://issues.apache.org/jira/browse/HIVE-27250 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Issue Time Tracking --- Worklog Id: (was: 856372) Remaining Estimate: 0h Time Spent: 10m > Backport of HIVE-22599 to branch-3 > -- > > Key: HIVE-27250 > URL: https://issues.apache.org/jira/browse/HIVE-27250 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27250) Backport of HIVE-22599 to branch-3
Aman Raj created HIVE-27250: --- Summary: Backport of HIVE-22599 to branch-3 Key: HIVE-27250 URL: https://issues.apache.org/jira/browse/HIVE-27250 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-26400) Provide docker images for Hive
[
https://issues.apache.org/jira/browse/HIVE-26400?focusedWorklogId=856366&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856366
]
ASF GitHub Bot logged work on HIVE-26400:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 09:21
Start Date: 12/Apr/23 09:21
Worklog Time Spent: 10m
Work Description: deniskuzZ commented on code in PR #3448:
URL: https://github.com/apache/hive/pull/3448#discussion_r1163861025
##
packaging/src/docker/README.md:
##
@@ -0,0 +1,131 @@
+### Introduction
+
+---
+Run Apache Hive inside docker container in pseudo-distributed mode, provide
the following
+- Quick-start/Debugging/Prepare a test env for Hive
+
+
+### Quickstart
+
+---
+ Build image
+Apache Hive relies on Hadoop, Tez and some others to facilitate reading,
writing, and managing large datasets.
+The `build.sh` provides ways to build the image against specified version of
the dependent, as well as build from source.
+
+# Build from source
+```shell
+mvn clean package -pl packaging -DskipTests -Pdocker
+```
+# Build with specified version
+There are some arguments to specify the component version:
+```shell
+-hadoop
+-tez
+-hive
+```
+If the version is not provided, it will read the version from current
`pom.xml`:
+`project.version`, `hadoop.version` and `tez.version` for Hive, Hadoop and Tez
respectively.
+
+For example, the following command uses Hive 3.1.3, Hadoop `hadoop.version`
and Tez `tez.version` to build the image,
+```shell
+./build.sh -hive 3.1.3
+```
+If the command does not specify the Hive version, it will use the local
`apache-hive-${project.version}-bin.tar.gz`(will trigger a build if it doesn't
exist),
+together with Hadoop 3.1.0 and Tez 0.10.1 to build the image,
+```shell
+./build.sh -hadoop 3.1.0 -tez 0.10.1
+```
+After building successfully, we can get a Docker image named `apache/hive` by
default, the image is tagged by the provided Hive version.
+
+ Run services
+
+Before going further, we should define the environment variable `HIVE_VERSION`
first.
+For example, if `-hive 3.1.3` is specified to build the image,
+```shell
+export HIVE_VERSION=3.1.3
+```
+or assuming that you're relying on current `project.version` from pom.xml,
+```shell
+export HIVE_VERSION=$(mvn -f pom.xml -q help:evaluate
-Dexpression=project.version -DforceStdout)
+```
+- Metastore
+
+For a quick start, launch the Metastore with Derby,
+ ```shell
+ docker run -d -p 9083:9083 --env SERVICE_NAME=metastore --name
metastore-standalone apache/hive:${HIVE_VERSION}
+ ```
+ Everything would be lost when the service is down. In order to save the Hive
table's schema and data, start the container with an external Postgres and
Volume to keep them,
+
+ ```shell
+ docker run -d -p 9083:9083 --env SERVICE_NAME=metastore \
+ --env DB_DRIVER=postgres \
Review Comment:
👍
Issue Time Tracking
---
Worklog Id: (was: 856366)
Time Spent: 13h 20m (was: 13h 10m)
> Provide docker images for Hive
> --
>
> Key: HIVE-26400
> URL: https://issues.apache.org/jira/browse/HIVE-26400
> Project: Hive
> Issue Type: Sub-task
> Components: Build Infrastructure
>Reporter: Zhihua Deng
>Assignee: Zhihua Deng
>Priority: Blocker
> Labels: hive-4.0.0-must, pull-request-available
> Time Spent: 13h 20m
> Remaining Estimate: 0h
>
> Make Apache Hive be able to run inside docker container in pseudo-distributed
> mode, with MySQL/Derby as its back database, provide the following:
> * Quick-start/Debugging/Prepare a test env for Hive;
> * Tools to build target image with specified version of Hive and its
> dependencies;
> * Images can be used as the basis for the Kubernetes operator.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-27249) Backport HIVE-23619 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27249: -- Labels: pull-request-available (was: ) > Backport HIVE-23619 to branch-3 > --- > > Key: HIVE-27249 > URL: https://issues.apache.org/jira/browse/HIVE-27249 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Backport HIVE-23619 to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27249) Backport HIVE-23619 to branch-3
[ https://issues.apache.org/jira/browse/HIVE-27249?focusedWorklogId=856365&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856365 ] ASF GitHub Bot logged work on HIVE-27249: - Author: ASF GitHub Bot Created on: 12/Apr/23 09:19 Start Date: 12/Apr/23 09:19 Worklog Time Spent: 10m Work Description: amanraj2520 opened a new pull request, #4220: URL: https://github.com/apache/hive/pull/4220 JIRA link : https://issues.apache.org/jira/browse/HIVE-27249 ### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested? Issue Time Tracking --- Worklog Id: (was: 856365) Remaining Estimate: 0h Time Spent: 10m > Backport HIVE-23619 to branch-3 > --- > > Key: HIVE-27249 > URL: https://issues.apache.org/jira/browse/HIVE-27249 > Project: Hive > Issue Type: Sub-task >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Time Spent: 10m > Remaining Estimate: 0h > > Backport HIVE-23619 to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27249) Backport HIVE-23619 to branch-3
Aman Raj created HIVE-27249: --- Summary: Backport HIVE-23619 to branch-3 Key: HIVE-27249 URL: https://issues.apache.org/jira/browse/HIVE-27249 Project: Hive Issue Type: Sub-task Reporter: Aman Raj Assignee: Aman Raj Backport HIVE-23619 to branch-3 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-26751) Bug Fixes and Improvements for 3.2.0 release
[ https://issues.apache.org/jira/browse/HIVE-26751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Raj updated HIVE-26751: Parent: (was: HIVE-26748) Issue Type: Task (was: Sub-task) > Bug Fixes and Improvements for 3.2.0 release > > > Key: HIVE-26751 > URL: https://issues.apache.org/jira/browse/HIVE-26751 > Project: Hive > Issue Type: Task >Affects Versions: 3.1.3 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Blocker > Labels: hive-3.2.0-must, release-3.2.0 > > Creating subtask to track the bug fixes that will go as part of 3.2.0 release. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27205) Update jackson-databind for CVE fix for CVE-2022-42003
[ https://issues.apache.org/jira/browse/HIVE-27205?focusedWorklogId=856359&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856359 ] ASF GitHub Bot logged work on HIVE-27205: - Author: ASF GitHub Bot Created on: 12/Apr/23 08:20 Start Date: 12/Apr/23 08:20 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #4184: URL: https://github.com/apache/hive/pull/4184#issuecomment-1504862353 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4184) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=BUG) [0 Bugs](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4184&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4184&resolved=false&types=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4184&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=CODE_SMELL) [0 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4184&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4184&metric=coverage&view=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4184&metric=duplicated_lines_density&view=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 856359) Time Spent: 1h 40m (was: 1.5h) > Update jackson-databind for CVE fix for CVE-2022-42003 > -- > > Key: HIVE-27205 > URL: https://issues.apache.org/jira/browse/HIVE-27205 > Project: Hive > Issue Type: Task >Reporter: Diksha >Assignee: Diksha >Priority: Major > Labels: pull-request-available > Time Spent: 1h 40m > Remaining Estimate: 0h > > Update jackson-databind for CVE fix for CVE-2022-42003 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-27234) Iceberg: CREATE BRANCH SQL implementation
[ https://issues.apache.org/jira/browse/HIVE-27234?focusedWorklogId=856354&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856354 ] ASF GitHub Bot logged work on HIVE-27234: - Author: ASF GitHub Bot Created on: 12/Apr/23 08:00 Start Date: 12/Apr/23 08:00 Worklog Time Spent: 10m Work Description: sonarcloud[bot] commented on PR #4216: URL: https://github.com/apache/hive/pull/4216#issuecomment-1504835458 Kudos, SonarCloud Quality Gate passed! [](https://sonarcloud.io/dashboard?id=apache_hive&pullRequest=4216) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=BUG) [1 Bug](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=BUG) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=VULNERABILITY) [0 Vulnerabilities](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=VULNERABILITY) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4216&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4216&resolved=false&types=SECURITY_HOTSPOT) [0 Security Hotspots](https://sonarcloud.io/project/security_hotspots?id=apache_hive&pullRequest=4216&resolved=false&types=SECURITY_HOTSPOT) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=CODE_SMELL) [2 Code Smells](https://sonarcloud.io/project/issues?id=apache_hive&pullRequest=4216&resolved=false&types=CODE_SMELL) [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4216&metric=coverage&view=list) No Coverage information [](https://sonarcloud.io/component_measures?id=apache_hive&pullRequest=4216&metric=duplicated_lines_density&view=list) No Duplication information Issue Time Tracking --- Worklog Id: (was: 856354) Time Spent: 50m (was: 40m) > Iceberg: CREATE BRANCH SQL implementation > -- > > Key: HIVE-27234 > URL: https://issues.apache.org/jira/browse/HIVE-27234 > Project: Hive > Issue Type: Sub-task > Components: Iceberg integration >Reporter: zhangbutao >Assignee: zhangbutao >Priority: Major > Labels: pull-request-available > Time Spent: 50m > Remaining Estimate: 0h > > Maybe we can follow spark sql about branch ddl implementation > [https://github.com/apache/iceberg/pull/6617] -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work logged] (HIVE-23548) TestActivePassiveHA is unstable
[
https://issues.apache.org/jira/browse/HIVE-23548?focusedWorklogId=856353&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-856353
]
ASF GitHub Bot logged work on HIVE-23548:
-
Author: ASF GitHub Bot
Created on: 12/Apr/23 08:00
Start Date: 12/Apr/23 08:00
Worklog Time Spent: 10m
Work Description: veghlaci05 commented on code in PR #4214:
URL: https://github.com/apache/hive/pull/4214#discussion_r1163767143
##
itests/hive-unit/src/test/java/org/apache/hive/jdbc/TestActivePassiveHA.java:
##
@@ -665,7 +666,18 @@ private String sendAuthMethod(HttpRequestBase method,
boolean enableAuth, boolea
httpResponse = client.execute(method);
- return EntityUtils.toString(httpResponse.getEntity());
+ if (httpResponse != null) {
+StatusLine statusLine = httpResponse.getStatusLine();
+if (statusLine != null) {
+ response = httpResponse.getStatusLine().getReasonPhrase();
+ statusCode = httpResponse.getStatusLine().getStatusCode();
+ if (statusCode == 200) {
+return EntityUtils.toString(httpResponse.getEntity());
+ }
Review Comment:
Why this is needed only for HTTP 200? For any other response code this
function will return `response`, which is actually
`httpResponse.getStatusLine().getReasonPhrase()`. I don't get why this is
needed.
Issue Time Tracking
---
Worklog Id: (was: 856353)
Time Spent: 50m (was: 40m)
> TestActivePassiveHA is unstable
> ---
>
> Key: HIVE-23548
> URL: https://issues.apache.org/jira/browse/HIVE-23548
> Project: Hive
> Issue Type: Sub-task
>Reporter: Zoltan Haindrich
>Assignee: KIRTI RUGE
>Priority: Major
> Labels: pull-request-available
> Time Spent: 50m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
