[jira] [Commented] (HIVE-27554) Validate URL used by SSO workflow for JDBC connection
[ https://issues.apache.org/jira/browse/HIVE-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749211#comment-17749211 ] Henri Biestro commented on HIVE-27554: -- PR is https://github.com/apache/hive/pull/4537 > Validate URL used by SSO workflow for JDBC connection > - > > Key: HIVE-27554 > URL: https://issues.apache.org/jira/browse/HIVE-27554 > Project: Hive > Issue Type: Improvement > Components: JDBC >Affects Versions: 3.1.3 >Reporter: Henri Biestro >Assignee: Henri Biestro >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > > Add a validation to ensure the URL used during SSO workflow is proper > (http/https). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27554) Validate URL used by SSO workflow for JDBC connection
[ https://issues.apache.org/jira/browse/HIVE-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27554: -- Labels: pull-request-available (was: ) > Validate URL used by SSO workflow for JDBC connection > - > > Key: HIVE-27554 > URL: https://issues.apache.org/jira/browse/HIVE-27554 > Project: Hive > Issue Type: Improvement > Components: JDBC >Affects Versions: 3.1.3 >Reporter: Henri Biestro >Assignee: Henri Biestro >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > > Add a validation to ensure the URL used during SSO workflow is proper > (http/https). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-27554) Validate URL used by SSO workflow for JDBC connection
[ https://issues.apache.org/jira/browse/HIVE-27554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henri Biestro reassigned HIVE-27554: Assignee: Henri Biestro > Validate URL used by SSO workflow for JDBC connection > - > > Key: HIVE-27554 > URL: https://issues.apache.org/jira/browse/HIVE-27554 > Project: Hive > Issue Type: Improvement > Components: JDBC >Affects Versions: 3.1.3 >Reporter: Henri Biestro >Assignee: Henri Biestro >Priority: Minor > Fix For: 4.0.0 > > > Add a validation to ensure the URL used during SSO workflow is proper > (http/https). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27554) Validate URL used by SSO workflow for JDBC connection
Henri Biestro created HIVE-27554: Summary: Validate URL used by SSO workflow for JDBC connection Key: HIVE-27554 URL: https://issues.apache.org/jira/browse/HIVE-27554 Project: Hive Issue Type: Improvement Components: JDBC Affects Versions: 3.1.3 Reporter: Henri Biestro Fix For: 4.0.0 Add a validation to ensure the URL used during SSO workflow is proper (http/https). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27553) After upgrading from Hive1 to Hive3, Decimal computation experiences a loss of precision
[
https://issues.apache.org/jira/browse/HIVE-27553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ZhengBowen updated HIVE-27553:
--
Description:
I can reproduce this bug.
{quote}{{create}} {{table}} {{decimal_test(}}
{{}}{{id }}{{{}int{}}}{{{},{}}}
{{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
{{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
{{) stored }}{{as}} {{textfile;}}
{{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
0.00015000);{}}}
{{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
{quote}
*1、The following are the execution results and execution plan on Hive-1.0.1：*
!image-2023-07-31-20-40-00-679.png|width=550,height=230!
!image-2023-07-31-20-43-05-379.png|width=540,height=144!
*2、The following are the execution results and execution plan on Hive-3.1.3：*
!image-2023-07-31-20-40-35-050.png|width=538,height=257!
!image-2023-07-31-20-43-49-775.png|width=533,height=142!
was:
I can reproduce this process.
{quote}{{create}} {{table}} {{decimal_test(}}
{{}}{{id }}{{{}int{}}}{{{},{}}}
{{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
{{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
{{) stored }}{{as}} {{textfile;}}
{{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
0.00015000);{}}}
{{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
{quote}
*1、The following are the execution results and execution plan on Hive-1.0.1：*
!image-2023-07-31-20-40-00-679.png|width=550,height=230!
!image-2023-07-31-20-43-05-379.png|width=540,height=144!
*2、The following are the execution results and execution plan on Hive-3.1.3：*
!image-2023-07-31-20-40-35-050.png|width=538,height=257!
!image-2023-07-31-20-43-49-775.png|width=533,height=142!
> After upgrading from Hive1 to Hive3, Decimal computation experiences a loss
> of precision
>
>
> Key: HIVE-27553
> URL: https://issues.apache.org/jira/browse/HIVE-27553
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.3
>Reporter: ZhengBowen
>Priority: Major
> Attachments: image-2023-07-31-20-40-00-679.png,
> image-2023-07-31-20-40-35-050.png, image-2023-07-31-20-43-05-379.png,
> image-2023-07-31-20-43-49-775.png
>
>
> I can reproduce this bug.
> {quote}{{create}} {{table}} {{decimal_test(}}
> {{}}{{id }}{{{}int{}}}{{{},{}}}
> {{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
> {{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
> {{) stored }}{{as}} {{textfile;}}
>
> {{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
> 0.00015000);{}}}
>
> {{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
> {quote}
> *1、The following are the execution results and execution plan on Hive-1.0.1：*
> !image-2023-07-31-20-40-00-679.png|width=550,height=230!
> !image-2023-07-31-20-43-05-379.png|width=540,height=144!
> *2、The following are the execution results and execution plan on Hive-3.1.3：*
> !image-2023-07-31-20-40-35-050.png|width=538,height=257!
> !image-2023-07-31-20-43-49-775.png|width=533,height=142!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-27553) After upgrading from Hive1 to Hive3, Decimal computation experiences a loss of precision
[
https://issues.apache.org/jira/browse/HIVE-27553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ZhengBowen updated HIVE-27553:
--
Description:
I can reproduce this process.
{quote}{{create}} {{table}} {{decimal_test(}}
{{}}{{id }}{{{}int{}}}{{{},{}}}
{{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
{{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
{{) stored }}{{as}} {{textfile;}}
{{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
0.00015000);{}}}
{{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
{quote}
*1、The following are the execution results and execution plan on Hive-1.0.1：*
!image-2023-07-31-20-40-00-679.png|width=550,height=230!
!image-2023-07-31-20-43-05-379.png|width=540,height=144!
*2、The following are the execution results and execution plan on Hive-3.1.3：*
!image-2023-07-31-20-40-35-050.png|width=538,height=257!
!image-2023-07-31-20-43-49-775.png|width=533,height=142!
was:
I can reproduce this process.
{quote}{{create}} {{table}} {{decimal_test(}}
{{}}{{id }}{{{}int{}}}{{{},{}}}
{{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
{{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
{{) stored }}{{as}} {{textfile;}}
{{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
0.00015000);{}}}
{{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
{quote}
*1、The following are the execution results and execution plan on Hive-1.0.1：*
!image-2023-07-31-20-40-00-679.png!
!image-2023-07-31-20-43-05-379.png!
*2、The following are the execution results and execution plan on Hive-3.1.3：*
!image-2023-07-31-20-40-35-050.png!
!image-2023-07-31-20-43-49-775.png!
> After upgrading from Hive1 to Hive3, Decimal computation experiences a loss
> of precision
>
>
> Key: HIVE-27553
> URL: https://issues.apache.org/jira/browse/HIVE-27553
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.3
>Reporter: ZhengBowen
>Priority: Major
> Attachments: image-2023-07-31-20-40-00-679.png,
> image-2023-07-31-20-40-35-050.png, image-2023-07-31-20-43-05-379.png,
> image-2023-07-31-20-43-49-775.png
>
>
> I can reproduce this process.
> {quote}{{create}} {{table}} {{decimal_test(}}
> {{}}{{id }}{{{}int{}}}{{{},{}}}
> {{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
> {{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
> {{) stored }}{{as}} {{textfile;}}
>
> {{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
> 0.00015000);{}}}
>
> {{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
> {quote}
> *1、The following are the execution results and execution plan on Hive-1.0.1：*
> !image-2023-07-31-20-40-00-679.png|width=550,height=230!
> !image-2023-07-31-20-43-05-379.png|width=540,height=144!
> *2、The following are the execution results and execution plan on Hive-3.1.3：*
> !image-2023-07-31-20-40-35-050.png|width=538,height=257!
> !image-2023-07-31-20-43-49-775.png|width=533,height=142!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-27553) After upgrading from Hive1 to Hive3, Decimal computation experiences a loss of precision
[
https://issues.apache.org/jira/browse/HIVE-27553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ZhengBowen updated HIVE-27553:
--
Attachment: image-2023-07-31-20-43-49-775.png
image-2023-07-31-20-43-05-379.png
Description:
I can reproduce this process.
{quote}{{create}} {{table}} {{decimal_test(}}
{{}}{{id }}{{{}int{}}}{{{},{}}}
{{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
{{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
{{) stored }}{{as}} {{textfile;}}
{{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
0.00015000);{}}}
{{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
{quote}
*1、The following are the execution results and execution plan on Hive-1.0.1：*
!image-2023-07-31-20-40-00-679.png!
!image-2023-07-31-20-43-05-379.png!
*2、The following are the execution results and execution plan on Hive-3.1.3：*
!image-2023-07-31-20-40-35-050.png!
!image-2023-07-31-20-43-49-775.png!
was:
I can reproduce this process.
{quote}{{create}} {{table}} {{decimal_test(}}
{{}}{{id }}{{{}int{}}}{{{},{}}}
{{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
{{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
{{) stored }}{{as}} {{textfile;}}
{{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
0.00015000);{}}}
{{select}} {{quantity * cost }}{{from}} {{decimal_test;}}{quote}
1、The following are the execution results on Hive-1.0.1：
!image-2023-07-31-20-40-00-679.png!
2、The following are the execution results on Hive-3.1.3：
!image-2023-07-31-20-40-35-050.png!
> After upgrading from Hive1 to Hive3, Decimal computation experiences a loss
> of precision
>
>
> Key: HIVE-27553
> URL: https://issues.apache.org/jira/browse/HIVE-27553
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 3.1.3
>Reporter: ZhengBowen
>Priority: Major
> Attachments: image-2023-07-31-20-40-00-679.png,
> image-2023-07-31-20-40-35-050.png, image-2023-07-31-20-43-05-379.png,
> image-2023-07-31-20-43-49-775.png
>
>
> I can reproduce this process.
> {quote}{{create}} {{table}} {{decimal_test(}}
> {{}}{{id }}{{{}int{}}}{{{},{}}}
> {{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
> {{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
> {{) stored }}{{as}} {{textfile;}}
>
> {{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
> 0.00015000);{}}}
>
> {{select}} {{quantity * cost }}{{from}} {{decimal_test;}}
> {quote}
> *1、The following are the execution results and execution plan on Hive-1.0.1：*
> !image-2023-07-31-20-40-00-679.png!
> !image-2023-07-31-20-43-05-379.png!
> *2、The following are the execution results and execution plan on Hive-3.1.3：*
> !image-2023-07-31-20-40-35-050.png!
> !image-2023-07-31-20-43-49-775.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (HIVE-27553) After upgrading from Hive1 to Hive3, Decimal computation experiences a loss of precision
ZhengBowen created HIVE-27553:
-
Summary: After upgrading from Hive1 to Hive3, Decimal computation
experiences a loss of precision
Key: HIVE-27553
URL: https://issues.apache.org/jira/browse/HIVE-27553
Project: Hive
Issue Type: Bug
Components: HiveServer2
Affects Versions: 3.1.3
Reporter: ZhengBowen
Attachments: image-2023-07-31-20-40-00-679.png,
image-2023-07-31-20-40-35-050.png
I can reproduce this process.
{quote}{{create}} {{table}} {{decimal_test(}}
{{}}{{id }}{{{}int{}}}{{{},{}}}
{{}}{{quantity }}{{{}decimal{}}}{{{}(38,8),{}}}
{{}}{{cost }}{{{}decimal{}}}{{{}(38,8){}}}
{{) stored }}{{as}} {{textfile;}}
{{insert}} {{into}} {{decimal_test }}{{{}values{}}}{{{}(1,0.8000,
0.00015000);{}}}
{{select}} {{quantity * cost }}{{from}} {{decimal_test;}}{quote}
1、The following are the execution results on Hive-1.0.1：
!image-2023-07-31-20-40-00-679.png!
2、The following are the execution results on Hive-3.1.3：
!image-2023-07-31-20-40-35-050.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-27539) Drop renamed external table fails when hive.metastore.try.direct.sql.ddl is disabled
[
https://issues.apache.org/jira/browse/HIVE-27539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-27539:
--
Labels: pull-request-available (was: )
> Drop renamed external table fails when hive.metastore.try.direct.sql.ddl is
> disabled
>
>
> Key: HIVE-27539
> URL: https://issues.apache.org/jira/browse/HIVE-27539
> Project: Hive
> Issue Type: Bug
>Reporter: Venugopal Reddy K
>Assignee: Venugopal Reddy K
>Priority: Major
> Labels: pull-request-available
>
> *Description:*
> With hive.metastore.try.direct.sql.ddl property set to false, create an
> external partitioned table, rename and drop the table. It fails with
> exception - Caused by: java.sql.SQLIntegrityConstraintViolationException:
> Cannot delete or update a parent row: a foreign key constraint fails
> ("metastore"."part_col_stats", CONSTRAINT "PART_COL_STATS_FK" FOREIGN KEY
> ("PART_ID") REFERENCES "partitions" ("PART_ID"))
> {noformat}
> 2023-07-29T11:04:58,884 ERROR [HiveServer2-Background-Pool: Thread-1212]
> metastore.ObjectStore:
> javax.jdo.JDOUserException: One or more instances could not be deleted
> at
> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:625)
> ~[datanucleus-api-jdo-5.2.8.jar:?]
> at
> org.datanucleus.api.jdo.JDOQuery.deletePersistentInternal(JDOQuery.java:530)
> ~[datanucleus-api-jdo-5.2.8.jar:?]
> at
> org.datanucleus.api.jdo.JDOQuery.deletePersistentAll(JDOQuery.java:499)
> ~[datanucleus-api-jdo-5.2.8.jar:?]
> at
> org.apache.hadoop.hive.metastore.QueryWrapper.deletePersistentAll(QueryWrapper.java:108)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore.dropPartitionsNoTxn(ObjectStore.java:4315)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore.access$1000(ObjectStore.java:290)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore$8.run(ObjectStore.java:3194)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.Batchable.runBatched(Batchable.java:74)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore.dropPartitionsViaJdo(ObjectStore.java:3182)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore.access$400(ObjectStore.java:290)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore$7.getJdoResult(ObjectStore.java:3166)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore$7.getJdoResult(ObjectStore.java:3158)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore$GetHelper.run(ObjectStore.java:4472)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore.dropPartitionsInternal(ObjectStore.java:3169)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.ObjectStore.dropPartitions(ObjectStore.java:3148)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[?:1.8.0_292]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> ~[?:1.8.0_292]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_292]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_292]
> at
> org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:97)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at com.sun.proxy.$Proxy27.dropPartitions(Unknown Source) ~[?:?]
> at
> org.apache.hadoop.hive.metastore.HMSHandler.dropPartitionsAndGetLocations(HMSHandler.java:3150)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.HMSHandler.drop_table_core(HMSHandler.java:2923)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.HMSHandler.drop_table_with_environment_context(HMSHandler.java:3175)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
> org.apache.hadoop.hive.metastore.HMSHandler.drop_table_with_environment_context(HMSHandler.java:3163)
> ~[hive-exec-4.0.0-beta-1-SNAPSHOT.jar:4.0.0-beta-1-SNAPSHOT]
> at
[jira] [Assigned] (HIVE-27525) Ease the write permissions on external table during create table operation
[ https://issues.apache.org/jira/browse/HIVE-27525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riju Trivedi reassigned HIVE-27525: --- Assignee: Riju Trivedi (was: Sai Hemanth Gantasala) > Ease the write permissions on external table during create table operation > -- > > Key: HIVE-27525 > URL: https://issues.apache.org/jira/browse/HIVE-27525 > Project: Hive > Issue Type: Improvement > Components: Standalone Metastore >Reporter: Sai Hemanth Gantasala >Assignee: Riju Trivedi >Priority: Major > > During the creation of external tables with a specified location, the general > expectation is that the data is already present or the data might be > externally added to the location without involving HMS. So, it is really not > required to have read and write permissions on an external table during the > creation time. > This enhancement can address security concerns where currently the users had > to be grant unnecessary write permissions on an external file location when > the table is only used for reading the data. > Update/delete operations would anyway require write permissions. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (HIVE-22961) Drop function in Hive should not send request for drop database to Ranger plugin.
[
https://issues.apache.org/jira/browse/HIVE-22961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Riju Trivedi reassigned HIVE-22961:
---
Assignee: Riju Trivedi (was: Sai Hemanth Gantasala)
> Drop function in Hive should not send request for drop database to Ranger
> plugin.
> --
>
> Key: HIVE-22961
> URL: https://issues.apache.org/jira/browse/HIVE-22961
> Project: Hive
> Issue Type: Bug
> Components: Hive
>Affects Versions: 4.0.0
>Reporter: Sam An
>Assignee: Riju Trivedi
>Priority: Major
>
> Issue here is how HIVE sends the "HivePrivilegeObjects" to Ranger when DROP
> fUNTION is done. This is different from how DROP TABLE is done.
> DROP TABLE the following is the request:
> {code:java}
> 'checkPrivileges':{'hiveOpType':DROPTABLE,
> 'inputHObjs':['HivePrivilegeObject':{'type':TABLE_OR_VIEW, 'dbName':testdemo,
> 'objectType':TABLE_OR_VIEW, 'objectName':t1, 'columns':[], 'partKeys':[],
> 'commandParams':[], 'actionType':OTHER, 'owner':systest}],
> 'outputHObjs':['HivePrivilegeObject':{'type':TABLE_OR_VIEW,
> 'dbName':testdemo, 'objectType':TABLE_OR_VIEW, 'objectName':t1, 'columns':[],
> 'partKeys':[], 'commandParams':[], 'actionType':OTHER, 'owner':systest}],
> 'context':{'clientType':HIVESERVER2, 'commandString':drop table t1,
> 'ipAddress':10.65.42.125, 'forwardedAddresses':null,
> 'sessionString':58f89a16-2df5-4124-af0e-913aabbefe06}, 'user':systest,
> 'groups':[systest, wheel]}{code}
> Where as in DROP FUNCTION:
> {code:java}
> {'hiveOpType':DROPFUNCTION,
> 'inputHObjs':['HivePrivilegeObject':{'type':FUNCTION, 'dbName':udfdemo,
> 'objectType':FUNCTION, 'objectName':aes1, 'columns':[], 'partKeys':[],
> 'commandParams':[], 'actionType':OTHER, 'owner':null}],
> 'outputHObjs':['HivePrivilegeObject':{'type':DATABASE, 'dbName':udfdemo,
> 'objectType':DATABASE, 'objectName':null, 'columns':[], 'partKeys':[],
> 'commandParams':[], 'actionType':OTHER,
> 'owner':systest},'HivePrivilegeObject':{'type':FUNCTION, 'dbName':udfdemo,
> 'objectType':FUNCTION, 'objectName':aes1, 'columns':[], 'partKeys':[],
> 'commandParams':[], 'actionType':OTHER, 'owner':null}],
> 'context':{'clientType':HIVESERVER2, 'commandString':drop function
> udfdemo.aes1, 'ipAddress':10.65.42.125, 'forwardedAddresses':null,
> 'sessionString':442ca4d3-f34a-470c-878a-18542b99016c}, 'user':systest,
> 'groups':[systest, wheel]}
> {code}
> in DROP function in outputHObjs, there is this addition, DATABASE object
> which should not there and this causes the Ranger requested to be generated
> differently.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Updated] (HIVE-27504) Automate inclusion of 3-party licenses in binary distribution
[ https://issues.apache.org/jira/browse/HIVE-27504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stamatis Zampetakis updated HIVE-27504: --- Fix Version/s: 4.0.0 > Automate inclusion of 3-party licenses in binary distribution > - > > Key: HIVE-27504 > URL: https://issues.apache.org/jira/browse/HIVE-27504 > Project: Hive > Issue Type: Improvement >Reporter: Stamatis Zampetakis >Assignee: Stamatis Zampetakis >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > Manually downloading and including licenses of bundled dependencies in the > binary distribution (as it is done currently under [binary-package-licenses > directory| > https://github.com/apache/hive/tree/bd02abc9eba3aa0cd3701b26d9169130551a12ef/binary-package-licenses]) > is error-prone and time consuming. > Moreover, dependencies and their versions change rapidly and it is hard to > keep the LICENSE documentation correct and up-to-date. At the moment, the > binary-package-licenses directory is stale; some bundled dependencies are > missing, others do not longer exist, and versions are not mentioned anywhere > so we cannot know if the license has changed. > Furthermore, every dependency change (add/remove/version bump) potentially > requires commits and modifications to the source code. > The goal of this ticket is to automate the download and inclusion of > 3rd-party licenses in the binary distribution to minimize/eliminate the need > for human intervention. As part of the automation the following issues should > be fixed as well: > 1. LICENSE/NOTICE should reflect exactly what lies inside each package > distribution (source & binary); ideally no more and definitely not less. > 2. LICENSES for bundled dependencies should be referenced from the main > LICENSE file not from NOTICE (or other places) as it is right now. > 3. For bundled dependencies their versions should be included cause different > version may use different licenses and it should be clear which version is > bundled. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27552) Backport of HIVE-22360 : MultiDelimitSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
Aman Raj created HIVE-27552: --- Summary: Backport of HIVE-22360 : MultiDelimitSerDe returns wrong results in last column when the loaded file has more columns than those in table schema Key: HIVE-27552 URL: https://issues.apache.org/jira/browse/HIVE-27552 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27552) Backport of HIVE-22360 : MultiDelimitSerDe returns wrong results in last column when the loaded file has more columns than those in table schema
[ https://issues.apache.org/jira/browse/HIVE-27552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27552: -- Labels: pull-request-available (was: ) > Backport of HIVE-22360 : MultiDelimitSerDe returns wrong results in last > column when the loaded file has more columns than those in table schema > > > Key: HIVE-27552 > URL: https://issues.apache.org/jira/browse/HIVE-27552 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27551) Backport of HIVE-22208 : Column name with reserved keyword is unescaped when query including join on table with mask column is re-written
[ https://issues.apache.org/jira/browse/HIVE-27551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27551: -- Labels: pull-request-available (was: ) > Backport of HIVE-22208 : Column name with reserved keyword is unescaped when > query including join on table with mask column is re-written > - > > Key: HIVE-27551 > URL: https://issues.apache.org/jira/browse/HIVE-27551 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27551) Backport of HIVE-22208 : Column name with reserved keyword is unescaped when query including join on table with mask column is re-written
Aman Raj created HIVE-27551: --- Summary: Backport of HIVE-22208 : Column name with reserved keyword is unescaped when query including join on table with mask column is re-written Key: HIVE-27551 URL: https://issues.apache.org/jira/browse/HIVE-27551 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27550) Backport of HIVE-22113: Prevent LLAP shutdown on AMReporter related RuntimeException
Aman Raj created HIVE-27550: --- Summary: Backport of HIVE-22113: Prevent LLAP shutdown on AMReporter related RuntimeException Key: HIVE-27550 URL: https://issues.apache.org/jira/browse/HIVE-27550 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27550) Backport of HIVE-22113: Prevent LLAP shutdown on AMReporter related RuntimeException
[ https://issues.apache.org/jira/browse/HIVE-27550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27550: -- Labels: pull-request-available (was: ) > Backport of HIVE-22113: Prevent LLAP shutdown on AMReporter related > RuntimeException > > > Key: HIVE-27550 > URL: https://issues.apache.org/jira/browse/HIVE-27550 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27549) Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP service
Aman Raj created HIVE-27549: --- Summary: Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP service Key: HIVE-27549 URL: https://issues.apache.org/jira/browse/HIVE-27549 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27549) Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP service
[ https://issues.apache.org/jira/browse/HIVE-27549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27549: -- Labels: pull-request-available (was: ) > Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP > service > --- > > Key: HIVE-27549 > URL: https://issues.apache.org/jira/browse/HIVE-27549 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27548) Backport of HIVE-22275: OperationManager.queryIdOperation does not properly clean up multiple queryIds
[ https://issues.apache.org/jira/browse/HIVE-27548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27548: -- Labels: pull-request-available (was: ) > Backport of HIVE-22275: OperationManager.queryIdOperation does not properly > clean up multiple queryIds > -- > > Key: HIVE-27548 > URL: https://issues.apache.org/jira/browse/HIVE-27548 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27548) Backport of HIVE-22275: OperationManager.queryIdOperation does not properly clean up multiple queryIds
Aman Raj created HIVE-27548: --- Summary: Backport of HIVE-22275: OperationManager.queryIdOperation does not properly clean up multiple queryIds Key: HIVE-27548 URL: https://issues.apache.org/jira/browse/HIVE-27548 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27547) Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP service
[ https://issues.apache.org/jira/browse/HIVE-27547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27547: -- Labels: pull-request-available (was: ) > Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP > service > --- > > Key: HIVE-27547 > URL: https://issues.apache.org/jira/browse/HIVE-27547 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27547) Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP service
Aman Raj created HIVE-27547: --- Summary: Backport of HIVE-22219: Bringing a node manager down blocks restart of LLAP service Key: HIVE-27547 URL: https://issues.apache.org/jira/browse/HIVE-27547 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27546) Backport of HIVE-15956: StackOverflowError when drop lots of partitions
[ https://issues.apache.org/jira/browse/HIVE-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27546: -- Labels: pull-request-available (was: ) > Backport of HIVE-15956: StackOverflowError when drop lots of partitions > --- > > Key: HIVE-27546 > URL: https://issues.apache.org/jira/browse/HIVE-27546 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27546) Backport of HIVE-15956: StackOverflowError when drop lots of partitions
Aman Raj created HIVE-27546: --- Summary: Backport of HIVE-15956: StackOverflowError when drop lots of partitions Key: HIVE-27546 URL: https://issues.apache.org/jira/browse/HIVE-27546 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27545) Backport of HIVE-22273: Access check is failed when a temporary directory is removed
[ https://issues.apache.org/jira/browse/HIVE-27545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27545: -- Labels: pull-request-available (was: ) > Backport of HIVE-22273: Access check is failed when a temporary directory is > removed > > > Key: HIVE-27545 > URL: https://issues.apache.org/jira/browse/HIVE-27545 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27545) Backport of HIVE-22273: Access check is failed when a temporary directory is removed
Aman Raj created HIVE-27545: --- Summary: Backport of HIVE-22273: Access check is failed when a temporary directory is removed Key: HIVE-27545 URL: https://issues.apache.org/jira/browse/HIVE-27545 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27544) Backport of HIVE-22120 - Fix wrong results/ArrayOutOfBound exception in left outer map joins on specific boundary conditions
[ https://issues.apache.org/jira/browse/HIVE-27544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27544: -- Labels: pull-request-available (was: ) > Backport of HIVE-22120 - Fix wrong results/ArrayOutOfBound exception in left > outer map joins on specific boundary conditions > > > Key: HIVE-27544 > URL: https://issues.apache.org/jira/browse/HIVE-27544 > Project: Hive > Issue Type: Sub-task >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27544) Backport of HIVE-22120 - Fix wrong results/ArrayOutOfBound exception in left outer map joins on specific boundary conditions
Aman Raj created HIVE-27544: --- Summary: Backport of HIVE-22120 - Fix wrong results/ArrayOutOfBound exception in left outer map joins on specific boundary conditions Key: HIVE-27544 URL: https://issues.apache.org/jira/browse/HIVE-27544 Project: Hive Issue Type: Sub-task Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HIVE-27494) Deduplicate the task result that generated by more branches in union all
[ https://issues.apache.org/jira/browse/HIVE-27494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihua Deng resolved HIVE-27494. Fix Version/s: 4.0.0-beta-1 Resolution: Fixed Fix has been merged. Thanks [~dkuzmenko], [~kkasa] and [~zabetak] for the review! > Deduplicate the task result that generated by more branches in union all > > > Key: HIVE-27494 > URL: https://issues.apache.org/jira/browse/HIVE-27494 > Project: Hive > Issue Type: Bug >Reporter: Zhihua Deng >Assignee: Zhihua Deng >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0-beta-1 > > Attachments: ddl.q, explain.output > > > HIVE-23891 adds the ability to deduplicate the task result that under the > directory, > //_tmp.-ext-1//HIVE_UNION_SUBDIR_1, > but turns out to ignore taking the same action to the directory for the same > query: > //_tmp.-ext-1//HIVE_UNION_SUBDIR_2. > So user may still have the same data duplication problem in multiple tez task > attempts. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27543) Backport of HIVE-24039 : Update jquery version to mitigate CVE-2020-11023 (#1403)
[ https://issues.apache.org/jira/browse/HIVE-27543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27543: -- Labels: pull-request-available (was: ) > Backport of HIVE-24039 : Update jquery version to mitigate CVE-2020-11023 > (#1403) > - > > Key: HIVE-27543 > URL: https://issues.apache.org/jira/browse/HIVE-27543 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27543) Backport of HIVE-24039 : Update jquery version to mitigate CVE-2020-11023 (#1403)
Aman Raj created HIVE-27543: --- Summary: Backport of HIVE-24039 : Update jquery version to mitigate CVE-2020-11023 (#1403) Key: HIVE-27543 URL: https://issues.apache.org/jira/browse/HIVE-27543 Project: Hive Issue Type: Sub-task Components: Hive Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27542) Backport of HIVE-25659: Metastore direct sql queries with IN/(NOT IN) should be split based on max parameters allowed by SQL DB
[ https://issues.apache.org/jira/browse/HIVE-27542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27542: -- Labels: pull-request-available (was: ) > Backport of HIVE-25659: Metastore direct sql queries with IN/(NOT IN) should > be split based on max parameters allowed by SQL DB > --- > > Key: HIVE-27542 > URL: https://issues.apache.org/jira/browse/HIVE-27542 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27542) Backport of HIVE-25659: Metastore direct sql queries with IN/(NOT IN) should be split based on max parameters allowed by SQL DB
Aman Raj created HIVE-27542: --- Summary: Backport of HIVE-25659: Metastore direct sql queries with IN/(NOT IN) should be split based on max parameters allowed by SQL DB Key: HIVE-27542 URL: https://issues.apache.org/jira/browse/HIVE-27542 Project: Hive Issue Type: Sub-task Components: Hive Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HIVE-27541) Backport of HIVE-21924, HIVE-22769
[ https://issues.apache.org/jira/browse/HIVE-27541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HIVE-27541: -- Labels: pull-request-available (was: ) > Backport of HIVE-21924, HIVE-22769 > -- > > Key: HIVE-27541 > URL: https://issues.apache.org/jira/browse/HIVE-27541 > Project: Hive > Issue Type: Sub-task > Components: Hive >Affects Versions: 3.2.0 >Reporter: Aman Raj >Assignee: Aman Raj >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HIVE-27541) Backport of HIVE-21924, HIVE-22769
Aman Raj created HIVE-27541: --- Summary: Backport of HIVE-21924, HIVE-22769 Key: HIVE-27541 URL: https://issues.apache.org/jira/browse/HIVE-27541 Project: Hive Issue Type: Sub-task Components: Hive Affects Versions: 3.2.0 Reporter: Aman Raj Assignee: Aman Raj -- This message was sent by Atlassian Jira (v8.20.10#820010)
