[jira] [Updated] (HIVE-24501) UpdateInputAccessTimeHook should not update stats

2021-02-09 Thread Prasanth Jayachandran (Jira) 


 [ 
https://issues.apache.org/jira/browse/HIVE-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-24501:
-
Fix Version/s: 4.0.0
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

> UpdateInputAccessTimeHook should not update stats
> -
>
> Key: HIVE-24501
> URL: https://issues.apache.org/jira/browse/HIVE-24501
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0.0
>
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> UpdateInputAccessTimeHook can fail for transactional tables with following 
> exception.
> The hook should skip updating the stats and only update the access time.
> {code:java}
> ERROR : FAILED: Hive Internal Error: 
> org.apache.hadoop.hive.ql.metadata.HiveException(Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null)ERROR : FAILED: Hive Internal Error: 
> org.apache.hadoop.hive.ql.metadata.HiveException(Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null)org.apache.hadoop.hive.ql.metadata.HiveException: Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:821) at 
> org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:769) at 
> org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:756) at 
> org.apache.hadoop.hive.ql.hooks.UpdateInputAccessTimeHook$PreExec.run(UpdateInputAccessTimeHook.java:70)
>  at 
> org.apache.hadoop.hive.ql.HookRunner.invokeGeneralHook(HookRunner.java:296) 
> at org.apache.hadoop.hive.ql.HookRunner.runPreHooks(HookRunner.java:273) at 
> org.apache.hadoop.hive.ql.Executor.preExecutionActions(Executor.java:155) at 
> org.apache.hadoop.hive.ql.Executor.execute(Executor.java:107) at 
> org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:721) at 
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:488) at 
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:482) at 
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:166) at 
> org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:225)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:322)
>  at java.security.AccessController.doPrivileged(Native Method) at 
> javax.security.auth.Subject.doAs(Subject.java:422) at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:340)
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at 
> java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)Caused by: 
> MetaException(message:Cannot change stats state for a transactional table 
> default.test without providing the transactional write state for verification 
> (new write ID 0, valid write IDs 
> default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null) at 
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_table_req_result$alter_table_req_resultStandardScheme.read(ThriftHiveMetastore.java)
>  at 
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_table_req_result$alter_table_req_resultStandardScheme.read(ThriftHiveMetastore.java)
>  at 
>

[jira] [Updated] (HIVE-24501) UpdateInputAccessTimeHook should not update stats

2020-12-08 Thread ASF GitHub Bot (Jira) 


 [ 
https://issues.apache.org/jira/browse/HIVE-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated HIVE-24501:
--
Labels: pull-request-available  (was: )

> UpdateInputAccessTimeHook should not update stats
> -
>
> Key: HIVE-24501
> URL: https://issues.apache.org/jira/browse/HIVE-24501
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> UpdateInputAccessTimeHook can fail for transactional tables with following 
> exception.
> The hook should skip updating the stats and only update the access time.
> {code:java}
> ERROR : FAILED: Hive Internal Error: 
> org.apache.hadoop.hive.ql.metadata.HiveException(Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null)ERROR : FAILED: Hive Internal Error: 
> org.apache.hadoop.hive.ql.metadata.HiveException(Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null)org.apache.hadoop.hive.ql.metadata.HiveException: Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:821) at 
> org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:769) at 
> org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:756) at 
> org.apache.hadoop.hive.ql.hooks.UpdateInputAccessTimeHook$PreExec.run(UpdateInputAccessTimeHook.java:70)
>  at 
> org.apache.hadoop.hive.ql.HookRunner.invokeGeneralHook(HookRunner.java:296) 
> at org.apache.hadoop.hive.ql.HookRunner.runPreHooks(HookRunner.java:273) at 
> org.apache.hadoop.hive.ql.Executor.preExecutionActions(Executor.java:155) at 
> org.apache.hadoop.hive.ql.Executor.execute(Executor.java:107) at 
> org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:721) at 
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:488) at 
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:482) at 
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:166) at 
> org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:225)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:322)
>  at java.security.AccessController.doPrivileged(Native Method) at 
> javax.security.auth.Subject.doAs(Subject.java:422) at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:340)
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at 
> java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)Caused by: 
> MetaException(message:Cannot change stats state for a transactional table 
> default.test without providing the transactional write state for verification 
> (new write ID 0, valid write IDs 
> default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null) at 
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_table_req_result$alter_table_req_resultStandardScheme.read(ThriftHiveMetastore.java)
>  at 
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_table_req_result$alter_table_req_resultStandardScheme.read(ThriftHiveMetastore.java)
>  at 
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_table_req_result.read(ThriftHiveMetastore.java)
>  at

[jira] [Updated] (HIVE-24501) UpdateInputAccessTimeHook should not update stats

2020-12-08 Thread Prasanth Jayachandran (Jira) 


 [ 
https://issues.apache.org/jira/browse/HIVE-24501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Prasanth Jayachandran updated HIVE-24501:
-
Status: Patch Available  (was: Open)

> UpdateInputAccessTimeHook should not update stats
> -
>
> Key: HIVE-24501
> URL: https://issues.apache.org/jira/browse/HIVE-24501
> Project: Hive
>  Issue Type: Bug
>Affects Versions: 4.0.0
>Reporter: Prasanth Jayachandran
>Assignee: Prasanth Jayachandran
>Priority: Major
>  Labels: pull-request-available
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> UpdateInputAccessTimeHook can fail for transactional tables with following 
> exception.
> The hook should skip updating the stats and only update the access time.
> {code:java}
> ERROR : FAILED: Hive Internal Error: 
> org.apache.hadoop.hive.ql.metadata.HiveException(Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null)ERROR : FAILED: Hive Internal Error: 
> org.apache.hadoop.hive.ql.metadata.HiveException(Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null)org.apache.hadoop.hive.ql.metadata.HiveException: Unable to alter table. 
> Cannot change stats state for a transactional table default.test without 
> providing the transactional write state for verification (new write ID 0, 
> valid write IDs default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null at org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:821) at 
> org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:769) at 
> org.apache.hadoop.hive.ql.metadata.Hive.alterTable(Hive.java:756) at 
> org.apache.hadoop.hive.ql.hooks.UpdateInputAccessTimeHook$PreExec.run(UpdateInputAccessTimeHook.java:70)
>  at 
> org.apache.hadoop.hive.ql.HookRunner.invokeGeneralHook(HookRunner.java:296) 
> at org.apache.hadoop.hive.ql.HookRunner.runPreHooks(HookRunner.java:273) at 
> org.apache.hadoop.hive.ql.Executor.preExecutionActions(Executor.java:155) at 
> org.apache.hadoop.hive.ql.Executor.execute(Executor.java:107) at 
> org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:721) at 
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:488) at 
> org.apache.hadoop.hive.ql.Driver.run(Driver.java:482) at 
> org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:166) at 
> org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:225)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:87)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:322)
>  at java.security.AccessController.doPrivileged(Native Method) at 
> javax.security.auth.Subject.doAs(Subject.java:422) at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1876)
>  at 
> org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:340)
>  at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at 
> java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)Caused by: 
> MetaException(message:Cannot change stats state for a transactional table 
> default.test without providing the transactional write state for verification 
> (new write ID 0, valid write IDs 
> default.test:8:9223372036854775807::1,2,3,4,7; current state 
> {"BASIC_STATS":"true","COLUMN_STATS":{"id":"true","name":"true"}}; new state 
> null) at 
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_table_req_result$alter_table_req_resultStandardScheme.read(ThriftHiveMetastore.java)
>  at 
> org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$alter_table_req_result$alter_table_req_resultStandardScheme.read(ThriftHiveMetastore.java)
>  at 
>