[jira] [Commented] (SENTRY-2558) Issue in creating full snapshot when the storage descriptor for a table is null.

2020-09-18 Thread Na Li (Jira)


[ 
https://issues.apache.org/jira/browse/SENTRY-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198502#comment-17198502
 ] 

Na Li commented on SENTRY-2558:
---

[~kalyan] why the tests were not triggered? 

> Issue in creating full snapshot when the storage descriptor for a table is 
> null.
> 
>
> Key: SENTRY-2558
> URL: https://issues.apache.org/jira/browse/SENTRY-2558
> Project: Sentry
>  Issue Type: Bug
>Reporter: Kalyan Kalvagadda
>Assignee: Kalyan Kalvagadda
>Priority: Major
> Fix For: 2.3.0
>
> Attachments: SENTRY-2558.001.patch
>
>
> When the storage descriptor for the table is null, sentry throws NullPointer 
> Exception and fails to create a snapshot.
> {noformat}
> 020-09-17 15:08:43,647 ERROR 
> org.apache.sentry.service.thrift.FullUpdateInitializer: Failed to execute 
> task java.lang.NullPointerException         at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$TableTask.doTask(FullUpdateInitializer.java:369)
>          at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$BaseTask$RetryStrategy.exec(FullUpdateInitializer.java:222)
>          at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$BaseTask.call(FullUpdateInitializer.java:258)
>          at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$BaseTask.call(FullUpdateInitializer.java:190)
>          at java.util.concurrent.FutureTask.run(FutureTask.java:266)         
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>          at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>          at java.lang.Thread.run(Thread.java:748) 2020-09-17 15:08:43,650 
> INFO org.apache.sentry.service.thrift.FullUpdateInitializer: For db = 
> test_db4 table = test_tb5 total number of partitions = 0 2020-09-17 
> 15:08:43,657 INFO hive.metastore: Closed a connection to metastore, current 
> connections: 8 2020-09-17 15:08:43,657 ERROR 
> org.apache.sentry.service.thrift.FullUpdateInitializer: Failed to execute 
> task java.util.concurrent.RejectedExecutionException: Task 
> java.util.concurrent.FutureTask@68c2c9a6 rejected from 
> java.util.concurrent.ThreadPoolExecutor@1a289856[Shutting down, pool size = 
> 7, active threads = 7, queued tasks = 0, completed tasks = 9]         at 
> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063)
>          at 
> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830)   
>       at 
> java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) 
>         at 
> java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:134)
>          at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$TableTask.doTask(FullUpdateInitializer.java:366)
>          at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$BaseTask$RetryStrategy.exec(FullUpdateInitializer.java:222)
>          at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$BaseTask.call(FullUpdateInitializer.java:258)
>          at 
> org.apache.sentry.service.thrift.FullUpdateInitializer$BaseTask.call(FullUpdateInitializer.java:190)
>          at java.util.concurrent.FutureTask.run(FutureTask.java:266)         
> at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>          at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>          at java.lang.Thread.run(Thread.java:748)
> {noformat}
> Instead, it should ignore the object and move-on.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Commented] (SENTRY-2557) Queries are running too slow after when there are more than 4k roles

2020-09-18 Thread Daniel Rosenfeld (Jira)


[ 
https://issues.apache.org/jira/browse/SENTRY-2557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17198516#comment-17198516
 ] 

Daniel Rosenfeld commented on SENTRY-2557:
--

Hello, we have identified a similar case of this bug in the CDH 6.3.3 
distribution that uses version 2.1.0 of Sentry. If possible, a test can be 
added to the backlog to evaluate this version because there is no record in 
this jira that version 2.1 is also impacted. Thank you

> Queries are running too slow after when there are more than 4k roles
> 
>
> Key: SENTRY-2557
> URL: https://issues.apache.org/jira/browse/SENTRY-2557
> Project: Sentry
>  Issue Type: Bug
>  Components: sentrystore
>Affects Versions: 2.2.0, 2.3.0
>Reporter: Kalyan Kalvagadda
>Assignee: Kalyan Kalvagadda
>Priority: Critical
> Fix For: 2.3.0
>
> Attachments: SENTRY-2557.01.patch
>
>
> When there are more than 4k roles Hive queries are very slow below because of 
> the time it spends on the compile phase because of the delay in fetching the 
> permissions.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)