[jira] [Updated] (RANGER-3517) Incorrect Policy evaluation on clearing existing policy

[Nishchith Shetty (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nishchith Shetty updated RANGER-3517:
-
Description: 
Hello,

 

Once a policy is created and then all the policies are cleared from Ranger 
Admin, the plugin enforces the last policy that was cached instead of clearing 
the policies on the client.

 

*Steps to reproduce*
 * Create a allow policy for userA (ID-1)
 * Delete the policy ({_}now there are 0 policies on ranger server){_}
 * Use the plugin
 ** Expected/Ideal behaviour - deny (as there's no policy)
 ** Current behaviour - allow (enforced policy ID-1)

_Note: For each step let the change get synced to the client via plugin_

 

*Logs (ranger-plugin v2.2.0)*
{code:java}
Downloaded policies do not require policy change !!
Keeping old policy-engine!
Ranger-PolicyVersion:[139], Cached-PolicyVersion:[138]
{code}

  was:
Hello,

 

Once a policy is created and then all the policies are cleared from Ranger 
Admin, the plugin enforces the last policy that was cached instead of clearing 
the policies on the client.

 

*Steps to reproduce*
 * Create a allow policy for userA (ID-1)
 * Delete the policy ({_}now there are 0 policies on ranger server){_}
 * Use the plugin
 ** Expected/Ideal behaviour - deny (as there's no policy)
 ** Current behaviour - allow (enforced policy ID-1)

_Note: For each step let the change get synced to the client via plugin_

 

*Logs (ranger-plugin v2.2.0)*

{{}}
{code:java}
Downloaded policies do not require policy change !!
Keeping old policy-engine!
Ranger-PolicyVersion:[139], Cached-PolicyVersion:[138]
{code}
{{}}


> Incorrect Policy evaluation on clearing existing policy
> ---
>
> Key: RANGER-3517
> URL: https://issues.apache.org/jira/browse/RANGER-3517
> Project: Ranger
>  Issue Type: Bug
>  Components: plugins, Ranger
>Affects Versions: 2.2.0
>Reporter: Nishchith Shetty
>Priority: Critical
>
> Hello,
>  
> Once a policy is created and then all the policies are cleared from Ranger 
> Admin, the plugin enforces the last policy that was cached instead of 
> clearing the policies on the client.
>  
> *Steps to reproduce*
>  * Create a allow policy for userA (ID-1)
>  * Delete the policy ({_}now there are 0 policies on ranger server){_}
>  * Use the plugin
>  ** Expected/Ideal behaviour - deny (as there's no policy)
>  ** Current behaviour - allow (enforced policy ID-1)
> _Note: For each step let the change get synced to the client via plugin_
>  
> *Logs (ranger-plugin v2.2.0)*
> {code:java}
> Downloaded policies do not require policy change !!
> Keeping old policy-engine!
> Ranger-PolicyVersion:[139], Cached-PolicyVersion:[138]
> {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Created] (RANGER-3517) Incorrect Policy evaluation on clearing existing policy

[Nishchith Shetty (Jira)]

Nishchith Shetty created RANGER-3517:


 Summary: Incorrect Policy evaluation on clearing existing policy
 Key: RANGER-3517
 URL: https://issues.apache.org/jira/browse/RANGER-3517
 Project: Ranger
  Issue Type: Bug
  Components: plugins, Ranger
Affects Versions: 2.2.0
Reporter: Nishchith Shetty


Hello,

 

Once a policy is created and then all the policies are cleared from Ranger 
Admin, the plugin enforces the last policy that was cached instead of clearing 
the policies on the client.

 

*Steps to reproduce*
 * Create a allow policy for userA (ID-1)
 * Delete the policy ({_}now there are 0 policies on ranger server){_}
 * Use the plugin
 ** Expected/Ideal behaviour - deny (as there's no policy)
 ** Current behaviour - allow (enforced policy ID-1)

_Note: For each step let the change get synced to the client via plugin_

 

*Logs (ranger-plugin v2.2.0)*

{{}}
{code:java}
Downloaded policies do not require policy change !!
Keeping old policy-engine!
Ranger-PolicyVersion:[139], Cached-PolicyVersion:[138]
{code}
{{}}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Created] (RANGER-3516) Java patch 'J10045' taking more time during upgrade.

[Harshal Chavan (Jira)]

Harshal Chavan created RANGER-3516:
--

 Summary: Java patch 'J10045' taking more time during upgrade.
 Key: RANGER-3516
 URL: https://issues.apache.org/jira/browse/RANGER-3516
 Project: Ranger
  Issue Type: Bug
  Components: Ranger
Reporter: Harshal Chavan


J10045 patch is taking more time to apply when we upgrade



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Commented] (RANGER-3504) Create framework to execute DB patch dependent on Java patch.

[Bhavik Patel (Jira)]

[ 
https://issues.apache.org/jira/browse/RANGER-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444293#comment-17444293
 ] 

Bhavik Patel commented on RANGER-3504:
--

Can you please attach the screenshot of Database table entry?

> Create framework to execute DB patch dependent on Java patch.
> -
>
> Key: RANGER-3504
> URL: https://issues.apache.org/jira/browse/RANGER-3504
> Project: Ranger
>  Issue Type: Improvement
>  Components: Ranger
>Affects Versions: 2.2.0
>Reporter: Dineshkumar Yadav
>Assignee: Dineshkumar Yadav
>Priority: Major
>
> Problem Statement
> Currently we have two sets of patches in Ranger (DB & Java patches).
> During Ranger setup, DB patches get executed first then Java patches get 
> executed in an orderly manner based on their sequence. 
> We don't have any mechanism where we can execute Java Patch first and it's 
> dependent DB patch afterwards. 
>  
> Please find the below approach to handle such scenarios.
> Approach:
>  # While executing DB patches, first check if any pre java patches are 
> present by name starting with {*}PatchPreSql_{*}.
>  # If a Pre Java patch is found then execute that java patch first.
>  # Execute DB patch.
>  # Check again if there are any post java patches present by name starting 
> with {*}PatchPostSql_{*}.
>  # If Post Java patches are found, execute them.
>  # While naming the dependent Java patches we need to follow the below 
> convention.
>  # Currently we follow convention: *Patch_J<5 digit sequence 
> number>.java*
>  # Proposed naming convention for dependent Java Patch. *Patch Pre>Sql___J<5 digit sequence 
> number>.java*
> Use Case: 
> Suppose we have a DB patch (050-uniqueindex.sql) and there are two Java 
> patches one needs to execute before and another immediately after DB patch.
> In that scenario we should use the following convention for naming java 
> patches.
> Pre Java Patch : PatchPreSql_050_CleanData_J10050.java 
> Post Java Patch : PatchPostSql_050_UpdateData_J10051.java
> Note: File to be changed : db_setup.py
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Re: Review Request 73707: RANGER-3511:Create Java patch to update policy resource-signature to unique value.

[bhavik patel]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73707/#review223740
---




security-admin/src/main/java/org/apache/ranger/patch/PatchPreSql_058_ForUpdateToUniqueResoureceSignature_J10053.java
Lines 104 (patched)


Print Policy Id or policy Name.



security-admin/src/main/java/org/apache/ranger/patch/PatchPreSql_058_ForUpdateToUniqueResoureceSignature_J10053.java
Lines 112 (patched)


Please update the message to "Disabled policy not found" (remove 'XX')


- bhavik patel


On Nov. 12, 2021, 2:37 p.m., Dineshkumar Yadav wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73707/
> ---
> 
> (Updated Nov. 12, 2021, 2:37 p.m.)
> 
> 
> Review request for ranger, Jayendra Parab, Kishor Gollapalliwar, Abhay 
> Kulkarni, Madhan Neethiraj, Mehul Parikh, Pradeep Agrawal, Ramesh Mani, 
> Vishal Suvagia, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3511
> https://issues.apache.org/jira/browse/RANGER-3511
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> This patch will re-calculate and update policy resource_signature for all 
> disabled Ranger Policies.
> 
> 
> Diffs
> -
> 
>   security-admin/db/mysql/optimized/current/ranger_core_db_mysql.sql 
> 9e2892a1c 
>   security-admin/db/oracle/optimized/current/ranger_core_db_oracle.sql 
> 65f9ad2f6 
>   security-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql 
> a5bcf488b 
>   
> security-admin/db/sqlanywhere/optimized/current/ranger_core_db_sqlanywhere.sql
>  a48f2348c 
>   security-admin/db/sqlserver/optimized/current/ranger_core_db_sqlserver.sql 
> 5cbe6d5a7 
>   security-admin/src/main/java/org/apache/ranger/db/XXPolicyDao.java 
> 41ca8b2a6 
>   
> security-admin/src/main/java/org/apache/ranger/patch/PatchPreSql_058_ForUpdateToUniqueResoureceSignature_J10053.java
>  PRE-CREATION 
>   security-admin/src/main/resources/META-INF/jpa_named_queries.xml 85cadbbd5 
> 
> 
> Diff: https://reviews.apache.org/r/73707/diff/4/
> 
> 
> Testing
> ---
> 
> Tested for all the disabled ranger policies.
> 
> 
> Thanks,
> 
> Dineshkumar Yadav
> 
>

[jira] [Commented] (RANGER-3504) Create framework to execute DB patch dependent on Java patch.

[Bhavik Patel (Jira)]

[ 
https://issues.apache.org/jira/browse/RANGER-3504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444288#comment-17444288
 ] 

Bhavik Patel commented on RANGER-3504:
--

this will impact Upgrade use-case?

> Create framework to execute DB patch dependent on Java patch.
> -
>
> Key: RANGER-3504
> URL: https://issues.apache.org/jira/browse/RANGER-3504
> Project: Ranger
>  Issue Type: Improvement
>  Components: Ranger
>Affects Versions: 2.2.0
>Reporter: Dineshkumar Yadav
>Assignee: Dineshkumar Yadav
>Priority: Major
>
> Problem Statement
> Currently we have two sets of patches in Ranger (DB & Java patches).
> During Ranger setup, DB patches get executed first then Java patches get 
> executed in an orderly manner based on their sequence. 
> We don't have any mechanism where we can execute Java Patch first and it's 
> dependent DB patch afterwards. 
>  
> Please find the below approach to handle such scenarios.
> Approach:
>  # While executing DB patches, first check if any pre java patches are 
> present by name starting with {*}PatchPreSql_{*}.
>  # If a Pre Java patch is found then execute that java patch first.
>  # Execute DB patch.
>  # Check again if there are any post java patches present by name starting 
> with {*}PatchPostSql_{*}.
>  # If Post Java patches are found, execute them.
>  # While naming the dependent Java patches we need to follow the below 
> convention.
>  # Currently we follow convention: *Patch_J<5 digit sequence 
> number>.java*
>  # Proposed naming convention for dependent Java Patch. *Patch Pre>Sql___J<5 digit sequence 
> number>.java*
> Use Case: 
> Suppose we have a DB patch (050-uniqueindex.sql) and there are two Java 
> patches one needs to execute before and another immediately after DB patch.
> In that scenario we should use the following convention for naming java 
> patches.
> Pre Java Patch : PatchPreSql_050_CleanData_J10050.java 
> Post Java Patch : PatchPostSql_050_UpdateData_J10051.java
> Note: File to be changed : db_setup.py
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Re: Review Request 73706: RANGER-3504 : Create framework to execute DB patch dependent on Java patch.

[bhavik patel]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73706/#review223737
---




security-admin/scripts/db_setup.py
Lines 380 (patched)


this can be removed as it is not used in the method



security-admin/scripts/db_setup.py
Lines 397 (patched)


create constant for regex.



security-admin/scripts/db_setup.py
Line 459 (original), 503 (patched)


Same as above Comment.


- bhavik patel


On Nov. 12, 2021, 2:36 p.m., Dineshkumar Yadav wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73706/
> ---
> 
> (Updated Nov. 12, 2021, 2:36 p.m.)
> 
> 
> Review request for ranger, Ankita Sinha, Jayendra Parab, Kishor 
> Gollapalliwar, Abhay Kulkarni, Madhan Neethiraj, Mehul Parikh, Pradeep 
> Agrawal, Ramesh Mani, Vishal Suvagia, and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3504
> https://issues.apache.org/jira/browse/RANGER-3504
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Problem Statement
> Currently we have two sets of patches in Ranger (DB & Java patches).
> During Ranger setup, DB patches get executed first then Java patches get 
> executed in an orderly manner based on their sequence. 
> We don't have any mechanism where we can execute Java Patch first and it's 
> dependent DB patch afterwards. 
>  
> Please find the below approach to handle such scenarios.
> Approach:
> While executing DB patches, first check if any pre java patches are present 
> by name starting with PatchPreSql_.
> If a Pre Java patch is found then execute that java patch first.
> Execute DB patch.
> Check again if there are any post java patches present by name starting with 
> PatchPostSql_.
> If Post Java patches are found, execute them.
> While naming the dependent Java patches we need to follow the below 
> convention.
> Currently we follow convention: Patch_J<5 digit sequence 
> number>.java
> Proposed naming convention for dependent Java Patch. Patch Pre>Sql___J<5 digit sequence 
> number>.java
> Use Case: 
> Suppose we have a DB patch (050-uniqueindex.sql) and there are two Java 
> patches one needs to execute before and another immediately after DB patch.
> In that scenario we should use the following convention for naming java 
> patches.
> Pre Java Patch : PatchPreSql_050_CleanData_J10050.java 
> Post Java Patch : PatchPostSql_050_UpdateData_J10051.java
> 
> 
> Diffs
> -
> 
>   security-admin/scripts/db_setup.py 29f074326 
> 
> 
> Diff: https://reviews.apache.org/r/73706/diff/1/
> 
> 
> Testing
> ---
> 
> Tested in local setup for dependent pre and post java patch.
> 
> 
> Thanks,
> 
> Dineshkumar Yadav
> 
>

[jira] [Commented] (RANGER-3508) Enable easier access to user/group/tag/resource attributes in condition expressions

[Madhan Neethiraj (Jira)]

[ 
https://issues.apache.org/jira/browse/RANGER-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444278#comment-17444278
 ] 

Madhan Neethiraj commented on RANGER-3508:
--

{noformat}
commit a0363eaba9f708088fd0a83f5c89bda5bec58b3c
Author: Madhan Neethiraj 
Date:   Thu Nov 11 13:20:35 2021 -0800

RANGER-3508: enhanced script condition expression for easier access to 
user/group/tag/resource attributes
{noformat}

> Enable easier access to user/group/tag/resource attributes in condition 
> expressions
> ---
>
> Key: RANGER-3508
> URL: https://issues.apache.org/jira/browse/RANGER-3508
> Project: Ranger
>  Issue Type: Improvement
>  Components: plugins
>Reporter: Madhan Neethiraj
>Assignee: Madhan Neethiraj
>Priority: Major
> Fix For: 3.0.0
>
>
> User/group/tags/resource attributes should be easily accessible in condition 
> expressions, with expressions like:
> {noformat}
> USER.state == 'CA'
> UGROUP['test'].dept == 'MKTG'
> REQ.accessType == 'SELECT'
> RES.database == 'hr'
> RES.table == 'employee'
> TAG._type == 'PII'
> TAG.attr1 == 'value1'
> TAGS.length == 2
> TNAMES.indexOf('PCI') != -1{noformat}
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Re: Review Request 73677: RANGER-3285: Off-By-One Error in XUser Syncing

[Abhishek Kumar]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73677/#review223735
---



The jira number tagged in the review does not appear to be associated with the 
code change. 
Please open a new jira and tag the review with it.

- Abhishek  Kumar


On Nov. 1, 2021, 2:30 p.m., David Mollitor wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73677/
> ---
> 
> (Updated Nov. 1, 2021, 2:30 p.m.)
> 
> 
> Review request for ranger.
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> RANGER-3285: Off-By-One Error in XUser Syncing
> 
> 
> Diffs
> -
> 
>   
> ugsync/src/main/java/org/apache/ranger/unixusersync/process/PolicyMgrUserGroupBuilder.java
>  60445043f 
> 
> 
> Diff: https://reviews.apache.org/r/73677/diff/1/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> David Mollitor
> 
>

Re: Review Request 73696: RANGER-3508: enhanced script condition expression for easier access to user/group/tag/resource attributes

[Madhan Neethiraj]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73696/
---

(Updated Nov. 16, 2021, 5:04 a.m.)


Review request for ranger, Abhishek  Kumar, Ankita Sinha, Kishor Gollapalliwar, 
Abhay Kulkarni, Mehul Parikh, Ramesh Mani, Sailaja Polavarapu, and Velmurugan 
Periasamy.


Changes
---

refactoried to move ScriptEngine instantiation to ScriptEngineUtil


Bugs: RANGER-3508
https://issues.apache.org/jira/browse/RANGER-3508


Repository: ranger


Description
---

Updated script evaluator to enable access to user/group/tag/resource attributes 
with following expressions:

- USER.state == 'CA'
- UGROUP['test'].dept == 'MKTG'
- REQ.accessType == 'SELECT'
- RES.database == 'hr'
- RES.table == 'employee'
- TAG._type == 'PII'
- TAG.attr1 == 'value1'
- TAGS.length == 2
- TNAMES.indexOf('PCI') != -1


Diffs (updated)
-

  
agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerAnyOfExpectedTagsPresentConditionEvaluator.java
 3221f79d5 
  
agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerNoneOfExpectedTagsPresentConditionEvaluator.java
 d04f4b388 
  
agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerScriptConditionEvaluator.java
 e57f599d7 
  
agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerScriptExecutionContext.java
 3563fd8e2 
  
agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerTagsAllPresentConditionEvaluator.java
 8616c6660 
  
agents-common/src/main/java/org/apache/ranger/plugin/service/RangerBasePlugin.java
 57a4b4bd5 
  
agents-common/src/main/java/org/apache/ranger/plugin/util/RangerCommonConstants.java
 75132d800 
  
agents-common/src/main/java/org/apache/ranger/plugin/util/ScriptEngineUtil.java 
PRE-CREATION 
  
agents-common/src/test/java/org/apache/ranger/plugin/conditionevaluator/RangerCustomConditionMatcherTest.java
 9f3fb23df 
  
agents-common/src/test/java/org/apache/ranger/plugin/conditionevaluator/RangerRequestScriptEvaluatorTest.java
 PRE-CREATION 


Diff: https://reviews.apache.org/r/73696/diff/4/

Changes: https://reviews.apache.org/r/73696/diff/3-4/


Testing
---

- added unit tests to validate new expressions
- verified that existing unit tests pass successfully


Thanks,

Madhan Neethiraj

[jira] [Created] (RANGER-3515) Enhance Ranger Java client to be configured using serviceType and AppId

[Abhishek Kumar (Jira)]

Abhishek Kumar created RANGER-3515:
--

 Summary: Enhance Ranger Java client to be configured using 
serviceType and AppId  
 Key: RANGER-3515
 URL: https://issues.apache.org/jira/browse/RANGER-3515
 Project: Ranger
  Issue Type: Improvement
  Components: Ranger
Affects Versions: 2.2.0
Reporter: Abhishek Kumar
Assignee: Abhishek Kumar






--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Created] (RANGER-3514) Fix updates to sync source post upgrades

[Abhishek Kumar (Jira)]

Abhishek Kumar created RANGER-3514:
--

 Summary: Fix updates to sync source post upgrades
 Key: RANGER-3514
 URL: https://issues.apache.org/jira/browse/RANGER-3514
 Project: Ranger
  Issue Type: Bug
  Components: usersync
Reporter: Abhishek Kumar
Assignee: Abhishek Kumar


Newly added field sync source needs to be updated with correct values from 
otherAttributes after an upgrade.  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Re: Review Request 73695: RANGER-3507:Handle trailing slash in the ranger Hive URL policy authorization

[Ramesh Mani]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73695/
---

(Updated Nov. 15, 2021, 7:46 p.m.)


Review request for ranger, Don Bosco Durai, Abhay Kulkarni, Madhan Neethiraj, 
Mehul Parikh, Pradeep Agrawal, Selvamohan Neethiraj, Sailaja Polavarapu, and 
Velmurugan Periasamy.


Changes
---

Updated patch after review


Bugs: RANGER-3507
https://issues.apache.org/jira/browse/RANGER-3507


Repository: ranger


Description
---

RANGER-3507:Handle trailing slash in the ranger Hive URL policy authorization


Diffs (updated)
-

  
agents-common/src/main/java/org/apache/ranger/plugin/resourcematcher/RangerURLResourceMatcher.java
 880e4851f 
  agents-common/src/test/resources/policyengine/test_policyengine_hive.json 
70d7e648b 
  
hive-agent/src/main/java/org/apache/ranger/authorization/hive/authorizer/RangerHiveAuditHandler.java
 a3d575c86 
  
hive-agent/src/main/java/org/apache/ranger/authorization/hive/authorizer/RangerHiveResource.java
 ddc0982a6 


Diff: https://reviews.apache.org/r/73695/diff/2/

Changes: https://reviews.apache.org/r/73695/diff/1-2/


Testing
---

- Verified in local vm HIVE commmand with URL in them.
- Verified in Unit test.


Thanks,

Ramesh Mani

Re: Review Request 73696: RANGER-3508: enhanced script condition expression for easier access to user/group/tag/resource attributes

[Abhay Kulkarni]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73696/#review223734
---


Ship it!




Ship It!

- Abhay Kulkarni


On Nov. 10, 2021, 11:02 p.m., Madhan Neethiraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73696/
> ---
> 
> (Updated Nov. 10, 2021, 11:02 p.m.)
> 
> 
> Review request for ranger, Abhishek  Kumar, Ankita Sinha, Kishor 
> Gollapalliwar, Abhay Kulkarni, Mehul Parikh, Ramesh Mani, Sailaja Polavarapu, 
> and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3508
> https://issues.apache.org/jira/browse/RANGER-3508
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Updated script evaluator to enable access to user/group/tag/resource 
> attributes with following expressions:
> 
> - USER.state == 'CA'
> - UGROUP['test'].dept == 'MKTG'
> - REQ.accessType == 'SELECT'
> - RES.database == 'hr'
> - RES.table == 'employee'
> - TAG._type == 'PII'
> - TAG.attr1 == 'value1'
> - TAGS.length == 2
> - TNAMES.indexOf('PCI') != -1
> 
> 
> Diffs
> -
> 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerAnyOfExpectedTagsPresentConditionEvaluator.java
>  3221f79d5 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerNoneOfExpectedTagsPresentConditionEvaluator.java
>  d04f4b388 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerScriptConditionEvaluator.java
>  e57f599d7 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerScriptExecutionContext.java
>  3563fd8e2 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/conditionevaluator/RangerTagsAllPresentConditionEvaluator.java
>  8616c6660 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/service/RangerBasePlugin.java
>  57a4b4bd5 
>   
> agents-common/src/main/java/org/apache/ranger/plugin/util/RangerCommonConstants.java
>  75132d800 
>   
> agents-common/src/test/java/org/apache/ranger/plugin/conditionevaluator/RangerCustomConditionMatcherTest.java
>  9f3fb23df 
>   
> agents-common/src/test/java/org/apache/ranger/plugin/conditionevaluator/RangerRequestScriptEvaluatorTest.java
>  PRE-CREATION 
> 
> 
> Diff: https://reviews.apache.org/r/73696/diff/3/
> 
> 
> Testing
> ---
> 
> - added unit tests to validate new expressions
> - verified that existing unit tests pass successfully
> 
> 
> Thanks,
> 
> Madhan Neethiraj
> 
>

Re: Review Request 73680: RANGER-3499 : Upgrade tomcat to 8.5.72

[Dhaval Shah]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73680/#review223733
---


Ship it!




Ship It!

- Dhaval Shah


On Nov. 2, 2021, 10:04 a.m., Mateen Mansoori wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73680/
> ---
> 
> (Updated Nov. 2, 2021, 10:04 a.m.)
> 
> 
> Review request for ranger, Dhaval Shah, Jayendra Parab, Abhay Kulkarni, 
> Madhan Neethiraj, Mahesh Bandal, Mehul Parikh, Ramesh Mani, Vishal Suvagia, 
> and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3499
> https://issues.apache.org/jira/browse/RANGER-3499
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Currently ranger is pulling tomcat-8.5.69, Upgraded to tomcat-8.5.72.
> 
> 
> Diffs
> -
> 
>   pom.xml 2937f0894 
> 
> 
> Diff: https://reviews.apache.org/r/73680/diff/1/
> 
> 
> Testing
> ---
> 
> Ran : mvn clean compile test verify install
> Tested on local VM, Performed crud operation on Ranger Admin and Ranger KMS.
> 
> 
> Thanks,
> 
> Mateen Mansoori
> 
>

[jira] [Resolved] (RANGER-3510) Ranger upgrade spring framework version to 5.3.12

[Mateen N Mansoori (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mateen N Mansoori resolved RANGER-3510.
---
Resolution: Fixed

Merged in master : 
https://github.com/apache/ranger/commit/63aeb5285c3259e6669f88ffbe4192aedd833733

> Ranger upgrade spring framework version to 5.3.12
> -
>
> Key: RANGER-3510
> URL: https://issues.apache.org/jira/browse/RANGER-3510
> Project: Ranger
>  Issue Type: Task
>  Components: admin, kms
>Reporter: Mateen N Mansoori
>Priority: Major
>
> Ranger is currently pulling in 5.3.7. This needs to be upgraded to 5.3.11 or 
> higher.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (RANGER-3510) Ranger upgrade spring framework version to 5.3.12

[Mateen N Mansoori (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mateen N Mansoori updated RANGER-3510:
--
Fix Version/s: 3.0.0

> Ranger upgrade spring framework version to 5.3.12
> -
>
> Key: RANGER-3510
> URL: https://issues.apache.org/jira/browse/RANGER-3510
> Project: Ranger
>  Issue Type: Task
>  Components: admin, kms
>Reporter: Mateen N Mansoori
>Priority: Major
> Fix For: 3.0.0
>
>
> Ranger is currently pulling in 5.3.7. This needs to be upgraded to 5.3.11 or 
> higher.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Summary: locks getLatestOrCached(RangerServicePoliciesCache.java:198)  
(was: locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2))

> locks getLatestOrCached(RangerServicePoliciesCache.java:198)
> 
>
> Key: RANGER-3513
> URL: https://issues.apache.org/jira/browse/RANGER-3513
> Project: Ranger
>  Issue Type: Bug
>  Components: admin
>Affects Versions: 1.2.0
>Reporter: ruiliang
>Priority: Major
> Attachments: ranger_1_1115.jstack
>
>   Original Estimate: 12h
>  Remaining Estimate: 12h
>
> add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
> locked.Does the external request lastKnownVersion not change?
>  * top  61905 Threads cpu use  99.3%
> {code:java}
> KiB Swap:        0 total,        0 free,        0 used. 57020896 avail Mem 
>   PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND    
>                                                                               
>                                                                               
>   
> 61905 root      20   0 20.748g 4.689g  23760 R 99.3  7.6   4:32.52 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
>  3500 root      20   0 20.748g 4.689g  23760 S  8.3  7.6   0:00.31 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
> 45584 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.76 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
> 62387 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.32 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
>  7230 root      20   0 20.748g 4.689g  23760 S  5.3  7.6   0:00.42 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
>  3412 root      20   0 20.748g 4.689g  23760 S  5.0  7.6   0:00.53 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
> 45616 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:03.50 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
>  3498 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.92 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
>  7238 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.28 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
>  7096 root      20   0 20.748g 4.689g  23760 S  1.3  7.6   0:00.05 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
> 52641 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   1:33.20 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
>  7229 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   0:00.30 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
> 52032 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.00 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
> 52034 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.84 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> -Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
> -Dhostname=fs-hiido-range+ 
> 52035 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:40.21 java 
> -Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
> 

[jira] [Resolved] (RANGER-3499) Ranger - Upgrade tomcat to 8.5.72

[Mateen N Mansoori (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mateen N Mansoori resolved RANGER-3499.
---
Fix Version/s: 3.0.0
   Resolution: Fixed

Merged in master : 
https://github.com/apache/ranger/commit/7d094723c96b85c43c4a88ec741604316f85ea97

> Ranger - Upgrade tomcat to 8.5.72
> -
>
> Key: RANGER-3499
> URL: https://issues.apache.org/jira/browse/RANGER-3499
> Project: Ranger
>  Issue Type: Task
>  Components: Ranger
>Reporter: Mateen N Mansoori
>Priority: Major
> Fix For: 3.0.0
>
>
> Ranger - Upgrade tomcat to 8.5.72



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Description: 
add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
locked.Does the external request lastKnownVersion not change?
 * top  61905 Threads cpu use  99.3%

{code:java}
KiB Swap:        0 total,        0 free,        0 used. 57020896 avail Mem 
  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND      
                                                                                
                                                                            
61905 root      20   0 20.748g 4.689g  23760 R 99.3  7.6   4:32.52 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3500 root      20   0 20.748g 4.689g  23760 S  8.3  7.6   0:00.31 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45584 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.76 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
62387 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7230 root      20   0 20.748g 4.689g  23760 S  5.3  7.6   0:00.42 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3412 root      20   0 20.748g 4.689g  23760 S  5.0  7.6   0:00.53 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45616 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:03.50 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3498 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.92 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7238 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.28 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7096 root      20   0 20.748g 4.689g  23760 S  1.3  7.6   0:00.05 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52641 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   1:33.20 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7229 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   0:00.30 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52032 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.00 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52034 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.84 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52035 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:40.21 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52036 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52037 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:36.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52038 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper 

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Description: 
add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
locked.Does the external request lastKnownVersion not change?
 * top  61905 Threads cpu use  99.3%

{code:java}
KiB Swap:        0 total,        0 free,        0 used. 57020896 avail Mem 
  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND      
                                                                                
                                                                            
61905 root      20   0 20.748g 4.689g  23760 R 99.3  7.6   4:32.52 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3500 root      20   0 20.748g 4.689g  23760 S  8.3  7.6   0:00.31 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45584 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.76 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
62387 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7230 root      20   0 20.748g 4.689g  23760 S  5.3  7.6   0:00.42 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3412 root      20   0 20.748g 4.689g  23760 S  5.0  7.6   0:00.53 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45616 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:03.50 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3498 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.92 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7238 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.28 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7096 root      20   0 20.748g 4.689g  23760 S  1.3  7.6   0:00.05 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52641 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   1:33.20 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7229 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   0:00.30 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52032 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.00 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52034 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.84 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52035 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:40.21 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52036 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52037 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:36.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52038 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper 

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Description: 
add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
locked.Does the external request lastKnownVersion not change?
 * A lot of these threads
{code:java}
KiB Swap:        0 total,        0 free,        0 used. 57020896 avail Mem 
  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND      
                                                                                
                                                                            
61905 root      20   0 20.748g 4.689g  23760 R 99.3  7.6   4:32.52 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3500 root      20   0 20.748g 4.689g  23760 S  8.3  7.6   0:00.31 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45584 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.76 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
62387 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7230 root      20   0 20.748g 4.689g  23760 S  5.3  7.6   0:00.42 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3412 root      20   0 20.748g 4.689g  23760 S  5.0  7.6   0:00.53 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45616 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:03.50 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3498 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.92 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7238 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.28 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7096 root      20   0 20.748g 4.689g  23760 S  1.3  7.6   0:00.05 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52641 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   1:33.20 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7229 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   0:00.30 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52032 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.00 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52034 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.84 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52035 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:40.21 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52036 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52037 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:36.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52038 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Description: 
add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
locked.Does the external request lastKnownVersion not change?
 * A lot of these threads
{code:java}
KiB Swap:        0 total,        0 free,        0 used. 57020896 avail Mem 
  PID USER      PR  NI    VIRT    RES    SHR S %CPU %MEM     TIME+ COMMAND      
                                                                                
                                                                            
61905 root      20   0 20.748g 4.689g  23760 R 99.3  7.6   4:32.52 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3500 root      20   0 20.748g 4.689g  23760 S  8.3  7.6   0:00.31 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45584 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.76 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
62387 root      20   0 20.748g 4.689g  23760 S  6.3  7.6   0:02.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7230 root      20   0 20.748g 4.689g  23760 S  5.3  7.6   0:00.42 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3412 root      20   0 20.748g 4.689g  23760 S  5.0  7.6   0:00.53 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
45616 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:03.50 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 3498 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.92 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7238 root      20   0 20.748g 4.689g  23760 S  4.3  7.6   0:00.28 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7096 root      20   0 20.748g 4.689g  23760 S  1.3  7.6   0:00.05 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52641 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   1:33.20 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
 7229 root      20   0 20.748g 4.689g  23760 S  0.3  7.6   0:00.30 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52032 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.00 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52034 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   0:00.84 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52035 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:40.21 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52036 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.32 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52037 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:36.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 
-Dhostname=fs-hiido-range+ 
52038 root      20   0 20.748g 4.689g  23760 S  0.0  7.6   7:37.96 java 
-Dproc_rangeradmin -XX:MetaspaceSize=512M -Xmx4024m -Xms4024m 
-Duser.timezone=UTC -Dzookeeper.sasl.client.username=zookeeper -Duser=root 

Re: Review Request 73698: RANGER-3510 : Ranger upgrade spring framework version to 5.3.12

[Mehul Parikh]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73698/#review223732
---


Ship it!




Ship It!

- Mehul Parikh


On Nov. 9, 2021, 10:24 a.m., Mateen Mansoori wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73698/
> ---
> 
> (Updated Nov. 9, 2021, 10:24 a.m.)
> 
> 
> Review request for ranger, Dhaval Shah, Kishor Gollapalliwar, Abhay Kulkarni, 
> Madhan Neethiraj, Mehul Parikh, Pradeep Agrawal, Ramesh Mani, and Sailaja 
> Polavarapu.
> 
> 
> Bugs: RANGER-3510
> https://issues.apache.org/jira/browse/RANGER-3510
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Ranger is currently pulling in 5.3.7. This needs to be upgraded to 5.3.11 or 
> higher.
> 
> 
> Diffs
> -
> 
>   pom.xml 2937f0894 
> 
> 
> Diff: https://reviews.apache.org/r/73698/diff/1/
> 
> 
> Testing
> ---
> 
> Ran : mvn clean compile test verify install
> Tested : Admin CRUD operation, KMS CRUD operation on Local VM.
> 
> 
> Thanks,
> 
> Mateen Mansoori
> 
>

Re: Review Request 73680: RANGER-3499 : Upgrade tomcat to 8.5.72

[Mehul Parikh]

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/73680/#review223731
---


Ship it!




Ship It!

- Mehul Parikh


On Nov. 2, 2021, 10:04 a.m., Mateen Mansoori wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/73680/
> ---
> 
> (Updated Nov. 2, 2021, 10:04 a.m.)
> 
> 
> Review request for ranger, Dhaval Shah, Jayendra Parab, Abhay Kulkarni, 
> Madhan Neethiraj, Mahesh Bandal, Mehul Parikh, Ramesh Mani, Vishal Suvagia, 
> and Velmurugan Periasamy.
> 
> 
> Bugs: RANGER-3499
> https://issues.apache.org/jira/browse/RANGER-3499
> 
> 
> Repository: ranger
> 
> 
> Description
> ---
> 
> Currently ranger is pulling tomcat-8.5.69, Upgraded to tomcat-8.5.72.
> 
> 
> Diffs
> -
> 
>   pom.xml 2937f0894 
> 
> 
> Diff: https://reviews.apache.org/r/73680/diff/1/
> 
> 
> Testing
> ---
> 
> Ran : mvn clean compile test verify install
> Tested on local VM, Performed crud operation on Ranger Admin and Ranger KMS.
> 
> 
> Thanks,
> 
> Mateen Mansoori
> 
>

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Description: 
add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
locked.Does the external request lastKnownVersion not change?
 * A lot of these threads
{code:java}
//
http-bio-6080-exec-41522" #44501 daemon prio=5 os_prio=0 tid=0x7f3ad8003800 
nid=0xa5b waiting on condition [0x7f3db3ffc000] java.lang.Thread.State: 
TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to 
wait for <0x0006c8fd07d0> (a 
java.util.concurrent.locks.ReentrantLock$NonfairSync) at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at 
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:934)
 at 
java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1247)
 at java.util.concurrent.locks.ReentrantLock.tryLock(ReentrantLock.java:442) at 
org.apache.ranger.common.RangerServicePoliciesCache$ServicePoliciesWrapper.getLatestOrCached(RangerServicePoliciesCache.java:198)
 at 
org.apache.ranger.common.RangerServicePoliciesCache.getServicePolicies(RangerServicePoliciesCache.java:142)
 at 
org.apache.ranger.biz.ServiceDBStore.getServicePoliciesIfUpdated(ServiceDBStore.java:2534)
 at 
org.apache.ranger.rest.ServiceREST.getSecureServicePoliciesIfUpdated(ServiceREST.java:3078)
 at 
org.apache.ranger.rest.ServiceREST$$FastClassBySpringCGLIB$$92dab672.invoke()
 at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at 
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
 at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
 at 
org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:99)
 at 
org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:282)
 at 
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:96)
 at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
 at 
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
 at 
org.apache.ranger.rest.ServiceREST$$EnhancerBySpringCGLIB$$7fd1c842.getSecureServicePoliciesIfUpdated()
 at sun.reflect.GeneratedMethodAccessor208.invoke(Unknown Source) at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498) at 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
 at 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
 at 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
 at 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
 at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
 at 
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
 at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
 at 
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
 at 
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
 at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
 at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at 

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Attachment: ranger_1_1115.jstack

> locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)
> -
>
> Key: RANGER-3513
> URL: https://issues.apache.org/jira/browse/RANGER-3513
> Project: Ranger
>  Issue Type: Bug
>  Components: admin
>Affects Versions: 1.2.0
>Reporter: ruiliang
>Priority: Major
> Attachments: ranger_1_1115.jstack
>
>   Original Estimate: 12h
>  Remaining Estimate: 12h
>
> add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
> locked.Does the external request lastKnownVersion not change?
>  * A lot of these threads
> {code:java}
> //
> http-bio-6080-exec-41522" #44501 daemon prio=5 os_prio=0 
> tid=0x7f3ad8003800 nid=0xa5b waiting on condition [0x7f3db3ffc000] 
> java.lang.Thread.State: TIMED_WAITING (parking) at 
> sun.misc.Unsafe.park(Native Method) - parking to wait for 
> <0x0006c8fd07d0> (a java.util.concurrent.locks.ReentrantLock$NonfairSync) 
> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:934)
>  at 
> java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1247)
>  at java.util.concurrent.locks.ReentrantLock.tryLock(ReentrantLock.java:442) 
> at 
> org.apache.ranger.common.RangerServicePoliciesCache$ServicePoliciesWrapper.getLatestOrCached(RangerServicePoliciesCache.java:198)
>  at 
> org.apache.ranger.common.RangerServicePoliciesCache.getServicePolicies(RangerServicePoliciesCache.java:142)
>  at 
> org.apache.ranger.biz.ServiceDBStore.getServicePoliciesIfUpdated(ServiceDBStore.java:2534)
>  at 
> org.apache.ranger.rest.ServiceREST.getSecureServicePoliciesIfUpdated(ServiceREST.java:3078)
>  at 
> org.apache.ranger.rest.ServiceREST$$FastClassBySpringCGLIB$$92dab672.invoke()
>  at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) 
> at 
> org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
>  at 
> org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:99)
>  at 
> org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:282)
>  at 
> org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:96)
>  at 
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
>  at 
> org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
>  at 
> org.apache.ranger.rest.ServiceREST$$EnhancerBySpringCGLIB$$7fd1c842.getSecureServicePoliciesIfUpdated()
>  at sun.reflect.GeneratedMethodAccessor208.invoke(Unknown Source) at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498) at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
>  at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>  at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>  at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>  at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
>  at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
>  at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
>  at 
> 

[jira] [Assigned] (RANGER-3512) Create Java patch to update policy guid to unique value.

[Dineshkumar Yadav (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dineshkumar Yadav reassigned RANGER-3512:
-

Fix Version/s: 2.2.0
 Assignee: Dineshkumar Yadav

> Create Java patch to update policy guid to unique value.
> 
>
> Key: RANGER-3512
> URL: https://issues.apache.org/jira/browse/RANGER-3512
> Project: Ranger
>  Issue Type: Sub-task
>  Components: Ranger
>Reporter: Dineshkumar Yadav
>Assignee: Dineshkumar Yadav
>Priority: Major
> Fix For: 2.2.0
>
>
> This Java patch will try to find duplicate GUID in x_policy table, If found 
> then update them to a unique value. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Updated] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ruiliang updated RANGER-3513:
-
Description: 
add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
locked.Does the external request lastKnownVersion not change?
 * A lot of these threads
{code:java}
//
http-bio-6080-exec-41522" #44501 daemon prio=5 os_prio=0 tid=0x7f3ad8003800 
nid=0xa5b waiting on condition [0x7f3db3ffc000] java.lang.Thread.State: 
TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to 
wait for <0x0006c8fd07d0> (a 
java.util.concurrent.locks.ReentrantLock$NonfairSync) at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at 
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:934)
 at 
java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1247)
 at java.util.concurrent.locks.ReentrantLock.tryLock(ReentrantLock.java:442) at 
org.apache.ranger.common.RangerServicePoliciesCache$ServicePoliciesWrapper.getLatestOrCached(RangerServicePoliciesCache.java:198)
 at 
org.apache.ranger.common.RangerServicePoliciesCache.getServicePolicies(RangerServicePoliciesCache.java:142)
 at 
org.apache.ranger.biz.ServiceDBStore.getServicePoliciesIfUpdated(ServiceDBStore.java:2534)
 at 
org.apache.ranger.rest.ServiceREST.getSecureServicePoliciesIfUpdated(ServiceREST.java:3078)
 at 
org.apache.ranger.rest.ServiceREST$$FastClassBySpringCGLIB$$92dab672.invoke()
 at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at 
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
 at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
 at 
org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:99)
 at 
org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:282)
 at 
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:96)
 at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
 at 
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
 at 
org.apache.ranger.rest.ServiceREST$$EnhancerBySpringCGLIB$$7fd1c842.getSecureServicePoliciesIfUpdated()
 at sun.reflect.GeneratedMethodAccessor208.invoke(Unknown Source) at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498) at 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
 at 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
 at 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
 at 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
 at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
 at 
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
 at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
 at 
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
 at 
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
 at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
 at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at 

[jira] [Created] (RANGER-3513) locks getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)

[ruiliang (Jira)]

ruiliang created RANGER-3513:


 Summary: locks 
getLatestOrCached(RangerServicePoliciesCache.java:198) (ranger 1.2)
 Key: RANGER-3513
 URL: https://issues.apache.org/jira/browse/RANGER-3513
 Project: Ranger
  Issue Type: Bug
  Components: admin
Affects Versions: 1.2.0
Reporter: ruiliang


add new policy ，All Ranger requests are 10s+.Print jstatck: some threads are 
locked.Does the external request lastKnownVersion not change?
 * A lot of these threads
{code:java}
//
http-bio-6080-exec-41522" #44501 daemon prio=5 os_prio=0 tid=0x7f3ad8003800 
nid=0xa5b waiting on condition [0x7f3db3ffc000] java.lang.Thread.State: 
TIMED_WAITING (parking) at sun.misc.Unsafe.park(Native Method) - parking to 
wait for <0x0006c8fd07d0> (a 
java.util.concurrent.locks.ReentrantLock$NonfairSync) at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at 
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireNanos(AbstractQueuedSynchronizer.java:934)
 at 
java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireNanos(AbstractQueuedSynchronizer.java:1247)
 at java.util.concurrent.locks.ReentrantLock.tryLock(ReentrantLock.java:442) at 
org.apache.ranger.common.RangerServicePoliciesCache$ServicePoliciesWrapper.getLatestOrCached(RangerServicePoliciesCache.java:198)
 at 
org.apache.ranger.common.RangerServicePoliciesCache.getServicePolicies(RangerServicePoliciesCache.java:142)
 at 
org.apache.ranger.biz.ServiceDBStore.getServicePoliciesIfUpdated(ServiceDBStore.java:2534)
 at 
org.apache.ranger.rest.ServiceREST.getSecureServicePoliciesIfUpdated(ServiceREST.java:3078)
 at 
org.apache.ranger.rest.ServiceREST$$FastClassBySpringCGLIB$$92dab672.invoke()
 at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) at 
org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:738)
 at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
 at 
org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:99)
 at 
org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:282)
 at 
org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:96)
 at 
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
 at 
org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:673)
 at 
org.apache.ranger.rest.ServiceREST$$EnhancerBySpringCGLIB$$7fd1c842.getSecureServicePoliciesIfUpdated()
 at sun.reflect.GeneratedMethodAccessor208.invoke(Unknown Source) at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.lang.reflect.Method.invoke(Method.java:498) at 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
 at 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185)
 at 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
 at 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
 at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
 at 
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
 at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
 at 
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)
 at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)
 at 
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)
 at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)
 at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:731) at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
 at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
 at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at 

[jira] [Updated] (RANGER-3512) Create Java patch to update policy guid to unique value.

[Dineshkumar Yadav (Jira)]

 [ 
https://issues.apache.org/jira/browse/RANGER-3512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dineshkumar Yadav updated RANGER-3512:
--
Description: This Java patch will try to find duplicate GUID in x_policy 
table, If found then update them to a unique value. 

> Create Java patch to update policy guid to unique value.
> 
>
> Key: RANGER-3512
> URL: https://issues.apache.org/jira/browse/RANGER-3512
> Project: Ranger
>  Issue Type: Sub-task
>  Components: Ranger
>Reporter: Dineshkumar Yadav
>Priority: Major
>
> This Java patch will try to find duplicate GUID in x_policy table, If found 
> then update them to a unique value. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

[jira] [Created] (RANGER-3512) Create Java patch to update policy guid to unique value.

[Dineshkumar Yadav (Jira)]

Dineshkumar Yadav created RANGER-3512:
-

 Summary: Create Java patch to update policy guid to unique value.
 Key: RANGER-3512
 URL: https://issues.apache.org/jira/browse/RANGER-3512
 Project: Ranger
  Issue Type: Sub-task
  Components: Ranger
Reporter: Dineshkumar Yadav






--
This message was sent by Atlassian Jira
(v8.20.1#820001)