[
https://issues.apache.org/jira/browse/RANGER-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Qiang Zhang updated RANGER-1729:
--------------------------------
Attachment: 0001-RANGER-1729-The-performance-of-hbase-will-be-signifi.patch
The idea of improvement is as follows:
1. The enhancement doesn't effect the previous function.
2. Using columns store to save frequently used access, and add frequently
access rights to the secondary cache.
3. Synchronize the secondary cache when the policy changes
The patch doesn't effect the previous function. But it significantly improves
the performance of the hbase's performance. The result is as following:
1. Add one policy and not write audit log. The HBase's performance decreased
4.18% when the user set supper user before used the patch. In the same
configuration case the HBase's performance decreased -3.20% after used the
patch;
1. Add one policy and not write audit log. The HBase's performance decreased
10.10% when the user set common user before used the patch. In the same
configuration case the HBase's performance decreased 2.74% after used the patch;
Please refer to verify_patch_result_detail.png.
> The hbase's performance will be significantly reduced after used Ranger to
> control and configure Hbase data security
> --------------------------------------------------------------------------------------------------------------------
>
> Key: RANGER-1729
> URL: https://issues.apache.org/jira/browse/RANGER-1729
> Project: Ranger
> Issue Type: Bug
> Components: Ranger
> Reporter: Qiang Zhang
> Assignee: Qiang Zhang
> Labels: patch
> Attachments:
> 0001-RANGER-1729-The-performance-of-hbase-will-be-signifi.patch,
> Polling_interval_result_detail.png, result_detail.png
>
>
> The hbase's performance will be significantly reduced after used Ranger to
> control and configure Hbase data security. I used following environment to
> verify issue.
> Test tools：ycsb-0.1.4
> Test environment：
> Node number：4
> Node configuration detail is as following:
> Node1、Node2:
> CPU:32 core，Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
> memory：128GB
> Node3、Node4
> CPU:48 core，Intel(R) Xeon(R) CPU E5-2670 v3 @ 2.30GHz
> memory：128GB
> The test result:
> 2. Add one policy and not write audit log, HBase's performance decreased
> 10.10%;
> 3. Add one policy and write audit log, HBase's performance decreased 12.90%;
> Please refer to result_detail.png.
> This decline is unacceptable in a real environment. It will seriously affect
> the user to use Ranger.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
