Yunye Zhang created RANGER-5406:
-----------------------------------
Summary: Support export policies in a segmented manner
Key: RANGER-5406
URL: https://issues.apache.org/jira/browse/RANGER-5406
Project: Ranger
Issue Type: New Feature
Components: Ranger
Affects Versions: 2.3.0
Reporter: Yunye Zhang
Fix For: 2.3.0
In big data production environments, customers create a massive number of
policies, often reaching hundreds of thousands or even millions. Exporting the
entire set of policies for disaster recovery would result in an enormous data
volume and extremely slow import speeds into the backup cluster. Our current
experimental data shows that importing 100,000 policies via the API is
memory-intensive and time-consuming. With an even larger number of policies,
memory consumption will increase significantly, and insufficient memory can
cause import interruptions. Therefore, we recommend modifying the API to allow
for segmented export. This will save memory and ensure data reliability when
importing to other clusters for disaster recovery.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
