vyommani commented on PR #770:
URL: https://github.com/apache/ranger/pull/770#issuecomment-3669684803
Summary – Apache Ranger Bulk‑Policy Evaluation Improvement
What we changed
• When delta sync is disabled (deltaEnabled=false) we now
evaluate policies from a lock‑free snapshot instead of holding the evaluation
loop.
• When delta sync is enabled the existing “legacy” locked path
remains unchanged.
Benchmark environment
• 50 000 policies, 24 threads, 30 000 batches per thread, 12 CPU
cores.
Key results
Scenario Throughput (r/s) @ 1 k
batch. Throughput (r/s) @ 10 k batch. Memory. P95 Latency
Lock‑free Snapshot (delta = false). ~3.76 M
~3.59 M 33‑42 MB 9‑88 ms
Legacy Locked (delta = true) ~3.57 M
~3.43 M ~33 MB 10‑91 ms
• Speedup: 4‑44 % higher throughput with the snapshot, biggest
gain at smaller batch sizes.
• Scalability: With up to 50 k policies the snapshot stays 4‑5 %
faster; at 100 k policies the advantage disappears.
• Correctness: 500 random requests gave identical allow/deny
decisions.
• Concurrency: 9 evaluation threads + 1 update thread ran without
crashes or race conditions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
