lhotari opened a new pull request, #24391: URL: https://github.com/apache/pulsar/pull/24391
### Motivation To reduce the size of ZNodes, there's ManagedCursorInfo compression which was introduced in [PIP-146](https://github.com/apache/pulsar/issues/14529). ManagedLedgerInfo compression was introduced earlier, in PR #11490. ManagedCursorInfo compression can enable using a higher `managedLedgerMaxUnackedRangesToPersist` and `managedLedgerMaxUnackedRangesToPersistInMetadataStore` settings. ManagedLedgerInfo compression is required for a very large amount of BookKeeper or tiered storage ledgers for a single topic. Both settings reduce the size of metadata storage which will reduce overall ZooKeeper memory usage. After enabling compression, existing entries won't be compressed until they are modified. ### Modifications - add the settings to `broker.conf` and `standalone.conf` so that it's easier to enable the settings. Without settings in `broker.conf`, it's necessary to use `PULSAR_PREFIX_` syntax with Pulsar's Helm chart and docker image when using the `apply-config-from-env.py` solution that is used to apply environment variables to `broker.conf`. ### Documentation <!-- DO NOT REMOVE THIS SECTION. CHECK THE PROPER BOX ONLY. --> - [ ] `doc` <!-- Your PR contains doc changes. --> - [ ] `doc-required` <!-- Your PR changes impact docs and you will update later --> - [x] `doc-not-needed` <!-- Your PR changes do not impact docs --> - [ ] `doc-complete` <!-- Docs have been already added --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@pulsar.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
