[
https://issues.apache.org/jira/browse/SOLR-16608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17684483#comment-17684483
]
ASF subversion and git services commented on SOLR-16608:
--------------------------------------------------------
Commit c984536ea9800dc70e27eed6671347764d43ac76 in solr's branch
refs/heads/main from Justin Sweeney
[ https://gitbox.apache.org/repos/asf?p=solr.git;h=c984536ea98 ]
SOLR-16608: Ability to compress the collection state (#1267)
> Enable ability to compress state.json in Zookeeper
> --------------------------------------------------
>
> Key: SOLR-16608
> URL: https://issues.apache.org/jira/browse/SOLR-16608
> Project: Solr
> Issue Type: Improvement
> Reporter: Justin Sweeney
> Priority: Major
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> As noted in the Solr documentation, Zookeeper is intended to hold small
> files, by default < 1MB:
> [https://solr.apache.org/guide/7_4/setting-up-an-external-zookeeper-ensemble.html#increasing-the-file-size-limit.]
> When creating collections with very large number of replicas, it is possible
> to exceeded that size in the state.json that is created, which then requires
> Solr operators to reconfigure Zookeeper to increase that limit and also has
> performance implications.
> I am proposing that we provide the ability to compress state.json using
> standard ZLib compression. This will be based on a configuration parameter in
> solr.xml which will provide a minimum size of state.json over which to use
> compression. This will give Solr operators a better mechanism to handle
> state.json for very large collections.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org
For additional commands, e-mail: issues-h...@solr.apache.org
