replication Compression
-----------------------
Key: SOLR-829
URL: https://issues.apache.org/jira/browse/SOLR-829
Project: Solr
Issue Type: Improvement
Components: replication
Affects Versions: 1.3.1
Reporter: Simon Collins
>From a discussion on the mailing list solr-user, it would be useful to have an
>option to compress the files sent between servers for replication purposes.
Files sent across between indexes can be compressed by a large margin allowing
for easier replication between sites.
...Noted by Noble Paul
we will use a gzip on both ends of the pipe . On the slave side you can say
<str name="zip">true<str> as an extra option to compress and send data from
server
Other thoughts on issue:
Do keep in mind that compression is a CPU intensive process so it is a trade
off between CPU utilization and network bandwidth. I have see cases where
compressing the data before a network transfer ended up being slower than
without compression because the cost of compression and un-compression was more
than the gain in network transfer.
Why invent something when compression is standard in HTTP? --wunder
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.