Cyrus 2.5, xapian, Sphinx and index sizes

2014-09-23 Thread Sebastian Hagedorn
Hi, as I mentioned a few days ago, we're considering metapartions on SSD drives in order to optimize IMAP search performance. We have yet to run a full analysis on how much storage that would require, but a first guesstimate points towards about 20% of the net mail data for all the cyrus.* fil

Re: Cyrus 2.5, xapian, Sphinx and index sizes

2014-09-23 Thread Bron Gondwana
On Tue, Sep 23, 2014, at 06:58 PM, Sebastian Hagedorn wrote: > Hi, > > as I mentioned a few days ago, we're considering metapartions on SSD drives > in order to optimize IMAP search performance. We have yet to run a full > analysis on how much storage that would require, but a first guesstimate

Re: Cyrus 2.5, xapian, Sphinx and index sizes

2014-09-23 Thread Robert Mueller
> # Any time the disk gets over 50%, compress -o single down to data > 13 * * * * /home/mod_perl/hm/scripts/xapian_compact.pl -a -o -d 50 temp > data > # Copy the temporary search databases down to data during the week > 43 1 * * 1,2,3,4,5,6 /home/mod_perl/hm/scripts/xapian_compact.pl -a > temp,

Re: Cyrus 2.5, xapian, Sphinx and index sizes

2014-09-24 Thread Sebastian Hagedorn
Hi Bron, thanks a lot for this detailed description of your setup! I have added a few questions inline below ... --On 23. September 2014 21:32:04 +1000 Bron Gondwana wrote: On Tue, Sep 23, 2014, at 06:58 PM, Sebastian Hagedorn wrote: Hi, as I mentioned a few days ago, we're considering

Re: Cyrus 2.5, xapian, Sphinx and index sizes

2014-09-24 Thread Bron Gondwana
On Thu, Sep 25, 2014, at 12:23 AM, Sebastian Hagedorn wrote: > > sdb1-20 are LUKS encrypted partitions on a single hardware RAID6 volume > > with 12 x 2Tb WD RE4 drives. md2 is also LUKS encrypted, but it's a > > software RAID1e with 3 x 2Tb WD RE4 drives. md1 is 400Gb Intel DC3700 > > drives in so