Re: sizes of non-fdt flies affected by compression settings

2015-11-04 Thread Chris Hostetter
: This setting can only affect the size of the fdt (and fdx) files. I suspect : you saw differences in the size of other files because it caused Lucene to : run different merges (because segments had different sizes), and the : compression that we use for postings/terms worked better, but it could

Re: sizes of non-fdt flies affected by compression settings

2015-11-04 Thread Chris Hostetter
: This setting can only affect the size of the fdt (and fdx) files. I suspect : you saw differences in the size of other files because it caused Lucene to : run different merges (because segments had different sizes), and the : compression that we use for postings/terms worked better, but it could

Re: sizes of non-fdt flies affected by compression settings

2015-11-01 Thread Adrien Grand
Hi Anton, This setting can only affect the size of the fdt (and fdx) files. I suspect you saw differences in the size of other files because it caused Lucene to run different merges (because segments had different sizes), and the compression that we use for postings/terms worked better, but it cou

sizes of non-fdt flies affected by compression settings

2015-10-01 Thread Anton Zenkov
Hello, I'm experimenting with Lucene 5.2.1 and I see something I cannot find an easy explanation for in the api docs. Depending on whether I pick BEST_COMPRESSION or BEST_SPEED mode for StoredFieldsFormat almost all files become smaller for BEST_COMPRESSION mode. I expected only .fdt files to be s