Re: Optimizing filter bitsets

2015-01-27 Thread Adrien Grand
On Mon, Jan 26, 2015 at 11:05 PM, Mike Sukmanowsky mike.sukmanow...@gmail.com wrote: I understand that the result of the bool is the bitset that's cached as opposed to the individual term filters themselves. This had me concerned that for certain complex bool filters (where we have 10 or so

Optimizing filter bitsets

2015-01-26 Thread Mike Sukmanowsky
We're storing Kibana-style time series documents across three indexes on a 10 node cluster (i2.xlarges). These indexes have between 20M-500M docs at peak and we use bool filters extensively while querying. Query volumes are pretty low (maybe around 100 searches/sec at peak) versus index ops