Re: Performance on faceting using docValues

2015-03-09 Thread Anshum Gupta
Hi Lei, The mailing list doesn't allow attachments. Can you share these via a file sharing platform? On Mon, Mar 9, 2015 at 12:48 AM, lei simpl...@gmail.com wrote: The Solr instance is single-shard. Index size is around 20G and total doc # is about 12 million. Below are the histograms for the

Re: Performance on faceting using docValues

2015-03-09 Thread lei
The term histograms are shared in this link. Sorry for the confusion. https://docs.google.com/presentation/d/1tma4hkYjxJfBTnMbO6Pq_dUHqZ0wI_UTlgoVqXtW4ZA/pub?start=falseloop=falsedelayms=3000slide=id.p On Mon, Mar 9, 2015 at 10:56 AM, Anshum Gupta ans...@anshumgupta.net wrote: Hi Lei, The

Re: Performance on faceting using docValues

2015-03-09 Thread lei
Sure, here is the link to the image of term histograms. Thanks. https://docs.google.com/presentation/d/1tma4hkYjxJfBTnMbO6Pq_dUHqZ0wI_UTlgoVqXtW4ZA/edit?usp=sharing On Mon, Mar 9, 2015 at 10:56 AM, Anshum Gupta ans...@anshumgupta.net wrote: Hi Lei, The mailing list doesn't allow attachments.

Re: Performance on faceting using docValues

2015-03-09 Thread lei
The Solr instance is single-shard. Index size is around 20G and total doc # is about 12 million. Below are the histograms for the three facet fields in my query. Thanks. On Thu, Mar 5, 2015 at 11:57 PM, Toke Eskildsen t...@statsbiblioteket.dk wrote: On Thu, 2015-03-05 at 21:14 +0100, lei

Re: Performance on faceting using docValues

2015-03-05 Thread Mikhail Khludnev
Hello, I have one consideration on top of my head, would you mind to show a brief snapshot by a sampler? On Thu, Mar 5, 2015 at 10:18 PM, lei simpl...@gmail.com wrote: Hi there, I'm testing facet performance with vs without docValues in Solr 4.7, and found that on first request, performance

Re: Performance on faceting using docValues

2015-03-05 Thread lei
Here is the specs of some example query faceting on three fields (all string type): first call: 1+ sec (with docValues) vs. 4+ sec (w/o docValues) subsequent calls: 30+ ms (with docValues) vs. 100+ ms (w/o docValues) consistently the total # of docs returned is around 600,000 On Thu, Mar 5,

Re: Performance on faceting using docValues

2015-03-05 Thread lei
Some mistake in the previous email. Here is the specs of some example query faceting on three fields (all string type): first call: 1+ sec (with docValues) vs. 4+ sec (w/o docValues) subsequent calls: 100+ ms (with docValues) vs. 30+ ms (w/o docValues) consistently the total # of docs returned is

RE: Performance on faceting using docValues

2015-03-05 Thread Ryan, Michael F. (LNG-DAY)
thought maybe I was the only one... -Michael -Original Message- From: lei [mailto:simpl...@gmail.com] Sent: Thursday, March 05, 2015 2:40 PM To: solr-user@lucene.apache.org Subject: Re: Performance on faceting using docValues Here is the specs of some example query faceting on three

Re: Performance on faceting using docValues

2015-03-05 Thread Toke Eskildsen
On Thu, 2015-03-05 at 21:14 +0100, lei wrote: You present a very interesting observation. I have not noticed what you describe, but on the other hand we have not done comparative speed tests. q=*:*fq=country:USfq=category:112 First observation: Your query is '*:*, which is a magic query.