Re: tracking solr response time

2009-11-10 Thread bharath venkatesh
, Katta, Hadoop, HBase, UIMA, NLP, NER, IR - Original Message From: bharath venkatesh bharathv6.proj...@gmail.com To: solr-user@lucene.apache.org Sent: Sun, November 8, 2009 2:15:00 PM Subject: Re: tracking solr response time Thanks Lance for the clear explanation .. are you

Re: tracking solr response time

2009-11-10 Thread Yonik Seeley
On Tue, Nov 10, 2009 at 8:07 AM, bharath venkatesh bharathv6.proj...@gmail.com wrote: how much ram would be good enough for the Solr JVM  to run comfortably. It really depends on how much stuff is cached, what fields you facet and sort on, etc. It can be easier to measure than to try and

Re: tracking solr response time

2009-11-10 Thread bharath venkatesh
Thanks yonik .. will consider Jconsole On Tue, Nov 10, 2009 at 7:01 PM, Yonik Seeley yo...@lucidimagination.comwrote: On Tue, Nov 10, 2009 at 8:07 AM, bharath venkatesh bharathv6.proj...@gmail.com wrote: how much ram would be good enough for the Solr JVM to run comfortably. It really

Re: tracking solr response time

2009-11-10 Thread Otis Gospodnetic
Hello, - Original Message From: bharath venkatesh bharathv6.proj...@gmail.com To: solr-user@lucene.apache.org Sent: Tue, November 10, 2009 8:07:59 AM Subject: Re: tracking solr response time Otis, This means we have to leave enough space for os cache to cache the whole

Re: tracking solr response time

2009-11-09 Thread Otis Gospodnetic
Message From: bharath venkatesh bharathv6.proj...@gmail.com To: solr-user@lucene.apache.org Sent: Sun, November 8, 2009 2:15:00 PM Subject: Re: tracking solr response time Thanks Lance for the clear explanation .. are you saying we should give solr JVM enough memory so that os cache can

Re: tracking solr response time

2009-11-08 Thread bharath venkatesh
Thanks Lance for the clear explanation .. are you saying we should give solr JVM enough memory so that os cache can optimize disk I/O efficiently .. that means in our case we have 16 GB index so would it be enough to allocated solr JVM 20GB memory and rely on the OS cache to optimize disk I/O

tracking solr response time

2009-11-02 Thread bharath venkatesh
Hi, We are using solr for many of ur products it is doing quite well . But since no of hits are becoming high we are experiencing latency in certain requests ,about 15% of our requests are suffering a latency . We are trying to identify the problem . It may be due to network issue or

Re: tracking solr response time

2009-11-02 Thread Yonik Seeley
On Mon, Nov 2, 2009 at 8:13 AM, bharath venkatesh bharathv6.proj...@gmail.com wrote:    We are using solr for many of ur products  it is doing quite well .  But since no of hits are becoming high we are experiencing latency in certain requests ,about 15% of our requests are suffering a latency

Re: tracking solr response time

2009-11-02 Thread Israel Ekpo
On Mon, Nov 2, 2009 at 8:41 AM, Yonik Seeley yo...@lucidimagination.comwrote: On Mon, Nov 2, 2009 at 8:13 AM, bharath venkatesh bharathv6.proj...@gmail.com wrote: We are using solr for many of ur products it is doing quite well . But since no of hits are becoming high we are

Re: tracking solr response time

2009-11-02 Thread Grant Ingersoll
On Nov 2, 2009, at 5:41 AM, Yonik Seeley wrote: QTime is the time spent in generating the in-memory representation for the response before the response writer starts streaming it back in whatever format was requested. The stored fields of returned documents are also loaded at this point (to

Re: tracking solr response time

2009-11-02 Thread bharath venkatesh
Thanks for the quick response @yonik How much of a latency compared to normal, and what version of Solr are you using? latency is usually around 2-4 secs (some times it goes more than that ) which happens to only 15-20% of the request other 80-85% of request are very fast it is in milli

Re: tracking solr response time

2009-11-02 Thread Erick Erickson
Also, how about a sample of a fast and slow query? And is a slow query only slow the first time it's executed or every time? Best Erick On Mon, Nov 2, 2009 at 9:52 AM, bharath venkatesh bharathv6.proj...@gmail.com wrote: Thanks for the quick response @yonik How much of a latency compared

Re: tracking solr response time

2009-11-02 Thread Israel Ekpo
On Mon, Nov 2, 2009 at 9:52 AM, bharath venkatesh bharathv6.proj...@gmail.com wrote: Thanks for the quick response @yonik How much of a latency compared to normal, and what version of Solr are you using? latency is usually around 2-4 secs (some times it goes more than that ) which

Re: tracking solr response time

2009-11-02 Thread bharath venkatesh
@Israel: yes I got that point which yonik mentioned .. but is qtime the total time taken by solr server for that request or is it part of time taken by the solr for that request ( is there any thing that a solr server does for that particulcar request which is not included in that qtime bracket

Re: tracking solr response time

2009-11-02 Thread Erick Erickson
So I need someone with better knowledge to chime in here with an opinion on whether autowarming would help since the whole faceting thing is something I'm not very comfortable with... hint, hint, hint Erick On Mon, Nov 2, 2009 at 2:21 PM, bharath venkatesh bharathv6.proj...@gmail.com wrote:

Re: tracking solr response time

2009-11-02 Thread Yonik Seeley
On Mon, Nov 2, 2009 at 2:21 PM, bharath venkatesh bharathv6.proj...@gmail.com wrote: we observed many times there is huge mismatch between qtime and time measured at the client for the response Long times to stream back the result to the client could be due to - client not reading fast enough