Re: Really bad query performance for date range queries

2013-02-05 Thread sausarkar
We have a 96GB ram machine with 16 processors. the JVM is set to use 60 GB. The test that we are running are purely query there is no indexing going on. I dont see garbage collection when I attach visualVM but see frequent CPU spikes ~once every minute. -- View this message in context:

Re: date query performance (TrieDate)

2013-02-04 Thread sausarkar
When the query time jump to more than 10 seconds the linux load average spikes up to more than 100 in a 16 CPU machine. Any one has any suggestions? -- View this message in context: http://lucene.472066.n3.nabble.com/date-query-performance-TrieDate-tp4038419p4038422.html Sent from the Solr -

Re: Really bad query performance for date range queries

2013-02-04 Thread sausarkar
Unfortunately we need data by minute we cannot go hour, is there an option for 3 minutes or 5 minutes? something is like NOW/3MIN? I am also noticing when I generating around 110 queries per second (date range ones) after sometime solr does not respond and just freezes. Is there a way to cure

Re: SolrCloud - Query performance degrades with multiple servers

2013-01-09 Thread sausarkar
Hi Yonik, Could you merger this feature with 4.0 branch, We tried to use 4.1 it did solve the CPU spike but we did get other issues. As we are very tight on schedule so it would very beneficial if you could merge this feature with 4.0 branch. Let me know. Thanks -- View this message in

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-12 Thread sausarkar
We still could replicate the issue in 4.1 branch i.e. queries going to one server (numShards=1) is being distributed among all the servers which is creating CPU spikes in all the servers in the cloud. Do you think this behavior is as expected or will be fixed in the 4.1 release? -- View this

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-11 Thread sausarkar
Do you know when will 4.1 be released or will there be a 4.0.1 release with bug fixes from 4.0? Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-Query-performance-degrades-with-multiple-servers-tp4024660p4026139.html Sent from the Solr - User mailing list

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-09 Thread sausarkar
: Re: SolrCloud - Query performance degrades with multiple servers If that's true, we will fix it for 4.1. I can look closer tomorrow. Mark Sent from my iPhone On Dec 9, 2012, at 2:04 AM, sausarkar [hidden email]/user/SendEmail.jtp?type=nodenode=4025457i=0 wrote: Spoke too early it seems

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-08 Thread sausarkar
with multiple servers Dec 06, 2012; 6:29pm — by Mark Miller-3 On Dec 6, 2012, at 5:08 PM, sausarkar [hidden email] wrote: We solved the issue by explicitly adding numShards=1 argument to the solr start up script. Is this a bug? Sounds like it…perhaps related to SOLR-3971…not sure though. - Mark

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-06 Thread sausarkar
We measured for just 3 nodes the overhead is around 100ms. We also noticed is that CPU spikes to 100% and some queries get blocked, this happens only when cloud has multiple nodes but does not happen on single node. All the nodes has the exact same configuration and JVM setting and hardware

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-06 Thread sausarkar
30-50ms for a 100 machines, each with 10 million docs a few years ago. So…that doesn't help you much…but FYI… - Mark On Dec 5, 2012, at 5:35 PM, sausarkar [hidden email] wrote: We are using SolrCloud and trying to configure it for testing purposes, we are seeing that the average query

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-06 Thread sausarkar
- Query performance degrades with multiple servers Dec 06, 2012; 3:13pm — by sausarkar I also did a test running a load directed to one single server in the cloud and checked the CPU usage of other servers. It seems that even if there are no load directed to those servers there is a CPU spike each

SolrCloud - Query performance degrades with multiple servers

2012-12-05 Thread sausarkar
We are using SolrCloud and trying to configure it for testing purposes, we are seeing that the average query time is increasing if we have more than one node in the SolrCloud cluster. We have a single shard 12 gigs index.Example:1 node, average query time *~28 msec* , load 140 queries/second3

Re: SOLR 4 Alpha - distributed DIH available?

2012-08-21 Thread sausarkar
can someone let me know how to configure DIH in a cloud environment, should it point to one specific server or to the load balancer for distributing dih on all the servers. One problem with the load balancer approach is that there is no good way to tell whether a dih is already running in the

SolrCloud issue - accents are not getting removed

2012-08-17 Thread sausarkar
We noticed that when we use SolrCloud the accents are not getting removed when we use the charFilter class=solr.MappingCharFilterFactory mapping=mapping-ISOLatin1Accent.txt/ filter. We are using the -Dbootstrap_conf=true to load the conf folder. This filter however is working fine in the

Re: SolrCloud issue - accents are not getting removed

2012-08-17 Thread sausarkar
Just found out that this was not an SolrCloud issue but an issue with the Tomcat configuration basically the URIEncoding was missing added it and it fixed the problem. Connector port=8080 protocol=HTTP/1.1 connectionTimeout=2 redirectPort=8443

Solr4.0 BETA - Error when StempelPolishStemFilterFactory

2012-08-16 Thread sausarkar
I just upgrade to Solr 4.0.0-BETA and it seems there is a problem with the StempelPolishStemFilterFactory it cannot find a resource, it seems that the bug was introduced in the new beta release, this works fine in the alpha release. Here is the exception I am seeing in the logs: SEVERE:

RE: Solr4.0 BETA - Error when StempelPolishStemFilterFactory

2012-08-16 Thread sausarkar
No I tried that, Solr is finding and loading all the other contrib jars but only for the Polish one it is complaining, it seems like this is a bug. -- View this message in context:

Re: Solr4.0 BETA - Error when StempelPolishStemFilterFactory

2012-08-16 Thread sausarkar
StempelPolishStemFilterFactory I can reproduce - I agree, this seems like a bug. I've opened an issue: https://issues.apache.org/jira/browse/SOLR-3737 Thanks for reporting! Steve -Original Message- From: sausarkar [mailto:[hidden email]/user/SendEmail.jtp?type=nodenode=4001741i=0] Sent: Thursday, August 16

Re: SOLR 4 Alpha Out Of Mem Err

2012-08-14 Thread sausarkar
Hello Mark, Has this issue been fixed in the BETA release? - Sauvik -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-Alpha-Out-Of-Mem-Err-tp3995033p4001266.html Sent from the Solr - User mailing list archive at Nabble.com.

Solr 4.0 schedule

2012-08-10 Thread sausarkar
anyone has any clue when will the beta version of Solr 4.0 be released also is their any timeframe when the first GA release for Solr4.0? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-4-0-schedule-tp4000561.html Sent from the Solr - User mailing list archive at

SolrCloud - load balancing

2012-08-03 Thread sausarkar
Do anyone know if query using CommonsHttpSolrServer on SolrCloud is automatically load balanced? I am trying to load test using solrmeter on one if the node I am seeing all the nodes seems to be hit. Any clues -- View this message in context:

Re: SolrCloud - load balancing

2012-08-03 Thread sausarkar
actually I noticing that the CommonsHttpSolrServer seems to load balancing by hitting all servers in the cluster, just wanted to confirm if that is the case. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrCloud-load-balancing-tp3999143p3999145.html Sent from the Solr -

Re: SolrCloud - load balancing

2012-08-03 Thread sausarkar
Hi Mark, You are referring to the CloudSolrServer not CommonsHttpSolrServer right? does the CommonsHttpSolrServer also round robin? Do you recommend any tool for load testing SolrCloud? Thanks, Sauvik -- View this message in context:

Re: SOLR 4 Alpha Out Of Mem Err

2012-07-20 Thread sausarkar
Hi Mark, I am am also facing the same issue when trying to index in SolrCloud using DIH running on a non-leader server. The DIH server is creating around 10k threads and then OOM cannot create thread error. Do you know when or which version this issue will be solved. I think a workaround for

SOLR 4 Alpha - distributed DIH available?

2012-07-20 Thread sausarkar
If I try to run DIH on the SolrCloud it can hit any one of the servers and start the import process, but if we try to get the import status from any other server it returns no import is running. Only the server that is running the DIH gives back the correct import status. So if we run DIH behind a