very slow add/commit time

2009-11-03 Thread Marc Des Garets
Hi, I am experiencing a problem with an index of about 80 millions documents (41Gb). I am trying to update documents in this index using Solrj. When I do: solrServer.add(docs); //docs is a List that contains 1000 SolrInputDocument (takes 36sec) solrServer.commit(false,false); //either ne

RE: very slow add/commit time

2009-11-03 Thread Marc Des Garets
Subject: Re: very slow add/commit time How many MB have you set of cache on your solrconfig.xml? On Tue, Nov 3, 2009 at 12:24 PM, Marc Des Garets wrote: > Hi, > > > > I am experiencing a problem with an index of about 80 millions documents > (41Gb). I am trying to update docum

update solr index

2010-01-11 Thread Marc Des Garets
Hi, I am running solr in tomcat and I have about 35 indexes (between 2 and 80 millions documents each). Currently if I try to update few documents from an index (let's say the one which contains 80 millions documents) while tomcat is running and therefore receiving requests, I am getting few very

RE: update solr index

2010-01-12 Thread Marc Des Garets
ekhar Mangar [mailto:shalinman...@gmail.com] Sent: 12 January 2010 07:49 To: solr-user@lucene.apache.org Subject: Re: update solr index On Mon, Jan 11, 2010 at 7:42 PM, Marc Des Garets wrote: > > I am running solr in tomcat and I have about 35 indexes (between 2 and > 80 millions documents

RE: Problem comitting on 40GB index

2010-01-13 Thread Marc Des Garets
Just curious, have you checked if the hanging you are experiencing is not garbage collection related? -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 13 January 2010 13:33 To: solr-user@lucene.apache.org Subject: Re: Problem comitting on 40GB index That's

question about mergeFactor

2010-03-08 Thread Marc Des Garets
Hello, On the solr wiki, here: http://wiki.apache.org/solr/SolrPerformanceFactors It is written: mergeFactor Tradeoffs High value merge factor (e.g., 25): Pro: Generally improves indexing speed Con: Less frequent merges, resulting in a collection with more index files which may slow

RE: question about mergeFactor

2010-03-08 Thread Marc Des Garets
Perfect. Thank you for your help. -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: 08 March 2010 12:57 To: solr-user@lucene.apache.org Subject: Re: question about mergeFactor On Mon, Mar 8, 2010 at 5:31 PM, Marc Des Garets wrote: > > If I

HTTP Status 500 - null java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:249)

2010-03-18 Thread Marc Des Garets
Hi, I am doing a really simple query on my index (it's running in tomcat): http://host:8080/solr_er_07_09/select/?q=hash_id:123456 I am getting the following exception: HTTP Status 500 - null java.lang.IllegalArgumentException at java.nio.Buffer.limit(Buffer.java:249) at org.apache.lucene

question about StandardAnalyzer, differences between solr 1.4 and solr 3.3

2011-09-09 Thread Marc Des Garets
Hi, I have a simple field defined like this: Which I use here: In solr 1.4, I could do: ?q=(middlename:a*) And I was getting all documents where middlename = A or where middlename starts by the letter A. In solr 3.3, I get only results where middlename starts by the lette

RE: question about StandardAnalyzer, differences between solr 1.4 and solr 3.3

2011-09-09 Thread Marc Des Garets
specify the individual components directly, e.g. to get the equivalent of StandardAnalyzer, but without the StopFilter: Steve > -Original Message- > From: Marc Des Garets [mailto:marc.desgar...@192.com] > Sent: Friday, September 09, 2011 6:21 AM > To: sol