RE: Interesting OutOfMemoryError on a 170M index

2010-01-19 Thread Minutello, Nick
angar [mailto:shalinman...@gmail.com] Sent: 19 January 2010 12:04 To: solr-user@lucene.apache.org Subject: Re: Interesting OutOfMemoryError on a 170M index On Thu, Jan 14, 2010 at 4:04 AM, Minutello, Nick < nick.minute...@credit-suisse.com> wrote: > Agreed, commit every second. > > Assumi

Re: Interesting OutOfMemoryError on a 170M index

2010-01-19 Thread Shalin Shekhar Mangar
On Thu, Jan 14, 2010 at 4:04 AM, Minutello, Nick < nick.minute...@credit-suisse.com> wrote: > Agreed, commit every second. > > Assuming I understand what you're saying correctly: > There shouldn't be any index readers - as at this point, just writing to > the index. > Did I understand correctly wh

RE: Interesting OutOfMemoryError on a 170M index

2010-01-13 Thread Minutello, Nick
@lucene.apache.org Subject: RE: Interesting OutOfMemoryError on a 170M index >> if you are using auto-commit, you should not call commit from the client Cheers, thanks. >> Do you need the index to be updated this often? Wouldn't increasing the autocommit time make it worse? (

RE: Interesting OutOfMemoryError on a 170M index

2010-01-13 Thread Minutello, Nick
it has -Nick -Original Message- From: Ryan McKinley [mailto:ryan...@gmail.com] Sent: 13 January 2010 23:16 To: solr-user@lucene.apache.org Subject: Re: Interesting OutOfMemoryError on a 170M index On Jan 13, 2010, at 5:34 PM, Minutello, Nick wrote: > Agreed, commit every second. Do you

Re: Interesting OutOfMemoryError on a 170M index

2010-01-13 Thread Ryan McKinley
g to the index. Did I understand correctly what you meant? -Nick -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: 13 January 2010 22:28 To: solr-user@lucene.apache.org Subject: Re: Interesting OutOfMemoryError on a 170M index The time in autocommit is in m

RE: Interesting OutOfMemoryError on a 170M index

2010-01-13 Thread Minutello, Nick
com] Sent: 13 January 2010 22:28 To: solr-user@lucene.apache.org Subject: Re: Interesting OutOfMemoryError on a 170M index The time in autocommit is in milliseconds. You are committing every second while indexing. This then causes a build-up of sucessive index readers that absorb each commit

Re: Interesting OutOfMemoryError on a 170M index

2010-01-13 Thread Lance Norskog
The time in autocommit is in milliseconds. You are committing every second while indexing. This then causes a build-up of sucessive index readers that absorb each commit, which is probably the out-of-memory. On Wed, Jan 13, 2010 at 10:36 AM, Minutello, Nick wrote: > > Hi, > > I have a bit of an

Interesting OutOfMemoryError on a 170M index

2010-01-13 Thread Minutello, Nick
Hi, I have a bit of an interesting OutOfMemoryError that I'm trying to figure out. My client & Solr server are running in the same JVM (for deployment simplicity). FWIW, I'm using Jetty to host Solr. I'm using the supplied code for the http-based client interface. Solr 1.3.0. My app is adding a