Interesting question. Bear in mind, that I don't believe we ever run index-all
- we do run filter-media every day, and if Tomcat is left running that will
almost certainly trash the index (any open IndexSearcher when it tries to
recreate the index from scratch will cause the index to be trashed - search and
ingest operations will then fail, although the instance is still alive and will
serve, for example, item requests).
So, we've never really been in a position to see the issues that you are
describing. However, if you take a look at the (unpatched) code for DSQuery,
specifically in the method getSearcher(), you will notice that whenever an
update index is detected, then a new IndexSearcher is opened on it - but any
old IndexSearcher object that might be referenced by the field searcher is
never cleanly shutdown (the close() method is not called).
That means it is up to the garbage collector to come along and clean those
objects up - the timing and indeed success of that isn't ever guaranteed.
There may be other contributing factors to your problems (I haven't looked at
much code beyond the patch I created), but it is a distinct possibility that
this is playing a part.
With the patch that I supplied, even without specifying the new
'search.dir.create' configuration property (only necessary if you suffer the
problems that I describe at the top), the way getSearcher() has been rewritten
means that it will always call close() on an old IndexSearcher before it
discards the reference. So the chances are you will see better resource /
memory behaviour.
G
-----Original Message-----
From: Jose Blanco [mailto:[EMAIL PROTECTED]
Sent: Fri 2/9/2007 9:25 PM
To: Graham Triggs; dspace-tech@lists.sourceforge.net
Subject: RE: [Dspace-tech] Reindexing vs Tomcat running
Graham:
What I've noticed over here is that when indexing is running, say via
index-all, there is an escalating use of memory and our DSpace instance goes
down. In other words, when the routine indexAllItems in DSIndexer gets
called. And this is considering, I have a routine that is suppose to clear
the cache for each item being index that I got from the list. This problem
seems to be more prevalent in 1.4.1 than it was in 1.4 (atually I don't
remember seeing it in 1.4).
So my question to you is, do you think your patch will help me with this,
and have you seen this?
Thanks!
Jose
-----Original Message-----
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of
[EMAIL PROTECTED]
Sent: Thursday, February 08, 2007 5:29 PM
To: dspace-tech@lists.sourceforge.net
Subject: Re: [Dspace-tech] Reindexing vs Tomcat running
Stephane,
I've now submitted a patch for this reindexing issue: #1655583
You can read my notes and download the patch file here:
https://sourceforge.net/tracker/?func=detail&atid=319984&aid=1655583&group_i
d=19984
With the patch applied, you will also need to add a 'search.dir.create'
entry to your dspace.cfg as per the comments.
Let me know if you have any questions.
G
------
Graham Triggs
Technical Architect
Open Repository
+44 (0)20 7631 9942
This email has been scanned by Postini.
For more information please visit http://www.postini.com
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job
easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
This email has been scanned by Postini.
For more information please visit http://www.postini.com
-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier.
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech
