FileNotFoundException

2006-08-01 Thread WATHELET Thomas
When the indexing process still running on a index and I try to search something on this index I retrive this error message: java.io.FileNotFoundException: \\tradluxstmp01\JavaIndex\tra\index_EN\_2hea.fnm (The system cannot find the file specified) How can I solve this.

FileNotFoundException segments

2005-07-07 Thread bib_lucene bib
Hi All can someone please help me on the error in my web application... I am using tomcat , the path for index dir is obtained from jsp page using application.getRealPath("/")+"download/compName" I want to index when the file gets uploaded. I am getting this error... java.io.FileNotFoundEx

Sudden FileNotFoundException

2006-10-04 Thread Hes Siemelink
Hi all I'm having trouble with FileNotFoundException that pops up every once and a while. Everything works fine in my application (description below), but after running for some time (eg. 20 hours) an exception like this one may occur: java.io.FileNotFoundException: /lucene-in

Re: FileNotFoundException

2006-08-01 Thread Michael McCandless
When the indexing process still running on a index and I try to search something on this index I retrive this error message: java.io.FileNotFoundException: \\tradluxstmp01\JavaIndex\tra\index_EN\_2hea.fnm (The system cannot find the file specified) How can I solve this. Could you provide some

RE: FileNotFoundException

2006-08-01 Thread WATHELET Thomas
cher(indexsearcher); Hits hits = this.multisearch.search(this.getBoolQuery()); ... -Original Message- From: Michael McCandless [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 13:45 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException > When the indexin

Re: FileNotFoundException

2006-08-01 Thread Erick Erickson
g: MultiSearcher multisearch = new MultiSearcher(indexsearcher); Hits hits = this.multisearch.search(this.getBoolQuery()); ... -Original Message- From: Michael McCandless [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 13:45 To: java-user@lucene.apache.org Subject: Re: Fil

RE: FileNotFoundException

2006-08-01 Thread WATHELET Thomas
It's the same when I try to open the index with luke -Original Message- From: Erick Erickson [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 15:24 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException two things come to mind 1> are you absolutely sure that you

Re: FileNotFoundException

2006-08-01 Thread Erick Erickson
rick On 8/1/06, WATHELET Thomas <[EMAIL PROTECTED]> wrote: It's the same when I try to open the index with luke -Original Message- From: Erick Erickson [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 15:24 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException two

RE: FileNotFoundException

2006-08-01 Thread WATHELET Thomas
ache.org Subject: Re: FileNotFoundException So it sounds like you're not writing the index to the place you think you are. Have you just looked in the directories and checked that there are files there? If Luke can't find them, they're not where you think they are. Especially if your

Re: FileNotFoundException

2006-08-01 Thread Supriya Kumar Shyamal
erSearcher object with old file list and probably that throws the FileNotFoundExcpetion becuase physically the file is not there. May be I am wrong but I try to put some light on this issue. I posted the similar problem with subject "FileNotFoundException: occurs during the optimization

RE: FileNotFoundException

2006-08-01 Thread WATHELET Thomas
Have you solved thisproblem? -Original Message- From: Supriya Kumar Shyamal [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 16:30 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException I think its a directory access synchronisation problem, I have also posted about this

Re: FileNotFoundException

2006-08-01 Thread Supriya Kumar Shyamal
release. Thanks, supriya WATHELET Thomas wrote: Have you solved thisproblem? -Original Message- From: Supriya Kumar Shyamal [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 16:30 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException I think its a directory access synchron

Re: FileNotFoundException

2006-08-01 Thread Michael McCandless
e have the IndexerSearcher object with old file list and probably that throws the FileNotFoundExcpetion becuase physically the file is not there. May be I am wrong but I try to put some light on this issue. I posted the similar problem with subject "FileNotFoundException: occurs during the optimizati

RE: FileNotFoundException

2006-08-01 Thread WATHELET Thomas
Yes -Original Message- From: Michael McCandless [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 17:10 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException > I think its a directory access synchronisation problem, I have also > posted about this before. The scenar

Re: FileNotFoundException

2006-08-01 Thread Michael McCandless
Yes Yes, you're certain you have the same lock dir for both modifier & search process? Or, Yes you're using NFS as your lock dir? Or, both? Mike - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail

RE: FileNotFoundException

2006-08-01 Thread WATHELET Thomas
Ok if I well understood I have to put the lock file at the same place in my indexing process and searching process. -Original Message- From: Michael McCandless [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 17:14 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException >

Re: FileNotFoundException

2006-08-01 Thread Michael McCandless
Ok if I well understood I have to put the lock file at the same place in my indexing process and searching process. That's correct. And, that place can't be an NFS mounted directory (until we fix locking implementation...). The two different processes will use this lock file to make sure

RE: FileNotFoundException

2006-08-01 Thread WATHELET Thomas
Ok thanks a lot. -Original Message- From: Michael McCandless [mailto:[EMAIL PROTECTED] Sent: 01 August 2006 17:19 To: java-user@lucene.apache.org Subject: Re: FileNotFoundException > Ok if I well understood I have to put the lock file at the same place in > my indexing proce

Re: FileNotFoundException

2006-08-01 Thread Supriya Kumar Shyamal
ically the file is not there. May be I am wrong but I try to put some light on this issue. I posted the similar problem with subject "FileNotFoundException: occurs during the optimization of index", I am also experiencing the similar problem when the index optimization task runs on the i

Re: FileNotFoundException

2006-08-01 Thread Michael McCandless
Yes, I use the nfs mount to share the index for other search instance and all the instances have same lock directory configured, but the only the difference is that nfs mount is read-only mount, so I have to disable the lock mechanism for search instances, only lock is enabled for index modif

Re: FileNotFoundException

2006-08-01 Thread Michael McCandless
For the index process I use IndexModifier class. That happens when I try to search something into the index in the same time that the index process still running. the code for indexing: System.setProperty("org.apache.lucene.lockDir", System .getProperty("user.dir"));

RE: FileNotFoundException

2006-08-02 Thread Trieschnigg, R.B. \(Dolf\)
> Ok if I well understood I have to put the lock file at the > same place in my indexing process and searching process. > the code for indexing: > System.setProperty("org.apache.lucene.lockDir", System >.getProperty("user.dir")); Are you sure that both the search process

Re: FileNotFoundException segments

2005-07-07 Thread Muetze303
probably the dir exists, but the index inside the dir is broken or not complete and you are trying to use it instead of creating a new one?! bib_lucene bib wrote: Hi All can someone please help me on the error in my web application... I am using tomcat , the path for index dir is obtained fr

Re: FileNotFoundException segments

2005-07-07 Thread bib_lucene bib
This is a new directory, created just before this step. I am uploading files to this directory. The file is getting uploaded fine. Any ideas? Muetze303 <[EMAIL PROTECTED]> wrote: probably the dir exists, but the index inside the dir is broken or not complete and you are trying to use it instead o

RE: FileNotFoundException segments

2005-07-07 Thread Jason Polites
om: bib_lucene bib [mailto:[EMAIL PROTECTED] Sent: Friday, 8 July 2005 8:21 AM To: java-user@lucene.apache.org Subject: Re: FileNotFoundException segments This is a new directory, created just before this step. I am uploading files to this directory. The file is getting uploaded fine. Any

Re: FileNotFoundException segments

2005-07-08 Thread Muetze303
Ok, your directory exists. if ((indexFile = new File(indexDir)).exists() && indexFile.isDirectory()) { exists = false; System.out.println("Index does not exist"); } now is exists == false at this point: writer = new IndexWriter(indexFile, new StandardAnalyzer(), exists); exists is still fals

FileNotFoundException on index

2009-10-02 Thread Max Lynch
I'm getting this error when I try to run my searcher and my indexer: Traceback (most recent call last): self.searcher = lucene.IndexSearcher(self.directory) JavaError: java.io.FileNotFoundException: /home/spider/misc/index/_275c.cfs (No such file or directory) I don't know anything about the form

FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Paul J. Lucas
I occasionally get a FileNotFoundException like: Exception in thread "Thread-44" org.apache.lucene.index.MergePolicy $MergeException: java.io.FileNotFoundException: /Stuff/Caches/ AuroraSupport/IM_IndexCache/INDEX/_27.cfs (No such file or dire

FileNotFoundException during indexing

2008-07-31 Thread Wojtek212
ng during indexing but the exception occurs. Does anybody have idea what can be a reason? -- View this message in context: http://www.nabble.com/FileNotFoundException-during-indexing-tp18766343p18766343.html Sent from the Lucene - Java Users mailing list archive at Nabble.com.

Re: Sudden FileNotFoundException

2006-10-04 Thread Karel Tejnora
Once I got same problem and following Jira not alone. I deleted index and rebuild it from source again and problem was gone. Im unable to reproduce it. Are you able to reproduce the problem? Karel java.io.FileNotFoundException: /lucene-indexes/mediafragments/_8km.fnm (No ---

Re: Sudden FileNotFoundException

2006-10-04 Thread Hes Siemelink
It happens from time to time... but I don't know how to reproduce it. Rebuilding this particular index unfortunately takes about 10 hrs, so it's not feasable to delete the index and rebuild it when this happens... our users would be missing a lot of search results then! There are a couple of wor

Re: Sudden FileNotFoundException

2006-10-04 Thread Michael McCandless
Hes Siemelink wrote: It happens from time to time... but I don't know how to reproduce it. Rebuilding this particular index unfortunately takes about 10 hrs, so it's not feasable to delete the index and rebuild it when this happens... our users would be missing a lot of search results then! The

Re: Sudden FileNotFoundException

2006-10-04 Thread Hes Siemelink
Hi Mike, thank you for your detailed reply. I put my answers inline. On 10/4/06, Michael McCandless <[EMAIL PROTECTED]> wrote: Hes Siemelink wrote: > It happens from time to time... but I don't know how to reproduce it. > > Rebuilding this particular index unfortunately takes about 10 hrs, so

Re: Sudden FileNotFoundException

2006-10-04 Thread Michael McCandless
Hes Siemelink wrote: > It happens from time to time... but I don't know how to reproduce it. > > Rebuilding this particular index unfortunately takes about 10 hrs, so it's > not feasable to delete the index and rebuild it when this happens... our > users would be missing a lot of search result

Re: Sudden FileNotFoundException

2006-10-04 Thread Hes Siemelink
One helpful thing to do is call IndexWriter.setInfoStream(...) and save the resulting output. This prints details about which segments were merged, and what the merged segment name is. This might provide some useful details for example was your deleted segments file one that was just merged away

Re: Sudden FileNotFoundException

2006-10-05 Thread Hes Siemelink
Not making much progress, but there is one thing I found curious: very often the file that can not be found is "_8km.fnm". Is it possible to derive any information from this? Cheers, Hes.

Re: Sudden FileNotFoundException

2006-10-05 Thread Michael McCandless
Hes Siemelink wrote: Not making much progress, but there is one thing I found curious: very often the file that can not be found is "_8km.fnm". Is it possible to derive any information from this? Hmmm, that's interesting. Segment numbers are just integers encoded in base 36, ie, using the dig

Re: Sudden FileNotFoundException

2006-10-05 Thread Hes Siemelink
Yes, I use default settings. Cheers, Hes. On 10/5/06, Michael McCandless <[EMAIL PROTECTED]> wrote: Hes Siemelink wrote: > Not making much progress, but there is one thing I found curious: very > often > the file that can not be found is "_8km.fnm". > Is it possible to derive any informatio

FileNotFoundException in recovery

2015-08-04 Thread Markus Heiden
Hi, I sometimes get FileNotFoundExceptions from the recovery of a core in my log. Does anyone know the reason for this? As I understand Solr this may (or should) not happen. Markus 2015-08-04 15:06:07,646|INFO|mpKPXpbUwp|org.apache.solr.update.UpdateLog|Starting to buffer updates. FSUpdateLog{st

FileNotFoundException: Corrupted Index?

2006-03-22 Thread Olivier Jaquemet
Hi all, We are using the last version of lucene (1.9.1), and sometimes we end up with such error when opening one of the index our application uses: java.io.FileNotFoundException: [...]/LuceneIndex/_ 46.fnm (No such file or directory) at java.io.RandomAccessFile.open(Native Method)

FileNotFoundException with version 4.10.4

2019-09-10 Thread Stuart Goldberg
We have been using version 4.10.4 for quite some time and ran into the following issue. Out of the clear blue, one of our clients sees the exception cited below. We see no prior evidence of anything going awry in our log files. This literally seems to occur out of nowhere. Is there any known issu

Re: FileNotFoundException on index

2009-10-08 Thread Bernd Fondermann
Hi Max just a guess: maybe you deleted all *.c source files in that area and unintentionally deleted this index file, too. Bernd On Fri, Oct 2, 2009 at 17:10, Max Lynch wrote: > I'm getting this error when I try to run my searcher and my indexer: > > Traceback (most recent call last): > self.

Re: FileNotFoundException on index

2009-10-08 Thread Max Lynch
Missed your response, thanks Bernd. I don't think that's it, since I haven't been executing any commands like that. The only thing I could think of is corruption. I've got the index backed up in case there is a way to fix it (it won't matter in a week or so since I cull any documents older than

Re: FileNotFoundException on index

2009-10-09 Thread Michael McCandless
You can use o.a.l.index.CheckIndex to fix the index. It will remove references to any segments that are missing or have problems during testing. First run it without -fix to see what problems there are. Then take a backup of the index. Then run it with -fix. The index will lose all docs in thos

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Mark Miller
Paul J. Lucas wrote: I occasionally get a FileNotFoundException like: Exception in thread "Thread-44" org.apache.lucene.index.MergePolicy$MergeException: java.io.FileNotFoundException: /Stuff/Caches/AuroraSupport/IM_IndexCache/INDEX/_27.cfs (No such file or di

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Paul J. Lucas
On May 29, 2008, at 5:18 PM, Mark Miller wrote: It looks to me like you are not sharing an IndexSearcher across threads. My reading of the documentation says that doing so is an optimization only and not a requirement. Are you saying that using multiple IndexSearchers will definitely ca

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Mark Miller
Paul J. Lucas wrote: On May 29, 2008, at 5:18 PM, Mark Miller wrote: It looks to me like you are not sharing an IndexSearcher across threads. My reading of the documentation says that doing so is an optimization only and not a requirement. Are you saying that using multiple IndexSearchers

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Michael Busch
index files...get enough of this going on, and even with the compound file format you can get too many files open and files missing FileNotFound exceptions. I disagree, Mark. An IndexWriter should never hit a FileNotFoundException. If Lucene is being used correctly in Paul's system, i.

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Mark Miller
normally unneeded index files...get enough of this going on, and even with the compound file format you can get too many files open and files missing FileNotFound exceptions. I disagree, Mark. An IndexWriter should never hit a FileNotFoundException. If Lucene is being used correctly in

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Michael McCandless
Paul J. Lucas wrote: if ( IndexReader.isLocked( INDEX ) ) IndexReader.unlock( INDEX ); The isLocked()/unlock() is because sometimes the server process gets killed and leaves teh indexed locked. This makes me a bit nervous. Does this only run on startup of your proces

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Michael McCandless
Michael Busch wrote: Of course it can happen that you run out of available file descriptors when a lot of threads open separate IndexReaders, and then the SegmentMerger could certainly hit IOExceptions, but I don't think a FileNotFoundException would be thrown in such a case. I

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Paul J. Lucas
On May 29, 2008, at 5:57 PM, Mark Miller wrote: Paul J. Lucas wrote: Are you saying that using multiple IndexSearchers will definitely cause the problem I am experiencing and so the suggestion that using a single IndexSearcher for optimaztion only is wrong? Will it definitely cause your p

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Paul J. Lucas
On May 29, 2008, at 6:26 PM, Michael McCandless wrote: Paul J. Lucas wrote: if ( IndexReader.isLocked( INDEX ) ) IndexReader.unlock( INDEX ); The isLocked()/unlock() is because sometimes the server process gets killed and leaves teh indexed locked. This makes me a bit

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Mark Miller
Michael McCandless wrote: Michael Busch wrote: Of course it can happen that you run out of available file descriptors when a lot of threads open separate IndexReaders, and then the SegmentMerger could certainly hit IOExceptions, but I don't think a FileNotFoundException would be thro

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Mark Miller
Forgot to mention...keep trying if you get read past file exception...I get that sometimes too. - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-29 Thread Paul J. Lucas
On May 29, 2008, at 6:35 PM, Michael McCandless wrote: Can you use lsof (or something similar) to see how many files you have? FYI: I personally can't reproduce this; only a coworker can and even then it's sporadic, so it could take a little while. Merging, especially several running at o

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Jamie
Hi Paul, I just noticed the discussion around this. All most all of my customers have/are experiencing the intermittant FileNotFound problem. Our software uses Lucene 2.3.1. I have just upgraded to Lucene 2.3.2 in the hope that this was one of the bugs that was fixed. I would be very inter

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Michael McCandless
Jamie, I'd love to get to the root cause of your exception. Last time we talked (a few weeks back) I saw several possible causes in the source you had posted: http://markmail.org/message/dqovvcwgwof5f7wl Did you test any of the ideas there? You are potentially manually deleting file

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Michael McCandless
Paul J. Lucas wrote: On May 29, 2008, at 6:35 PM, Michael McCandless wrote: Can you use lsof (or something similar) to see how many files you have? FYI: I personally can't reproduce this; only a coworker can and even then it's sporadic, so it could take a little while. If possible, cou

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Michael McCandless
A few more questions, below: Paul J. Lucas wrote: I have a thread than handles the unindexing/reindexing. It gets changed from a BlockingQueue. My unindex code is like: IndexWriter writer = new IndexWriter( INDEX, INDEX_ANALYZER, false ); final Term t = new Term( DIR_FIELD

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Jamie
Hi Michael Thank you. Your suggestions were great and they were implemented (see attached source code), however, unfortunately, I am still getting file not found errors on the automatic merging of indexes. Regards, Jamie Michael McCandless wrote: Jamie, I'd love to get to the root cause

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Jamie
Hi Michael / others The one thing I discovered was that it is quite useful to implement a JVM shutdown hook in your code to prevent the index from getting corrupted when an indexing process dies unexpectantly. For those who don't know about shutdown hook mechanism, you do this by implementin

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Mark Miller
I guess my test index was corrupted some other way...I can not duplicate my results today without breaking things with two lockless Writers first. Oh well. I definitely saw it legitimately while playing with IndexReader.reopen...if I kept enough of the old IndexReaders around long enough I wo

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Michael McCandless
Jamie, The code looks better! You're not forcefully removing the write.lock nor deleting files from the index yourself, anymore, which is good. One thing I spotted is your VolumeIndex.deleteIndex method fails to synchronize on the indexLock. If I understand the code correctly, that mea

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Paul J. Lucas
On May 30, 2008, at 3:05 AM, Michael McCandless wrote: Are you indexing only one document each time you open IndexWriter? Or do you open a single IndexWriter, add all documents for that directory, then close it? The latter. When the exception occurs, do you know how many simultaneous thre

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Mark Miller
Paul J. Lucas wrote: On May 30, 2008, at 3:05 AM, Michael McCandless wrote: Are you indexing only one document each time you open IndexWriter? Or do you open a single IndexWriter, add all documents for that directory, then close it? The latter. When the exception occurs, do you know how ma

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Michael McCandless
Paul, What is your mergeFactor set to? Can you get the exception to happen with infoStream set on the writer, and post that back? Mike Paul J. Lucas wrote: On May 30, 2008, at 3:05 AM, Michael McCandless wrote: Are you indexing only one document each time you open IndexWriter? Or do

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-30 Thread Michael McCandless
Paul, One more question: when you hit that exception, does the offending file in fact not exist (when you list the directory yourself)? And, does the exception keep happening consistently (same file missing) once that happens, or, does the same index work fine the next time you try it (i

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-31 Thread Paul J. Lucas
On May 30, 2008, at 5:59 PM, Michael McCandless wrote: One more question: when you hit that exception, does the offending file in fact not exist (when you list the directory yourself)? Yes, the file does not exist. And, does the exception keep happening consistently (same file missing) onc

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-31 Thread Michael McCandless
OK. What is your mergeFactor? Mike Paul J. Lucas wrote: On May 30, 2008, at 5:59 PM, Michael McCandless wrote: One more question: when you hit that exception, does the offending file in fact not exist (when you list the directory yourself)? Yes, the file does not exist. And, does the e

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-05-31 Thread Michael McCandless
Paul, How often does your process start up? Are you really sure that there can never be two instances of your process running? If/when you gather the infoStream logs running up to this exception, can you also log when IndexReader.unLock is called? Two writers on the same index can defi

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-10 Thread Grant Ingersoll
occurred in the same spot. Thanks, Grant On May 29, 2008, at 7:43 PM, Paul J. Lucas wrote: I occasionally get a FileNotFoundException like: Exception in thread "Thread-44" org.apache.lucene.index.MergePolicy $MergeException: java.io.FileNotFoundException: /Stuff/Caches/ AuroraSuppor

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-10 Thread Michael McCandless
thread running and it may just be a timing thing, but it might be interesting if it consistently occurred in the same spot. Thanks, Grant On May 29, 2008, at 7:43 PM, Paul J. Lucas wrote: I occasionally get a FileNotFoundException like: Exception in thread "Thread-44" org.apache

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-10 Thread Grant Ingersoll
a timing thing, but it might be interesting if it consistently occurred in the same spot. Thanks, Grant On May 29, 2008, at 7:43 PM, Paul J. Lucas wrote: I occasionally get a FileNotFoundException like: Exception in thread "Thread-44" org.apache.lucene.index.MergePolicy $Merge

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-11 Thread Michael McCandless
Grant Ingersoll wrote: Is more than one thread adding documents to the index? I don't believe so, but I am trying to reproduce. I've only seen it once, and don't have a lot of details, other than I noticed it was on a specific file (.fdt) and was wondering if that was a factor or not.

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-11 Thread Grant Ingersoll
On Jun 11, 2008, at 6:00 AM, Michael McCandless wrote: Grant Ingersoll wrote: Is more than one thread adding documents to the index? I don't believe so, but I am trying to reproduce. I've only seen it once, and don't have a lot of details, other than I noticed it was on a specific fil

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-12 Thread Michael McCandless
Hi Grant, My stress test is unable to reproduce this exception, either. I'm adding Wikipedia docs to an index, using a high merge factor, then opening a new writer with low merge factor (5) and calling optimize. This forces concurrent merges to run during the optimize. One more questio

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-12 Thread Grant Ingersoll
On Jun 12, 2008, at 6:39 AM, Michael McCandless wrote: Hi Grant, My stress test is unable to reproduce this exception, either. I'm adding Wikipedia docs to an index, using a high merge factor, then opening a new writer with low merge factor (5) and calling optimize. This forces concur

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-06-30 Thread Paul J. Lucas
Sorry for the radio silence. I changed my code around so that a single IndexReader and IndexSearcher are shared. Since doing that, I've not seen the problem. That being the case, I didn't pursue the issue. I still think there's a bug because the code I had previously, IMHO, should have

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-07-01 Thread Michael McCandless
Hmmm then it sounds possible you were in fact running out of file descriptors. What was your mergeFactor set to? Mike Paul J. Lucas wrote: Sorry for the radio silence. I changed my code around so that a single IndexReader and IndexSearcher are shared. Since doing that, I've not seen

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-07-01 Thread Paul J. Lucas
That really can't be it. I have *one* client connecting to my server. And there isn't a descriptor leak. My mergeFactor is 10. - Paul On Jul 1, 2008, at 1:37 AM, Michael McCandless wrote: Hmmm then it sounds possible you were in fact running out of file descriptors. What was your merg

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-07-01 Thread Mark Miller
Paul J. Lucas wrote: Sorry for the radio silence. I changed my code around so that a single IndexReader and IndexSearcher are shared. Since doing that, I've not seen the problem. That being the case, I didn't pursue the issue. I still think there's a bug because the code I had previously,

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-07-01 Thread Mark Miller
Mark Miller wrote: Paul J. Lucas wrote: Sorry for the radio silence. I changed my code around so that a single IndexReader and IndexSearcher are shared. Since doing that, I've not seen the problem. That being the case, I didn't pursue the issue. I still think there's a bug because the cod

Re: FileNotFoundException in ConcurrentMergeScheduler

2008-07-06 Thread Yajun
using two Writer's simultaneously. >> >> - Mark > P.S. > > Dont switch back to not sharing! Even your one client must enjoy not > having to wait for that new Searcher to load up on every search :) > Especially if you have any sort caches. > > - Mark > > ---

Re: FileNotFoundException during indexing

2008-07-31 Thread Michael McCandless
during indexing but the exception occurs. Does anybody have idea what can be a reason? -- View this message in context: http://www.nabble.com/FileNotFoundException-during-indexing-tp18766343p18766343.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. ---

Re: FileNotFoundException during indexing

2008-08-01 Thread Wojtek212
its work. Does IndexWriter executes some threads and doesn't wait when they are finished? It's the only one situation I can imagine that there 2 IndexWriters... -- View this message in context: http://www.nabble.com/FileNotFoundException-during-indexing-tp18766343p18769652.html Sent fro

Re: FileNotFoundException during indexing

2008-08-01 Thread Michael McCandless
Wojtek212 wrote: Hi Mike, I'm sharing one instance of IndexManager across all threads and as I've noticed only this one is used during indexing. OK, maybe triple check this -- because that's the only way in your code I can see 2 IWs being live at once. I'm unlocking before every inde

Re: FileNotFoundException during indexing

2008-08-01 Thread Michael McCandless
ished? It's the only one situation I can imagine that there 2 IndexWriters... -- View this message in context: http://www.nabble.com/FileNotFoundException-during-indexing-tp18766343p18769652.html Sent from the Lucene - Java Users mailing l

Re: FileNotFoundException during indexing

2008-08-01 Thread Wojtek212
y I assume that there are not 2 indexers writing at the same time? Mike, what do you think? Above test was made on lucene 2.3.2. -- View this message in context: http://www.nabble.com/FileNotFoundException-during-indexing-tp18766343p18772749.html Sent from the Lucene - Java

Re: FileNotFoundException during indexing

2008-08-01 Thread Michael McCandless
ex.ConcurrentMergeScheduler $MergeThread.run(ConcurrentMergeScheduler.java:240) So if the LockObtainFailedException doesn't occur may I assume that there are not 2 indexers writing at the same time? Mike, what do you think? Above test was made on lucene 2.3.2. -- View this message in context:

Re: FileNotFoundException during indexing

2008-08-01 Thread Wojtek212
x27;t see the reason of such behaviour... -- View this message in context: http://www.nabble.com/FileNotFoundException-during-indexing-tp18766343p18773824.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. ---

Re: FileNotFoundException during indexing

2008-08-01 Thread Wojtek212
.get(SegmentReader.java:205) at org.apache.lucene.index.IndexWriter.applyDeletes(IndexWriter.java:3441) at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2638) at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2523) at org.apache.

Re: FileNotFoundException during indexing

2008-08-01 Thread Michael McCandless
pache.lucene.index.SegmentReader.get(SegmentReader.java:262) at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:205) at org.apache.lucene.index.IndexWriter.applyDeletes(IndexWriter.java: 3441) at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2638) at

Re: FileNotFoundException during indexing

2008-08-03 Thread Wojtek212
ing wrking IndexWriter? Or should these operations be synchronized? -- View this message in context: http://www.nabble.com/FileNotFoundException-during-indexing-tp18766343p18796641.html Sent from the Lucene - Java Users mailing list archive at

Re: FileNotFoundException during indexing

2008-08-03 Thread Michael McCandless
Wojtek212 wrote: You were right I had 2 IndexWriters. I've checked again and it turned out I had 2 IndexManagers loaded by 2 different classloaders, so even if stored it in static Map, it didn't help. Phew! That's tricky (two different classloaders). Good sleuthing Anyway thanks for

Re: FileNotFoundException on index

2009-12-08 Thread Max Lynch
Hi Mike, Missed your response on this, What I was doing was physically removing index/write.lock if older than 8 hours, allowing another process of my indexer to run. I realize in hindsight that there is no reason why I should be doing this and it was really stupid. I think I was under the impre

Re: FileNotFoundException on index

2009-12-09 Thread Michael McCandless
OK thanks for bringing closure! Accidentally allowing 2 writers to write to the same index quickly leads to corruption. They are like the Betta fish: they fight to the death, removing each others files, if you put them in the same cage. Mike On Wed, Dec 9, 2009 at 1:56 AM, Max Lynch wrote: > H

Help - FileNotFoundException during IndexWriter.init()

2007-03-31 Thread Antony Bowesman
I got the following exception this morning when running one last test on a data set that has been indexed many times before over the past few months. java.io.FileNotFoundException: D:\72ed1\server\Java\Search\0008\index\0001\segments_gq9 (Access is denied) at java.io.RandomAcce

FileNotFoundException while indexing data

2005-11-14 Thread amolb
Hi everybody, I am trying to index arround 10 lacs user records, but my indexing application is failing with following exception after around 5 lacs user records. If I rerun it fails to the same record. I tried to skip the record, but that does not help. I tried to get help from google, but few

Re: FileNotFoundException: Corrupted Index?

2006-03-22 Thread Otis Gospodnetic
o somebody else can put it there. Otis - Original Message From: Olivier Jaquemet <[EMAIL PROTECTED]> To: Lucene Java User ML Sent: Wednesday, March 22, 2006 10:08:28 AM Subject: FileNotFoundException: Corrupted Index? Hi all, We are using the last version of lucene (1.9.1), and som

  1   2   >