unused tmp fdt files in index

2007-07-09 Thread Harini Raghavan
Hi All, I have a large lucene index of size 60G. We have had Out Of Memory issues a few times in the past due to which the indexing had got interrupted. This has resulted in a lot of .fnm, .fdt,.tmp files which don't get removed even through optimizing the index. We have data for last 90 days in

RE: unused tmp fdt files in index

2007-07-09 Thread Liu_Andy2
To: java-user@lucene.apache.org Subject: unused tmp fdt files in index Hi All, I have a large lucene index of size 60G. We have had Out Of Memory issues a few times in the past due to which the indexing had got interrupted. This has resulted in a lot of .fnm, .fdt,.tmp files which don'

Re: unused tmp fdt files in index

2007-07-10 Thread Harini Raghavan
etable, it is should be safe to delete these files. Please backup your data before testing. Andy -Original Message- From: Harini Raghavan [mailto:[EMAIL PROTECTED] Sent: Tuesday, July 10, 2007 2:29 PM To: java-user@lucene.apache.org Subject: unused tmp fdt files in index Hi All, I have a

Re: unused tmp fdt files in index

2007-07-10 Thread Michael McCandless
What version of Lucene are you using? As of 2.1, Lucene should remove such partially created files immediately on hitting the OOM exception, and if somehow it failed to do that (eg if JVM had crashed or machine running JVM crashed, etc) it should then remove them the next time a writer is created