Re: “Too many open files" error hit when I run my Lucene 3.0.3 application on Java 8

2017-02-22 Thread Uwe Schindler
The garbage collector in Java 8 may have different behavior. This may cause issues if you have buggy code that does not close indexreaders open in parallel to indexing. If it relies on Garbage Collector to close accidentally open files, that won't work anymore on Java 8. The reason for this migh

Re: “Too many open files" error hit when I run my Lucene 3.0.3 application on Java 8

2017-02-22 Thread Torsten Krah
What does lsof tell - which handles are open and which are unexpected or suspicious? Am 22.02.2017 5:27 nachm. schrieb "Leonid Bolshinsky" : > No code changes between running in Java 6 and Java 8. The same code still > runs successfully with Java 6 while is failing with Java 8. > > On Feb 22, 201

Re: “Too many open files" error hit when I run my Lucene 3.0.3 application on Java 8

2017-02-22 Thread Leonid Bolshinsky
No code changes between running in Java 6 and Java 8. The same code still runs successfully with Java 6 while is failing with Java 8. On Feb 22, 2017 5:52 PM, "Frederik Van Hoyweghen" < frederik.vanhoyweg...@chapoo.com> wrote: Did you make any changes to your code between running on java 6 and 8?

Re: “Too many open files" error hit when I run my Lucene 3.0.3 application on Java 8

2017-02-22 Thread Frederik Van Hoyweghen
Did you make any changes to your code between running on java 6 and 8? The java file API has changed considerably since java 8. If you -have- rewritten some of the file handling code in your indexing process, make sure to explicitly close the streams you create, or use the (since java 7) try-wi

“Too many open files" error hit when I run my Lucene 3.0.3 application on Java 8

2017-02-22 Thread Leonid Bolshinsky
I have a search engine based on Lucene 3.0.3 and I can't change the Lucene version for reasons that are out of scope of this question. Now I have a requirement to move from Java 6 to Java 8, however when I run the indexing using Java 8 JVM, I hit "Too many open files issue" as below: java.io.FileN

Re: Too many open files error

2011-03-23 Thread Ian Lea
No. Certainly not for lucene 3.0.3 on linux anyway. As someone has already suggested, run lsof to see which files your process has open. Maybe you aren't closing the source documents. -- Ian. On Wed, Mar 23, 2011 at 10:46 AM, Vo Nhu Tuan wrote: > I have already used compound file and closed

Re: Too many open files error

2011-03-23 Thread Vo Nhu Tuan
I have already used compound file and closed everything I can. Would this line cause problem when called many times? IndexWriter writer = new IndexWriter(FSDirectory.open(indexFile), new StandardAnalyzer(Version.LUCENE_30), true, IndexWriter.MaxFieldLength.LIMITED); This FSDirectory.open() is th

Re: Too many open files error

2011-03-23 Thread Li Li
and also try using compound files (cfs) 2011/3/23 Vo Nhu Tuan : > Hi, > > Can someone help me with this problem please? I got these when running my > program: > > java.io.FileNotFoundException: > /Users/vonhutuan/Documents/workspace/InformationExtractor/index_wordlist/_i82.frq > (Too many open

Re: Too many open files error

2011-03-23 Thread Mindaugas Žakšauskas
Hi, Have a look at this: http://wiki.apache.org/lucene-java/LuceneFAQ#Why_am_I_getting_an_IOException_that_says_.22Too_many_open_files.22.3F m. On Wed, Mar 23, 2011 at 9:48 AM, Vo Nhu Tuan wrote: > Hi, > > Can someone help me with this problem please? I got these when running my > program: >

Re: Too many open files error

2011-03-23 Thread Li Li
use lsof to count the number of opened files ulimit to modify it. maybe u need ask adminstrator to modify limit.conf 2011/3/23 Vo Nhu Tuan : > Hi, > > Can someone help me with this problem please? I got these when running my > program: > > java.io.FileNotFoundException: > /Users/vonhutuan/Docume

Too many open files error

2011-03-23 Thread Vo Nhu Tuan
Hi, Can someone help me with this problem please? I got these when running my program: java.io.FileNotFoundException: /Users/vonhutuan/Documents/workspace/InformationExtractor/index_wordlist/_i82.frq (Too many open files) at java.io.RandomAccessFile.open(Native Method) at java.

Re: Too many open files error using tomcat and lucene

2005-07-20 Thread jian chen
Hi, Dan, I think the problem you mentioned is the one that has been discussed lot of times in this mailing list. Bottomline is that you'd better use the compound file format to store indexes. I am not sure Lucene 1.3 has that available, but, if possible, can you upgrade to lucene 1.4.3? Cheers,

Re: Too many open files error using tomcat and lucene

2005-07-20 Thread Daniel Naber
On Wednesday 20 July 2005 22:49, Dan Pelton wrote: > We are getting the following error in our tomcat error log. > /dsk1/db/lucene/journals/_clr.f7 (Too many open files) > java.io.FileNotFoundException: /dsk1/db/lucene/journals/_clr.f7 (Too > many open files) See http://wiki.apache.org/jakarta-l

Too many open files error using tomcat and lucene

2005-07-20 Thread Dan Pelton
We are getting the following error in our tomcat error log. /dsk1/db/lucene/journals/_clr.f7 (Too many open files) java.io.FileNotFoundException: /dsk1/db/lucene/journals/_clr.f7 (Too many open files) at java.io.RandomAccessFile.open(Native Method) We are using the following lucene-1.3-f