Re: Too many open files with DirectUpdateHandlerOptimizeTest

[Yonik Seeley]

Does it happen on a fresh checkout?
I use windows (and cygwin for the familiar command line interface),
which has higher limits.

Also watch out for the system-wide limit:
http://www.cs.wisc.edu/condor/condorg/linux_scalability.html

If it happens with a fresh checkout, perhaps we could lower the merge
factor for that test.

-Yonik

On Sun, Jul 20, 2008 at 2:59 PM, Shalin Shekhar Mangar
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> The DirectUpdateHandlerOptimizeTest fails on my local box due to too many
> open files. The nightly build does not fail so I'm assuming it must be
> something specific to my setup. Has anyone else seen this problem on their
> local environment?
>
> ulimit -n gives 1024 on my Ubuntu Hardy Heron.
>
> <testcase classname="org.apache.solr.update.DirectUpdateHandlerOptimizeTest"
> name="testOptimize" time="5.687">
>    <error message="java.io.FileNotFoundException:
> /tmp/org.apache.solr.update.DirectUpdateHandlerOptimizeTest-1216580007333/index/_9u.tii
> (Too many open files)"
> type="java.lang.RuntimeException">java.lang.RuntimeException:
> java.io.FileNotFoundException:
> /tmp/org.apache.solr.update.DirectUpdateHandlerOptimizeTest-1216580007333/index/_9u.tii
> (Too many open files)
>        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:806)
>        at
> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:368)
>        at
> org.apache.solr.update.DirectUpdateHandlerOptimizeTest.testOptimize(DirectUpdateHandlerOptimizeTest.java:62)
> Caused by: java.io.FileNotFoundException:
> /tmp/org.apache.solr.update.DirectUpdateHandlerOptimizeTest-1216580007333/index/_9u.tii
> (Too many open files)
>        at java.io.RandomAccessFile.open(Native Method)
>        at java.io.RandomAccessFile.&lt;init&gt;(RandomAccessFile.java:212)
>        at
> org.apache.lucene.store.FSDirectory$FSIndexInput$Descriptor.&lt;init&gt;(FSDirectory.java:539)
>        at
> org.apache.lucene.store.FSDirectory$FSIndexInput.&lt;init&gt;(FSDirectory.java:569)
>        at
> org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:478)
>        at
> org.apache.lucene.index.TermInfosReader.&lt;init&gt;(TermInfosReader.java:80)
>        at
> org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:319)
>        at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:264)
>        at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:199)
>        at
> org.apache.lucene.index.MultiSegmentReader.&lt;init&gt;(MultiSegmentReader.java:55)
>        at
> org.apache.lucene.index.DirectoryIndexReader$1.doBody(DirectoryIndexReader.java:93)
>        at
> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:649)
>        at
> org.apache.lucene.index.DirectoryIndexReader.open(DirectoryIndexReader.java:81)
>        at org.apache.lucene.index.IndexReader.open(IndexReader.java:209)
>        at org.apache.lucene.index.IndexReader.open(IndexReader.java:173)
>        at
> org.apache.solr.search.SolrIndexSearcher.&lt;init&gt;(SolrIndexSearcher.java:93)
>        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:797)
> </error>
>  </testcase>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>