Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure
On Fri, Apr 22, 2011 at 2:44 PM, Robert Muir rcm...@gmail.com wrote: On Fri, Apr 22, 2011 at 8:41 AM, Thomas Matthijs thomas.matth...@actonomy.com wrote: On Fri, Apr 22, 2011 at 14:15, Uwe Schindler u...@thetaphi.de wrote: Hi Simon, I had no success to change anything. As root I can at least call ulimit -n, but the limit does not raise. Lowering is easily possible: [root@lucene ~]# ulimit -n 32768 Probably kernel level enforced max, try raising it with sysctl, i think there are options named kern.maxfilesperproc or kern.maxfiles you can list them with # sysctl -a Are you sure we should do this? I've had this discussion with mikemccand before, the concern is that if we have too many open files this is definitely a realistic problem (it comes up on the userlist quite often). -- open files (-n) 11095 thats quite a ok setting though... the problem I see here is that there are some tests around that could produce tons of files due to some settings like maxBufferedDocs = 2 if then no merge policy is used we getting pretty close to those limits. The problems on the userlist are coming up since ever not sure what to do here then.. simon - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure
hey folks, this seems to happen more often in the near past... can we raise the limit for jenkins so we don't get these failures again. Once we land DWPT this is likely to happen even more often since we are writing more / smaller segments with DWPT. Uwe do you have karma to fix that? simon On Fri, Apr 22, 2011 at 4:38 AM, Apache Jenkins Server hud...@hudson.apache.org wrote: Build: https://builds.apache.org/hudson/job/Lucene-trunk/1537/ 21 tests failed. REGRESSION: org.apache.lucene.index.TestNRTThreads.testNRTThreads Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:69) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:90) at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:91) at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:78) at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:374) at org.apache.lucene.store.Directory.openInput(Directory.java:122) at org.apache.lucene.index.TermVectorsReader.init(TermVectorsReader.java:83) at org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(SegmentReader.java:236) at org.apache.lucene.index.SegmentReader.openDocStores(SegmentReader.java:515) at org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:611) at org.apache.lucene.index.IndexWriter$ReaderPool.getReadOnlyClone(IndexWriter.java:560) at org.apache.lucene.index.DirectoryReader.init(DirectoryReader.java:172) at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:360) at org.apache.lucene.index.DirectoryReader.doReopenFromWriter(DirectoryReader.java:419) at org.apache.lucene.index.DirectoryReader.doReopen(DirectoryReader.java:432) at org.apache.lucene.index.DirectoryReader.reopen(DirectoryReader.java:392) at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.java:213) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160) REGRESSION: org.apache.lucene.index.TestOmitNorms.testOmitNormsCombos Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.FSDirectory$FSIndexOutput.init(FSDirectory.java:448) at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:312) at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:348) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPostingsWriterImpl.java:139) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPostingsWriterImpl.java:106) at org.apache.lucene.index.codecs.mockintblock.MockFixedIntBlockCodec.fieldsConsumer(MockFixedIntBlockCodec.java:114) at org.apache.lucene.index.PerFieldCodecWrapper$FieldsWriter.init(PerFieldCodecWrapper.java:64) at org.apache.lucene.index.PerFieldCodecWrapper.fieldsConsumer(PerFieldCodecWrapper.java:54) at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:78) at org.apache.lucene.index.TermsHash.flush(TermsHash.java:103) at org.apache.lucene.index.DocInverter.flush(DocInverter.java:65) at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:55) at org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:567) at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2497) at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2462) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1211) at
RE: [HUDSON] Lucene-trunk - Build # 1537 - Failure
I will look into it ASAP. I am not sure what limitation there currently are, but I have root access to the VM itsself. Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Simon Willnauer [mailto:simon.willna...@googlemail.com] Sent: Friday, April 22, 2011 9:55 AM To: dev@lucene.apache.org Subject: Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure hey folks, this seems to happen more often in the near past... can we raise the limit for jenkins so we don't get these failures again. Once we land DWPT this is likely to happen even more often since we are writing more / smaller segments with DWPT. Uwe do you have karma to fix that? simon On Fri, Apr 22, 2011 at 4:38 AM, Apache Jenkins Server hud...@hudson.apache.org wrote: Build: https://builds.apache.org/hudson/job/Lucene-trunk/1537/ 21 tests failed. REGRESSION: org.apache.lucene.index.TestNRTThreads.testNRTThreads Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descripto r.init(SimpleFSDirectory.java:69) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(Si mpleFSDirectory.java:90) at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDir ectory.java:91) at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:7 8) at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectory Wr apper.java:374) at org.apache.lucene.store.Directory.openInput(Directory.java:122) at org.apache.lucene.index.TermVectorsReader.init(TermVectorsReader.jav a:83) at org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(Seg men tReader.java:236) at org.apache.lucene.index.SegmentReader.openDocStores(SegmentReader.j ava :515) at org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:61 1) at org.apache.lucene.index.IndexWriter$ReaderPool.getReadOnlyClone(Index W riter.java:560) at org.apache.lucene.index.DirectoryReader.init(DirectoryReader.java:17 2) at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:360) at org.apache.lucene.index.DirectoryReader.doReopenFromWriter(DirectoryR e ader.java:419) at org.apache.lucene.index.DirectoryReader.doReopen(DirectoryReader.java: 432) at org.apache.lucene.index.DirectoryReader.reopen(DirectoryReader.java:39 2) at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.j ava:213) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(Lu ceneTestCase.java:1232) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(Lu ceneTestCase.java:1160) REGRESSION: org.apache.lucene.index.TestOmitNorms.testOmitNormsCom bos Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.FSDirectory$FSIndexOutput.init(FSDirectory.j ava:448) at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:312) at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirecto r yWrapper.java:348) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPos tingsWriterImpl.java:139) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPos tingsWriterImpl.java:106) at org.apache.lucene.index.codecs.mockintblock.MockFixedIntBlockCodec.fie ldsConsumer(MockFixedIntBlockCodec.java:114) at org.apache.lucene.index.PerFieldCodecWrapper$FieldsWriter.init(PerFi eldCodecWrapper.java:64) at org.apache.lucene.index.PerFieldCodecWrapper.fieldsConsumer(PerFieldCo decWrapper.java:54) at org.apache.lucene.index.FreqProxTermsWriter.flush
Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure
On Fri, Apr 22, 2011 at 12:20 PM, Uwe Schindler u...@thetaphi.de wrote: I will look into it ASAP. I am not sure what limitation there currently are, but I have root access to the VM itsself. cool thanks uwe! simon Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Simon Willnauer [mailto:simon.willna...@googlemail.com] Sent: Friday, April 22, 2011 9:55 AM To: dev@lucene.apache.org Subject: Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure hey folks, this seems to happen more often in the near past... can we raise the limit for jenkins so we don't get these failures again. Once we land DWPT this is likely to happen even more often since we are writing more / smaller segments with DWPT. Uwe do you have karma to fix that? simon On Fri, Apr 22, 2011 at 4:38 AM, Apache Jenkins Server hud...@hudson.apache.org wrote: Build: https://builds.apache.org/hudson/job/Lucene-trunk/1537/ 21 tests failed. REGRESSION: org.apache.lucene.index.TestNRTThreads.testNRTThreads Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descripto r.init(SimpleFSDirectory.java:69) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(Si mpleFSDirectory.java:90) at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDir ectory.java:91) at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:7 8) at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectory Wr apper.java:374) at org.apache.lucene.store.Directory.openInput(Directory.java:122) at org.apache.lucene.index.TermVectorsReader.init(TermVectorsReader.jav a:83) at org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(Seg men tReader.java:236) at org.apache.lucene.index.SegmentReader.openDocStores(SegmentReader.j ava :515) at org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:61 1) at org.apache.lucene.index.IndexWriter$ReaderPool.getReadOnlyClone(Index W riter.java:560) at org.apache.lucene.index.DirectoryReader.init(DirectoryReader.java:17 2) at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:360) at org.apache.lucene.index.DirectoryReader.doReopenFromWriter(DirectoryR e ader.java:419) at org.apache.lucene.index.DirectoryReader.doReopen(DirectoryReader.java: 432) at org.apache.lucene.index.DirectoryReader.reopen(DirectoryReader.java:39 2) at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.j ava:213) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(Lu ceneTestCase.java:1232) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(Lu ceneTestCase.java:1160) REGRESSION: org.apache.lucene.index.TestOmitNorms.testOmitNormsCom bos Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.FSDirectory$FSIndexOutput.init(FSDirectory.j ava:448) at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:312) at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirecto r yWrapper.java:348) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPos tingsWriterImpl.java:139) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPos tingsWriterImpl.java:106) at org.apache.lucene.index.codecs.mockintblock.MockFixedIntBlockCodec.fie ldsConsumer(MockFixedIntBlockCodec.java:114) at org.apache.lucene.index.PerFieldCodecWrapper$FieldsWriter.init(PerFi eldCodecWrapper.java:64
RE: [HUDSON] Lucene-trunk - Build # 1537 - Failure
Hi Simon, I had no success to change anything. As root I can at least call ulimit -n, but the limit does not raise. Lowering is easily possible: [root@lucene ~]# ulimit -n 32768 [root@lucene ~]# ulimit -a socket buffer size (bytes, -b) unlimited core file size (blocks, -c) unlimited data seg size (kbytes, -d) 33554432 file size (blocks, -f) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 11095 pipe size(512 bytes, -p) 1 stack size (kbytes, -s) 524288 cpu time (seconds, -t) unlimited max user processes (-u) 5547 virtual memory (kbytes, -v) unlimited swap size (kbytes, -w) unlimited The same was before the ulimit and the value 11095 is also the default for users after login (same for Jenkins). I think we have to ask Infra. - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Simon Willnauer [mailto:simon.willna...@googlemail.com] Sent: Friday, April 22, 2011 1:18 PM To: Uwe Schindler Cc: dev@lucene.apache.org Subject: Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure On Fri, Apr 22, 2011 at 12:20 PM, Uwe Schindler u...@thetaphi.de wrote: I will look into it ASAP. I am not sure what limitation there currently are, but I have root access to the VM itsself. cool thanks uwe! simon Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de -Original Message- From: Simon Willnauer [mailto:simon.willna...@googlemail.com] Sent: Friday, April 22, 2011 9:55 AM To: dev@lucene.apache.org Subject: Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure hey folks, this seems to happen more often in the near past... can we raise the limit for jenkins so we don't get these failures again. Once we land DWPT this is likely to happen even more often since we are writing more / smaller segments with DWPT. Uwe do you have karma to fix that? simon On Fri, Apr 22, 2011 at 4:38 AM, Apache Jenkins Server hud...@hudson.apache.org wrote: Build: https://builds.apache.org/hudson/job/Lucene-trunk/1537/ 21 tests failed. REGRESSION: org.apache.lucene.index.TestNRTThreads.testNRTThreads Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene- trunk/checkout/lucene/b uild/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descri pto r.init(SimpleFSDirectory.java:69) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init (Si mpleFSDirectory.java:90) at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFS Dir ectory.java:91) at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.jav a:7 8) at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectory Wr apper.java:374) at org.apache.lucene.store.Directory.openInput(Directory.java:122) at org.apache.lucene.index.TermVectorsReader.init(TermVectorsReader.ja v a:83) at org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(Seg men tReader.java:236) at org.apache.lucene.index.SegmentReader.openDocStores(SegmentReader.j ava :515) at org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java :61 1) at org.apache.lucene.index.IndexWriter$ReaderPool.getReadOnlyClone(Index W riter.java:560) at org.apache.lucene.index.DirectoryReader.init(DirectoryReader.java :17 2) at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:360) at org.apache.lucene.index.DirectoryReader.doReopenFromWriter(DirectoryR e ader.java:419) at org.apache.lucene.index.DirectoryReader.doReopen(DirectoryReader.java: 432) at org.apache.lucene.index.DirectoryReader.reopen(DirectoryReader.java :39 2) at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads. j ava:213) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(L u ceneTestCase.java:1232) at org.apache.lucene.util.LuceneTestCase
Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure
On Fri, Apr 22, 2011 at 14:15, Uwe Schindler u...@thetaphi.de wrote: Hi Simon, I had no success to change anything. As root I can at least call ulimit -n, but the limit does not raise. Lowering is easily possible: [root@lucene ~]# ulimit -n 32768 Probably kernel level enforced max, try raising it with sysctl, i think there are options named kern.maxfilesperproc or kern.maxfiles you can list them with # sysctl -a
RE: [HUDSON] Lucene-trunk - Build # 1537 - Failure
Hi Thomas, This is a FreeBSD Jail, it has this sysctl setting, but jails are not allowed to change it (Operation not permitted). Uwe - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de/ http://www.thetaphi.de eMail: u...@thetaphi.de From: acton...@selckin.be [mailto:acton...@selckin.be] On Behalf Of Thomas Matthijs Sent: Friday, April 22, 2011 2:41 PM To: dev@lucene.apache.org Subject: Re: [HUDSON] Lucene-trunk - Build # 1537 - Failure On Fri, Apr 22, 2011 at 14:15, Uwe Schindler u...@thetaphi.de wrote: Hi Simon, I had no success to change anything. As root I can at least call ulimit -n, but the limit does not raise. Lowering is easily possible: [root@lucene ~]# ulimit -n 32768 Probably kernel level enforced max, try raising it with sysctl, i think there are options named kern.maxfilesperproc or kern.maxfiles you can list them with # sysctl -a
[HUDSON] Lucene-trunk - Build # 1537 - Failure
Build: https://builds.apache.org/hudson/job/Lucene-trunk/1537/ 21 tests failed. REGRESSION: org.apache.lucene.index.TestNRTThreads.testNRTThreads Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/nrtopenfiles.4311211294863747903/_bx.tvd (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput$Descriptor.init(SimpleFSDirectory.java:69) at org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexInput.init(SimpleFSDirectory.java:90) at org.apache.lucene.store.NIOFSDirectory$NIOFSIndexInput.init(NIOFSDirectory.java:91) at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:78) at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:345) at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:374) at org.apache.lucene.store.Directory.openInput(Directory.java:122) at org.apache.lucene.index.TermVectorsReader.init(TermVectorsReader.java:83) at org.apache.lucene.index.SegmentReader$CoreReaders.openDocStores(SegmentReader.java:236) at org.apache.lucene.index.SegmentReader.openDocStores(SegmentReader.java:515) at org.apache.lucene.index.IndexWriter$ReaderPool.get(IndexWriter.java:611) at org.apache.lucene.index.IndexWriter$ReaderPool.getReadOnlyClone(IndexWriter.java:560) at org.apache.lucene.index.DirectoryReader.init(DirectoryReader.java:172) at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:360) at org.apache.lucene.index.DirectoryReader.doReopenFromWriter(DirectoryReader.java:419) at org.apache.lucene.index.DirectoryReader.doReopen(DirectoryReader.java:432) at org.apache.lucene.index.DirectoryReader.reopen(DirectoryReader.java:392) at org.apache.lucene.index.TestNRTThreads.testNRTThreads(TestNRTThreads.java:213) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1160) REGRESSION: org.apache.lucene.index.TestOmitNorms.testOmitNormsCombos Error Message: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) Stack Trace: java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene-trunk/checkout/lucene/build/test/1/test8730544420518378026tmp/_i_0.skp (Too many open files in system) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.init(RandomAccessFile.java:233) at org.apache.lucene.store.FSDirectory$FSIndexOutput.init(FSDirectory.java:448) at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:312) at org.apache.lucene.store.MockDirectoryWrapper.createOutput(MockDirectoryWrapper.java:348) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPostingsWriterImpl.java:139) at org.apache.lucene.index.codecs.sep.SepPostingsWriterImpl.init(SepPostingsWriterImpl.java:106) at org.apache.lucene.index.codecs.mockintblock.MockFixedIntBlockCodec.fieldsConsumer(MockFixedIntBlockCodec.java:114) at org.apache.lucene.index.PerFieldCodecWrapper$FieldsWriter.init(PerFieldCodecWrapper.java:64) at org.apache.lucene.index.PerFieldCodecWrapper.fieldsConsumer(PerFieldCodecWrapper.java:54) at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:78) at org.apache.lucene.index.TermsHash.flush(TermsHash.java:103) at org.apache.lucene.index.DocInverter.flush(DocInverter.java:65) at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:55) at org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:567) at org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:2497) at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:2462) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1211) at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1180) at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:101) at org.apache.lucene.index.TestOmitNorms.getNorms(TestOmitNorms.java:285) at org.apache.lucene.index.TestOmitNorms.testOmitNormsCombos(TestOmitNorms.java:244) at org.apache.lucene.util.LuceneTestCase$LuceneTestCaseRunner.runChild(LuceneTestCase.java:1232) at
