The solution for MacOSX with the TCSH SHell, is to type the following, before starting TomCat using the same Shell:
limit descriptors 2048
whether the number actually needs to be that big, I do not know, but it worked ;)
regards Jeremy
On Monday, Nov 4, 2002, at 10:25 Europe/London, Peter Neumcke wrote:
Hi Jeremy,
we had this problem too (on Linux)- solved it by setting the maximum number
of open file descriptors to 2048:
ulimit -n 2048
-----Ursprungliche Nachricht----- Von: Jeremy Quinn [mailto:jeremy@;media.demon.co.uk] Gesendet: Montag, 4. November 2002 11:06 An: [EMAIL PROTECTED] Betreff: Re: Lucene ProblemsOn Sunday, Nov 3, 2002, at 20:34 Europe/London, Bernhard Huber wrote:hi,Many thanks for your reply, Bernhard.IOException in index()This causes the index to be incomplete, and causes furtherproblemswhen you try to search using the index. If I use the Lucene Samples in Cocoon, and index my Cocoon documentation, I always get this error.Hm, i once got this kind of error, too, but i can't remember exactly how i did solve it, perhaps you must set the mergefactor of lucene differently. As much as i remember lucene has some options about howmany files arekept opened in case of indexing, it later merges the indexes files, ....Ah Ha! I was beginning to think it was some weakness of MacOSX JVM (or maybe it still is ....). Have you any idea where this is configured?Before I started to have the indexing failures, I had another problem, this time much more difficult to replicate. About every 10 searches, I would get a "Bad Resource" error from LuceneGenerator. A simple reload of the page would give methe searchhits I expected. Can anyone think of a Cocoon cause for these problems, orshould Iget onto the Lucene team about them?Do you have anymore detailed exception stack traces?I do for the indexing, but not for the intermittent fault, which has not happened again since the indexing started failing. Here is the indexing exception report: Cocoon 2 - Internal server error type fatal message IOException in index() description org.apache.cocoon.ProcessingException: IOException in index(): java.io.FileNotFoundException: /Users/jermq/Library/TomCat/work/Standalone/localhost/cocoon/cocoon- files/index/_1d.f30 (Too many open files) sender org.apache.cocoon.servlet.CocoonServlet source Cocoon servlet stack-trace org.apache.cocoon.ProcessingException: IOException in index(): java.io.FileNotFoundException: /Users/jermq/Library/TomCat/work/Standalone/localhost/cocoon/cocoon- files/index/_1d.f30 (Too many open files) at org.apache.cocoon.components.search.SimpleLuceneCocoonIndexerI mpl.index( SimpleLuceneCocoonIndexerImpl.java:261) at org.apache.cocoon.www.samples.search.create_index_xsp.createIndex(/ Users/jermq/Library/TomCat/work/Standalone/localhost/cocoon/cocoon- files/org/apache/cocoon/www/samples/search/create_index_xsp.java:106) at org.apache.cocoon.www.samples.search.create_index_xsp.generate (/Users/ jermq/Library/TomCat/work/Standalone/localhost/cocoon/cocoon-f iles/org/ apache/cocoon/www/samples/search/create_index_xsp.java:190) at org.apache.cocoon.generation.ServerPagesGenerator.generate(Ser verPagesGe nerator.java:269) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeli ne.process XMLPipeline(AbstractProcessingPipeline.java:512) at org.apache.cocoon.components.pipeline.impl.AbstractCachingProc essingPipe line.processXMLPipeline(AbstractCachingProcessingPipeline.java:204) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeli ne.process (AbstractProcessingPipeline.java:483) at org.apache.cocoon.components.treeprocessor.sitemap.SerializeNo de.invoke( SerializeNode.java:149) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:85) at org.apache.cocoon.components.treeprocessor.sitemap.PreparableM atchNode.i nvoke(PreparableMatchNode.java:166) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNod e.invoke(P ipelineNode.java:153) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNo de.invoke( PipelinesNode.java:143) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:326) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:308) at org.apache.cocoon.components.treeprocessor.sitemap.MountNode.i nvoke(Moun tNode.java:131) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:85) at org.apache.cocoon.components.treeprocessor.sitemap.PreparableM atchNode.i nvoke(PreparableMatchNode.java:166) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNod e.invoke(P ipelineNode.java:153) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNo de.invoke( PipelinesNode.java:143) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:326) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:308) at org.apache.cocoon.components.treeprocessor.sitemap.MountNode.i nvoke(Moun tNode.java:131) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:85) at org.apache.cocoon.components.treeprocessor.sitemap.PreparableM atchNode.i nvoke(PreparableMatchNode.java:166) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNod e.invoke(P ipelineNode.java:153) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNo de.invoke( PipelinesNode.java:143) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:326) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:308) at org.apache.cocoon.Cocoon.process(Cocoon.java:595) at org.apache.cocoon.servlet.CocoonServlet.service(CocoonServlet. java:1069) at javax.servlet.http.HttpServlet.service(HttpServlet.java:853) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilt er(Applica tionFilterChain.java:247) at org.apache.catalina.core.ApplicationFilterChain.doFilter(Appli cationFilt erChain.java:193) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardW rapperValv e.java:260) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.catalina.core.StandardContextValve.invoke(StandardC ontextValv e.java:191) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.catalina.core.StandardContext.invoke(StandardContex t.java:239 6) at org.apache.catalina.core.StandardHostValve.invoke(StandardHost Valve.java :180) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDi spatcherVa lve.java:170) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:641) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReport Valve.java :172) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:641) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEn gineValve. java:174) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter. java:223) at org.apache.coyote.http11.Http11Processor.process(Http11Process or.java:40 5) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandle r.processC onnection(Http11Protocol.java:380) at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoi nt.java:50 8) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run( ThreadPool .java:533) at java.lang.Thread.run(Thread.java:491) java.io.FileNotFoundException: /Users/jermq/Library/TomCat/work/Standalone/localhost/cocoon/cocoon- files/index/_1d.f30 (Too many open files) at java.io.RandomAccessFile.open(Native Method) at java.io.RandomAccessFile.(RandomAccessFile.java:93) at java.io.RandomAccessFile.(RandomAccessFile.java:138) at org.apache.lucene.store.FSInputStream$Descriptor.(Unknown Source) at org.apache.lucene.store.FSInputStream.(Unknown Source) at org.apache.lucene.store.FSDirectory.openFile(Unknown Source) at org.apache.lucene.index.SegmentReader.openNorms(Unknown Source) at org.apache.lucene.index.SegmentReader.(Unknown Source) at org.apache.lucene.index.IndexWriter.mergeSegments(Unknown Source) at org.apache.lucene.index.IndexWriter.optimize(Unknown Source) at org.apache.cocoon.components.search.SimpleLuceneCocoonIndexerI mpl.index( SimpleLuceneCocoonIndexerImpl.java:259) at org.apache.cocoon.www.samples.search.create_index_xsp.createIndex(/ Users/jermq/Library/TomCat/work/Standalone/localhost/cocoon/cocoon- files/org/apache/cocoon/www/samples/search/create_index_xsp.java:106) at org.apache.cocoon.www.samples.search.create_index_xsp.generate (/Users/ jermq/Library/TomCat/work/Standalone/localhost/cocoon/cocoon-f iles/org/ apache/cocoon/www/samples/search/create_index_xsp.java:190) at org.apache.cocoon.generation.ServerPagesGenerator.generate(Ser verPagesGe nerator.java:269) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeli ne.process XMLPipeline(AbstractProcessingPipeline.java:512) at org.apache.cocoon.components.pipeline.impl.AbstractCachingProc essingPipe line.processXMLPipeline(AbstractCachingProcessingPipeline.java:204) at org.apache.cocoon.components.pipeline.AbstractProcessingPipeli ne.process (AbstractProcessingPipeline.java:483) at org.apache.cocoon.components.treeprocessor.sitemap.SerializeNo de.invoke( SerializeNode.java:149) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:85) at org.apache.cocoon.components.treeprocessor.sitemap.PreparableM atchNode.i nvoke(PreparableMatchNode.java:166) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNod e.invoke(P ipelineNode.java:153) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNo de.invoke( PipelinesNode.java:143) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:326) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:308) at org.apache.cocoon.components.treeprocessor.sitemap.MountNode.i nvoke(Moun tNode.java:131) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:85) at org.apache.cocoon.components.treeprocessor.sitemap.PreparableM atchNode.i nvoke(PreparableMatchNode.java:166) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNod e.invoke(P ipelineNode.java:153) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNo de.invoke( PipelinesNode.java:143) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:326) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:308) at org.apache.cocoon.components.treeprocessor.sitemap.MountNode.i nvoke(Moun tNode.java:131) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:85) at org.apache.cocoon.components.treeprocessor.sitemap.PreparableM atchNode.i nvoke(PreparableMatchNode.java:166) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelineNod e.invoke(P ipelineNode.java:153) at org.apache.cocoon.components.treeprocessor.AbstractParentProce ssingNode. invokeNodes(AbstractParentProcessingNode.java:109) at org.apache.cocoon.components.treeprocessor.sitemap.PipelinesNo de.invoke( PipelinesNode.java:143) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:326) at org.apache.cocoon.components.treeprocessor.TreeProcessor.proce ss(TreePro cessor.java:308) at org.apache.cocoon.Cocoon.process(Cocoon.java:595) at org.apache.cocoon.servlet.CocoonServlet.service(CocoonServlet. java:1069) at javax.servlet.http.HttpServlet.service(HttpServlet.java:853) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilt er(Applica tionFilterChain.java:247) at org.apache.catalina.core.ApplicationFilterChain.doFilter(Appli cationFilt erChain.java:193) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardW rapperValv e.java:260) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.catalina.core.StandardContextValve.invoke(StandardC ontextValv e.java:191) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.catalina.core.StandardContext.invoke(StandardContex t.java:239 6) at org.apache.catalina.core.StandardHostValve.invoke(StandardHost Valve.java :180) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.valves.ErrorDispatcherValve.invoke(ErrorDi spatcherVa lve.java:170) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:641) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReport Valve.java :172) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:641) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEn gineValve. java:174) at org.apache.catalina.core.StandardPipeline$StandardPipelineValv eContext.i nvokeNext(StandardPipeline.java:643) at org.apache.catalina.core.StandardPipeline.invoke(StandardPipel ine.java:4 80) at org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:995) at org.apache.coyote.tomcat4.CoyoteAdapter.service(CoyoteAdapter. java:223) at org.apache.coyote.http11.Http11Processor.process(Http11Process or.java:40 5) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandle r.processC onnection(Http11Protocol.java:380) at org.apache.tomcat.util.net.TcpWorkerThread.runIt(PoolTcpEndpoi nt.java:50 8) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run( ThreadPool .java:533) at java.lang.Thread.run(Thread.java:491) request-uri /cocoon/samples/search/create path-info samples/search/create Thanks again regards Jeremy --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, email: [EMAIL PROTECTED]--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, email: [EMAIL PROTECTED]
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, email: [EMAIL PROTECTED]