Sounds like a bug to me.
----- Reply message -----
From: "Axel Morgner" <a...@morgner.de>
Date: Wed, Mar 30, 2011 1:23 pm
Subject: [Neo4j] Lucene index: Too many open files
To: "Neo4j user discussions" <user@lists.neo4j.org>
Hi,
during stress tests, I got a "Too many open files" message (see detailed
stack trace below). Server is a Debian Linux 2.6.26 x86_64 w/ 24 GB RAM,
Core i7 which handles the load with ease.
cat /proc/sys/fs/file-max
2399285
The parameter fs.file-max was already set very high, but I'll increase
it further and see if it will happen again.
fs.file-max = 6815744
fs.aio-max-nr = 1048576
Are there recommendations of linux kernel parameters? Or/and would you
recommend other things to circumvent that, f.e. using multiple indexes
instead of one?
And it seems to me that finishing a Neo4j transaction will always
trigger a LuceneTransaction.doCommit, even if there was no update on
index (I try to avoid for the log nodes). Can this be switched off?
Thanks and greetings
Axel
[1] Stack trace
java.lang.RuntimeException: java.io.FileNotFoundException:
/opt/structr/t5s/db/index/lucene/node/fulltextAllNodes/_ngl.fdx (Too
many open files)
at
org.neo4j.index.impl.lucene.LuceneTransaction.doCommit(LuceneTransaction.java:272)
at
org.neo4j.kernel.impl.transaction.xaframework.XaTransaction.commit(XaTransaction.java:318)
at
org.neo4j.kernel.impl.transaction.xaframework.XaResourceManager.commit(XaResourceManager.java:446)
at
org.neo4j.kernel.impl.transaction.xaframework.XaResourceHelpImpl.commit(XaResourceHelpImpl.java:64)
at
org.neo4j.kernel.impl.transaction.TransactionImpl.doCommit(TransactionImpl.java:516)
at
org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:621)
at
org.neo4j.kernel.impl.transaction.TxManager.commit(TxManager.java:584)
at
org.neo4j.kernel.impl.transaction.TransactionImpl.commit(TransactionImpl.java:104)
at
org.neo4j.kernel.TopLevelTransaction.finish(TopLevelTransaction.java:85)
at
org.structr.core.node.TransactionCommand.execute(TransactionCommand.java:37)
at org.structr.core.entity.AbstractNode.commit(AbstractNode.java:1048)
at org.structr.core.log.LogService.flushQueue(LogService.java:101)
at org.structr.core.log.LogService.run(LogService.java:73)
Caused by: java.io.FileNotFoundException:
/opt/structr/t5s/db/index/lucene/node/fulltextAllNodes/_ngl.fdx (Too
many open files)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:233)
at
org.apache.lucene.store.SimpleFSDirectory$SimpleFSIndexOutput.<init>(SimpleFSDirectory.java:180)
at
org.apache.lucene.store.NIOFSDirectory.createOutput(NIOFSDirectory.java:74)
at org.apache.lucene.index.FieldsWriter.<init>(FieldsWriter.java:86)
at
_______________________________________________
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user
