[ https://issues.apache.org/jira/browse/LUCENE-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12636207#action_12636207 ]
Michael McCandless commented on LUCENE-1409: -------------------------------------------- Apparently, compass committed its transaction and is attempting to reopen the IndexReader but the reopen hits that exception because somehow the fieldInfos file (*.fnm) for one of your segments is 0 bytes long. I don't know what would do truncate your _X.fnm file like that. Which OS are you on? Are you sure there's nothing external to Lucene that might interfere w/ the index files? Or, is it possible you have filesystem corrutption (does this happen on a different computer)? Or could it be that two writers are accidentally operating on this index at once? bq. That slowdown I think is caused by optimizer as you wrote I turned off optimize as you suggested. It helped, but, strangely, it's still drastically slowing down. Have other users of compass seen this? > read past EOF > ------------- > > Key: LUCENE-1409 > URL: https://issues.apache.org/jira/browse/LUCENE-1409 > Project: Lucene - Java > Issue Type: Bug > Affects Versions: 2.3.2 > Environment: jdk 1.5.0_08 > Reporter: Adam Łączyński > > I create index with a lot of documents (~500 000). During add documents to > "read past EOF" error occured. It occure after random number of indexed > documents. I used lucene with compass framework but I think that is not > important. It is a link to compass forum where that problem was reporeted > http://forum.compass-project.org/thread.jspa?threadID=215641&tstart=0 > java.io.IOException: read past EOF > at > org.apache.lucene.store.BufferedIndexInput.refill(BufferedIndexInput.java:146) > at > org.apache.lucene.store.BufferedIndexInput.readByte(BufferedIndexInput.java:38) > at org.apache.lucene.store.IndexInput.readVInt(IndexInput.java:76) > at org.apache.lucene.index.FieldInfos.read(FieldInfos.java:304) > at org.apache.lucene.index.FieldInfos.<init>(FieldInfos.java:59) > at > org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:298) > at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:262) > at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:197) > at > org.apache.lucene.index.MultiSegmentReader.<init>(MultiSegmentReader.java:109) > at > org.apache.lucene.index.MultiSegmentReader.doReopen(MultiSegmentReader.java:203) > at > org.apache.lucene.index.DirectoryIndexReader$2.doBody(DirectoryIndexReader.java:98) > at > org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:636) > at > org.apache.lucene.index.DirectoryIndexReader.reopen(DirectoryIndexReader.java:92) > at > org.compass.core.lucene.engine.manager.DefaultLuceneSearchEngineIndexManager.internalRefreshCache(DefaultLuceneSearchEngineIndexManager.java:368) > at > org.compass.core.lucene.engine.manager.DefaultLuceneSearchEngineIndexManager.refreshCache(DefaultLuceneSearchEngineIndexManager.java:358) > at > org.compass.core.lucene.engine.transaction.readcommitted.ReadCommittedTransaction$CommitCallable.call(ReadCommittedTransaction.java:422) > at > org.compass.core.transaction.context.TransactionalCallable$1.doInTransaction(TransactionalCallable.java:44) > at > org.compass.core.impl.DefaultCompass$CompassTransactionContext.execute(DefaultCompass.java:342) > at > org.compass.core.transaction.context.TransactionalCallable.call(TransactionalCallable.java:41) > at > org.compass.core.executor.DefaultExecutorManager.invokeAllWithLimit(DefaultExecutorManager.java:104) > at > org.compass.core.executor.DefaultExecutorManager.invokeAllWithLimitBailOnException(DefaultExecutorManager.java:73) > at > org.compass.core.lucene.engine.transaction.readcommitted.ReadCommittedTransaction.doCommit(ReadCommittedTransaction.java:142) > at > org.compass.core.lucene.engine.transaction.AbstractTransaction.commit(AbstractTransaction.java:98) > at > org.compass.core.lucene.engine.LuceneSearchEngine.commit(LuceneSearchEngine.java:172) > at > org.compass.core.transaction.LocalTransaction.doCommit(LocalTransaction.java:97) > at > org.compass.core.transaction.AbstractTransaction.commit(AbstractTransaction.java:46) > at org.compass.core.CompassTemplate.execute(CompassTemplate.java:131) > at org.compass.core.CompassTemplate.execute(CompassTemplate.java:112) > at asl.simplesearch.compass.CompassService.createCall(Unknown Source) > at asl.util.IndexCreator.createIndex(Unknown Source) > at asl.util.IndexCreator.start(Unknown Source) > at asl.util.IndexCreatorTestCase.main(IndexCreatorTestCase.java:20) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online. --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]