[
https://issues.apache.org/jira/browse/LUCENE-8252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16437461#comment-16437461
]
Michael Braun commented on LUCENE-8252:
---------------------------------------
Aha thanks - sorry, had thought it checked checksums on load rather than
requiring a checkindex to verify just that piece-
{code}
test: check integrity.....FAILED
WARNING: exorciseIndex() would remove reference to this segment; full
exception:
org.apache.lucene.index.CorruptIndexException: checksum failed (hardware
problem?) : expected=92621dd7 actual=87fba3fa
(resource=BufferedChecksumIndexInput(MMapIndexInput(path=".../collection/collection_shardY_replica1/data/index.20180403111745790/_24ov_Lucene50_0.pos")))
at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:419)
at
org.apache.lucene.codecs.CodecUtil.checksumEntireFile(CodecUtil.java:526)
at
org.apache.lucene.codecs.lucene50.Lucene50PostingsReader.checkIntegrity(Lucene50PostingsReader.java:1286)
at
org.apache.lucene.codecs.blocktree.BlockTreeTermsReader.checkIntegrity(BlockTreeTermsReader.java:339)
at
org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.checkIntegrity(PerFieldPostingsFormat.java:348)
at
org.apache.lucene.index.CodecReader.checkIntegrity(CodecReader.java:374)
at org.apache.lucene.index.CheckIndex.checkIndex(CheckIndex.java:708)
at org.apache.lucene.index.CheckIndex.doCheck(CheckIndex.java:2771)
at org.apache.lucene.index.CheckIndex.doMain(CheckIndex.java:2673)
at org.apache.lucene.index.CheckIndex.main(CheckIndex.java:2599)
{code}
If this is expected to happen on occasion and checksum checking is only done on
checkindex, then this jira should be withdrawn. Thanks for your help [~jpountz]
> ArrayIndexOutOfBoundsException hit in lucene50.ForUtil.readBlock
> ----------------------------------------------------------------
>
> Key: LUCENE-8252
> URL: https://issues.apache.org/jira/browse/LUCENE-8252
> Project: Lucene - Core
> Issue Type: Bug
> Affects Versions: 6.6.2
> Reporter: Michael Braun
> Priority: Major
>
> We hit this on an autowarming query with a phrase on a particular shard, and
> it keeps happening with similar errors (and on other position-sensitive
> queries) post-restart on both that particular autowarming query and other
> queries. I'm guessing somehow a file in the index got written incorrectly
> with regard to positions.
> {code}
> 10:11:58 ERROR 04-06 17:52:06.360 org.apache.solr.handler.RequestHandlerBase
> (searcherExecutor-9-thread-1-processing-n:ourip:8983_solr
> x:collection_shardY_replica1 s:shardY c:collection) [s:Y ]
> java.lang.ArrayIndexOutOfBoundsException: -95
> at
> org.apache.lucene.codecs.lucene50.ForUtil.readBlock(ForUtil.java:196)
> at
> org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockPostingsEnum.refillPositions(Lucene50PostingsReader.java:638)
> at
> org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockPostingsEnum.skipPositions(Lucene50PostingsReader.java:747)
> at
> org.apache.lucene.codecs.lucene50.Lucene50PostingsReader$BlockPostingsEnum.nextPosition(Lucene50PostingsReader.java:768)
> at
> org.apache.lucene.search.ExactPhraseScorer.phraseFreq(ExactPhraseScorer.java:128)
> at
> org.apache.lucene.search.ExactPhraseScorer.access$000(ExactPhraseScorer.java:27)
> at
> org.apache.lucene.search.ExactPhraseScorer$1.matches(ExactPhraseScorer.java:73)
> at
> org.apache.lucene.search.Weight$DefaultBulkScorer.scoreAll(Weight.java:253)
> at
> org.apache.lucene.search.Weight$DefaultBulkScorer.score(Weight.java:197)
> at org.apache.lucene.search.BulkScorer.score(BulkScorer.java:39)
> at
> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:668)
> at
> org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:472)
> at
> org.apache.solr.search.SolrIndexSearcher.buildAndRunCollectorChain(SolrIndexSearcher.java:217)
> at
> org.apache.solr.search.SolrIndexSearcher.getDocListNC(SolrIndexSearcher.java:1582)
> at
> org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:1399)
> at
> org.apache.solr.search.SolrIndexSearcher.search(SolrIndexSearcher.java:566)
> at
> org.apache.solr.handler.component.QueryComponent.process(QueryComponent.java:545)
> at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:296)
> at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:173)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2477)
> at
> org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:74)
> at
> org.apache.solr.core.SolrCore.lambda$getSearcher$15(SolrCore.java:2249)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
