[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14079873#comment-14079873 ] Jack Krupansky commented on LUCENE-5849: Any sense of whether this is JVM-dependent? Or whether it is an issue for the JVM itself? > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > Attachments: TestBinaryDocIndex.java > > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077704#comment-14077704 ] Uwe Schindler commented on LUCENE-5849: --- Thanks for the new test case. [~cnstar9988]'s problem is just caused by better bounds checks in RAMDirectory (previously RAMDir was buggy and did not correctly detect EOF). If you access a document number out of bounds with docvalues, an EOF is expected. I am also afraid that this is a corner case of LUCENE-5681, but Robert's test should catch this :-) > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > Attachments: TestBinaryDocIndex.java > > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077699#comment-14077699 ] ASF subversion and git services commented on LUCENE-5849: - Commit 1614340 from [~rcmuir] in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1614340 ] LUCENE-5849: try to stress slicing better in BaseDirectoryTestCase > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > Attachments: TestBinaryDocIndex.java > > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077695#comment-14077695 ] ASF subversion and git services commented on LUCENE-5849: - Commit 1614339 from [~rcmuir] in branch 'dev/trunk' [ https://svn.apache.org/r1614339 ] LUCENE-5849: try to stress slicing better in BaseDirectoryTestCase > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > Attachments: TestBinaryDocIndex.java > > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076381#comment-14076381 ] Robert Muir commented on LUCENE-5849: - Thats expected. you passed an illegal document id. that isn't a bug. > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > Attachments: TestBinaryDocIndex.java > > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076308#comment-14076308 ] Robert Muir commented on LUCENE-5849: - That is my concern: that its a corner case in LUCENE-5681... > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076288#comment-14076288 ] Littlestar commented on LUCENE-5849: I meet the bug too when getting binaryDoc. I have patch LUCENE-5681, wong too... java.lang.RuntimeException: java.io.EOFException: read past EOF: RAMInputStream(name=RAMInputStream(name=_0_Lucene49_0.dvd) [slice=randomaccess]) at org.apache.lucene.util.packed.DirectReader$DirectPackedReader1.get(DirectReader.java:78) at org.apache.lucene.codecs.lucene49.Lucene49DocValuesProducer$1.get(Lucene49DocValuesProducer.java:345) at org.apache.lucene.util.LongValues.get(LongValues.java:45) > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (LUCENE-5849) Scary "read past EOF" in RAMDir
[ https://issues.apache.org/jira/browse/LUCENE-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14076043#comment-14076043 ] Michael McCandless commented on LUCENE-5849: {noformat} JUnit version 4.10 .Jul 28, 2014 9:31:47 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException WARNING: Uncaught exception in thread: Thread[Lucene Merge Thread #2,6,TGRP-TestBinaryDocValuesUpdates] org.apache.lucene.index.MergePolicy$MergeException: java.io.EOFException: read past EOF: RAMInputStream(name=RAMInputStream(name=_6.cfs) [slice=_6_Memory_0.mdvd]) at __randomizedtesting.SeedInfo.seed([879E92147F435095]:0) at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:545) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:518) Caused by: java.io.EOFException: read past EOF: RAMInputStream(name=RAMInputStream(name=_6.cfs) [slice=_6_Memory_0.mdvd]) at org.apache.lucene.store.RAMInputStream.switchCurrentBuffer(RAMInputStream.java:98) at org.apache.lucene.store.RAMInputStream.readBytes(RAMInputStream.java:81) at org.apache.lucene.store.MockIndexInputWrapper.readBytes(MockIndexInputWrapper.java:128) at org.apache.lucene.store.BufferedChecksumIndexInput.readBytes(BufferedChecksumIndexInput.java:49) at org.apache.lucene.store.DataInput.readBytes(DataInput.java:82) at org.apache.lucene.store.DataInput.skipBytes(DataInput.java:266) at org.apache.lucene.store.ChecksumIndexInput.seek(ChecksumIndexInput.java:51) at org.apache.lucene.codecs.CodecUtil.checksumEntireFile(CodecUtil.java:267) at org.apache.lucene.codecs.memory.MemoryDocValuesProducer.checkIntegrity(MemoryDocValuesProducer.java:258) at org.apache.lucene.codecs.perfield.PerFieldDocValuesFormat$FieldsReader.checkIntegrity(PerFieldDocValuesFormat.java:329) at org.apache.lucene.index.SegmentReader.checkIntegrity(SegmentReader.java:644) at org.apache.lucene.index.SegmentMerger.(SegmentMerger.java:60) at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3978) at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3589) at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482) {noformat} > Scary "read past EOF" in RAMDir > --- > > Key: LUCENE-5849 > URL: https://issues.apache.org/jira/browse/LUCENE-5849 > Project: Lucene - Core > Issue Type: Bug >Reporter: Michael McCandless > > Nightly build hit this: > http://builds.flonkings.com/job/Lucene-trunk-Linux-Java7-64-test-only/91095 > And I'm able to repro at least once after beasting w/ the right JVM > (1.7.0_55) and G1GC. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org