Robert made some nice improvements (rev 1349452) to test coverage in BaseTokenStreamTestCase by sometimes (rarely()) indexing the tokens so we can CheckIndex the result (eg verify offsets match term vectors).
But we need to turn off Memory (and probably SimpleText) PF ... I'll turn it off in BTSTC so we don't have to fix all tests that call it ... Mike McCandless http://blog.mikemccandless.com On Tue, Jun 19, 2012 at 3:46 PM, Uwe Schindler <[email protected]> wrote: > Why does this happen so often recently? > > Uwe > -- > Uwe Schindler > H.-H.-Meier-Allee 63, 28213 Bremen > http://www.thetaphi.de > > > > Michael McCandless <[email protected]> schrieb: >> >> I'll take this ... same situation as TestJapaneseTokenizer. >> >> Mike McCandless >> >> http://blog.mikemccandless.com >> >> >> On Tue, Jun 19, 2012 at 3:37 PM, Apache Jenkins Server >> <[email protected]> wrote: >> > Build: https://builds.apache.org/job/Lucene-Solr-tests-only-4.x/136/ >> > >> > 1 tests failed. >> > REGRESSION: >> > org.apache.lucene.analysis.ngram.NGramTokenizerTest.testRandomStrings >> > >> > Error Message: >> > some thread(s) failed >> > >> > Stack Trace: >> > java.lang.RuntimeException: some thread(s) failed >> > at >> > __randomizedtesting.SeedInfo.seed([D8B7C46DBD2399D7:503EC4D31E27CEE2]:0) >> > at >> >> org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:466) >> > at >> > org.apache.lucene.analysis.ngram.NGramTokenizerTest.testRandomStrings(NGramTokenizerTest.java:106) >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> > at >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> > at >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> > at java.lang.reflect.Method.invoke(Method.java:616) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1969) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:814) >> > at >> >> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:875) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:889) >> > at >> > org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> > at >> > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32) >> > at >> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) >> > at >> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> > at >> > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) >> > at >> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) >> > at >> >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:821) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) >> > at >> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) >> > at >> >> org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) >> > at >> > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) >> > at >> > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) >> > at >> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> > at >> > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) >> > at >> > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) >> > at >> > org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) >> > at >> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> > at >> >> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) >> > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) >> > >> > >> > >> > >> > Build Log: >> > [...truncated 4967 lines...] >> > [junit4] Suite: >> > org.apache.lucene.analysis.payloads.TokenOffsetPayloadTokenFilterTest >> > [junit4] Completed on J0 in 0.03s, 1 test >> > [junit4] >> > [junit4] Suite: >> > org.apache.lucene.analysis.sinks.TokenRangeSinkTokenizerTest >> > [junit4] Completed on J0 in 0.01s, 1 test >> > [junit4] >> > [junit4] Suite: org.apache.lucene.analysis.ro.TestRomanianAnalyzer >> > [junit4] Completed on J1 in 1.10s, 4 tests >> > [junit4] >> > [junit4] Suite: org.apache.lucene.analysis.ngram.NGramTokenizerTest >> > [junit4] ERROR 2343s J1 | NGramTokenizerTest.testRandomStrings >> > [junit4] > Throwable #1: java.lang.RuntimeException: some thread(s) >> > failed >> > [junit4] > at >> > __randomizedtesting.SeedInfo.seed([D8B7C46DBD2399D7:503EC4D31E27CEE2]:0) >> > [junit4] > at >> > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:466) >> > [junit4] > at >> > org.apache.lucene.analysis.ngram.NGramTokenizerTest.testRandomStrings(NGramTokenizerTest.java:106) >> > [junit4] > at >> > sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> > [junit4] > >> at >> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> > [junit4] > at >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> > [junit4] > at >> > java.lang.reflect.Method.invoke(Method.java:616) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1969) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$1100(RandomizedRunner.java:132) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:814) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:875) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:889) >> &g >> t; >> [junit4] > at >> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) >> >> > [junit4] > at >> > org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:32) >> > [junit4] > at >> > org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) >> > [junit4] > at >> >> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:821) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) >> > [junit4] > at >> >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) >> > [j >> unit4] >> > at >> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) >> > [junit4] > Throwable #2: java.lang.RuntimeException: Thread threw >> > an uncaught exception, thread: Thread[Thread-69,5,] >> > [junit4] > at >> >> com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) >> > [junit4] > at >> >> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) >> > [j >> unit4] >> > at >> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) >> > [junit4] > at >> > org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:56) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) >> > [junit4] > at >> > com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) >> > [junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit >> > exceeded >> > [junit4] > at __randomizedtesting.SeedInfo. >> seed([D8B7C46DBD2399D7]:0)< >> br >> />> [junit4] > at >> org.apache.lucene.index.MultiDocsAndPositionsEnum.reset(MultiDocsAndPositionsEnum.java:54) >> >> > [junit4] > at >> > org.apache.lucene.index.MultiTermsEnum.docsAndPositions(MultiTermsEnum.java:492) >> > [junit4] > at >> > org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:149) >> > [junit4] > at >> > org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:65) >> > [junit4] > at >> > org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:326) >> > [junit4] > at >> > org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:112) >> > [junit4] > at >> > org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:3488) >> > [junit4] > at >> > org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3123) >> > [junit4] > >> >> at >> org.apache.lucene.index.SerialMergeScheduler.merge(SerialMergeScheduler.java:37) >> > [junit4] > at >> > org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1697) >> > [junit4] > at >> > org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:1691) >> > [junit4] > at >> > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1338) >> > [junit4] > at >> > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1078) >> > [junit4] > at >> > org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:186) >> > [junit4] > at >> > org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:145) >> > [junit4] > at >> > org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:558) >> > [junit4] > >> >> at >> org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenStreamTestCase.java:64) >> > [junit4] > at >> > org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:421) >> > [junit4] > >> > [junit4] 2> TEST FAIL: useCharFilter=false text='wij.|sktjb j]ia >> > \ue7a7\ue63fd\u77c7\u018em\u9017\u6d51\uc9a53\uc5d7a \ --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
