Steve Rowe created LUCENE-7445:
----------------------------------

             Summary: TestSearcherManager failure: Document contains at least 
one immense term in field="body"
                 Key: LUCENE-7445
                 URL: https://issues.apache.org/jira/browse/LUCENE-7445
             Project: Lucene - Core
          Issue Type: Bug
            Reporter: Steve Rowe


My Jenkins found a reproducing branch_6x seed:

{noformat}
   [junit4] Suite: org.apache.lucene.search.TestSearcherManager
   [junit4]   2> ruj 10, 2016 8:08:20 AM 
com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler
 uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: 
Thread[Thread-673,5,TGRP-TestSearcherManager]
   [junit4]   2> java.lang.IllegalArgumentException: Document contains at least 
one immense term in field="body" (whose UTF8 encoding is longer than the max 
length 32766), all of which were skipped.  Please correct the analyzer to not 
produce such terms.  The prefix of the first immense term is: '[125, 125, 123, 
123, 123, 123, 123, 115, 117, 98, 115, 116, 99, 124, 125, 125, 125, 123, 123, 
123, 49, 125, 125, 125, 124, 123, 123, 123, 112, 49]...', original message: 
bytes can be at most 32766 in length; got 94384
   [junit4]   2>        at 
__randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231)
   [junit4]   2>        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307)
   [junit4]   2>        at 
org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557)
   [junit4]   2>        Suppressed: java.lang.IllegalStateException: close() 
called in wrong state: INCREMENT
   [junit4]   2>                at 
org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
   [junit4]   2>                at 
org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292)
   [junit4]   2>                at 
org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58)
   [junit4]   2>                at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788)
   [junit4]   2>                ... 7 more
   [junit4]   2> Caused by: 
org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can 
be at most 32766 in length; got 94384
   [junit4]   2>        at 
org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263)
   [junit4]   2>        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
   [junit4]   2>        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762)
   [junit4]   2>        ... 7 more
   [junit4]   2> 
   [junit4]   2> ruj 10, 2016 8:38:00 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
   [junit4]   2> WARNING: Suite execution timed out: 
org.apache.lucene.search.TestSearcherManager
   [junit4]   2> ==== jstack at approximately timeout time ====
   [junit4]   2> "Thread-676" ID=802 RUNNABLE
   [junit4]   2>        at java.lang.Thread.holdsLock(Native Method)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:565)
   [junit4]   2>        at 
org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:553)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.incRefDeleter(IndexWriter.java:4963)
   [junit4]   2>        - locked org.apache.lucene.index.IndexWriter@7fc295c2
   [junit4]   2>        at 
org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:117)
   [junit4]   2>        at 
org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:460)
   [junit4]   2>        - locked org.apache.lucene.index.IndexWriter@7fc295c2
   [junit4]   2>        - locked java.lang.Object@c3599a3
   [junit4]   2>        at 
org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
   [junit4]   2>        at 
org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:108)
   [junit4]   2>        at 
org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:76)
   [junit4]   2>        at 
org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647)
   [junit4]   2> 
   [junit4]   2> "Thread-675" ID=801 RUNNABLE
   [junit4]   2>        at java.lang.Throwable.fillInStackTrace(Native Method)
   [junit4]   2>        at 
java.lang.Throwable.fillInStackTrace(Throwable.java:783)
   [junit4]   2>        - locked 
org.apache.lucene.store.AlreadyClosedException@4e77cf8b
   [junit4]   2>        at java.lang.Throwable.<init>(Throwable.java:265)
   [junit4]   2>        at java.lang.Exception.<init>(Exception.java:66)
   [junit4]   2>        at 
java.lang.RuntimeException.<init>(RuntimeException.java:62)
   [junit4]   2>        at 
java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
   [junit4]   2>        at 
org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
   [junit4]   2>        at 
org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
   [junit4]   2>        at 
org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
   [junit4]   2>        at 
org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
   [junit4]   2> 
   [junit4]   2> "Thread-674" ID=800 RUNNABLE
   [junit4]   2>        at java.lang.Throwable.fillInStackTrace(Native Method)
   [junit4]   2>        at 
java.lang.Throwable.fillInStackTrace(Throwable.java:783)
   [junit4]   2>        - locked 
org.apache.lucene.store.AlreadyClosedException@746a9d47
   [junit4]   2>        at java.lang.Throwable.<init>(Throwable.java:265)
   [junit4]   2>        at java.lang.Exception.<init>(Exception.java:66)
   [junit4]   2>        at 
java.lang.RuntimeException.<init>(RuntimeException.java:62)
   [junit4]   2>        at 
java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
   [junit4]   2>        at 
org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
   [junit4]   2>        at 
org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
   [junit4]   2>        at 
org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
   [junit4]   2> 
   [junit4]   2> 
"TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA]"
 ID=797 WAITING on org.apache.lucene.search.TestSearcherManager$9@1fed6a8d
   [junit4]   2>        at java.lang.Object.wait(Native Method)
   [junit4]   2>        - waiting on 
org.apache.lucene.search.TestSearcherManager$9@1fed6a8d
   [junit4]   2>        at java.lang.Thread.join(Thread.java:1245)
   [junit4]   2>        at java.lang.Thread.join(Thread.java:1319)
   [junit4]   2>        at 
org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670)
   [junit4]   2>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>        at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
   [junit4]   2>        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> "SUITE-TestSearcherManager-seed#[22BFCB6CA5A80CA]" ID=796 
RUNNABLE
   [junit4]   2>        at sun.management.ThreadImpl.dumpThreads0(Native Method)
   [junit4]   2>        at 
sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:454)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:673)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:414)
   [junit4]   2>        - locked java.lang.Object@3fb51052
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:681)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:591)
   [junit4]   2> 
   [junit4]   2> "JUnit4-serializer-daemon" ID=18 TIMED_WAITING
   [junit4]   2>        at java.lang.Thread.sleep(Native Method)
   [junit4]   2>        at 
com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47)
   [junit4]   2> 
   [junit4]   2> "Signal Dispatcher" ID=4 RUNNABLE
   [junit4]   2> 
   [junit4]   2> "Finalizer" ID=3 WAITING on 
java.lang.ref.ReferenceQueue$Lock@4f4e9bb8
   [junit4]   2>        at java.lang.Object.wait(Native Method)
   [junit4]   2>        - waiting on java.lang.ref.ReferenceQueue$Lock@4f4e9bb8
   [junit4]   2>        at 
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
   [junit4]   2>        at 
java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
   [junit4]   2>        at 
java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
   [junit4]   2> 
   [junit4]   2> "Reference Handler" ID=2 WAITING on 
java.lang.ref.Reference$Lock@6f6eb7b3
   [junit4]   2>        at java.lang.Object.wait(Native Method)
   [junit4]   2>        - waiting on java.lang.ref.Reference$Lock@6f6eb7b3
   [junit4]   2>        at java.lang.Object.wait(Object.java:502)
   [junit4]   2>        at 
java.lang.ref.Reference.tryHandlePending(Reference.java:191)
   [junit4]   2>        at 
java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)
   [junit4]   2> 
   [junit4]   2> "main" ID=1 WAITING on 
com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9
   [junit4]   2>        at java.lang.Object.wait(Native Method)
   [junit4]   2>        - waiting on 
com.carrotsearch.randomizedtesting.RandomizedRunner$2@3eff9ff9
   [junit4]   2>        at java.lang.Thread.join(Thread.java:1245)
   [junit4]   2>        at java.lang.Thread.join(Thread.java:1319)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:601)
   [junit4]   2>        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:450)
   [junit4]   2>        at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:243)
   [junit4]   2>        at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:354)
   [junit4]   2>        at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
   [junit4]   2> 
   [junit4]   2> ^^==============================================
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSearcherManager 
-Dtests.method=testConcurrentIndexCloseSearchAndRefresh 
-Dtests.seed=22BFCB6CA5A80CA -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   1800s J8  | 
TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh <<<
   [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because 
suite timeout was reached.
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
   [junit4]   2> ruj 10, 2016 8:38:00 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 4 leaked 
thread(s).
   [junit4]   2> ruj 10, 2016 8:38:20 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 4 threads leaked from SUITE scope at 
org.apache.lucene.search.TestSearcherManager: 
   [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
   [junit4]   2>         at 
java.lang.Throwable.fillInStackTrace(Throwable.java:783)
   [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
   [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
   [junit4]   2>         at 
java.lang.RuntimeException.<init>(RuntimeException.java:62)
   [junit4]   2>         at 
java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
   [junit4]   2>         at 
org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
   [junit4]   2>         at 
org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
   [junit4]   2>    2) Thread[id=802, name=Thread-676, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2>         at java.lang.Thread.holdsLock(Native Method)
   [junit4]   2>         at 
org.apache.lucene.index.IndexFileDeleter.locked(IndexFileDeleter.java:117)
   [junit4]   2>         at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:577)
   [junit4]   2>         at 
org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:647)
   [junit4]   2>         at 
org.apache.lucene.index.IndexWriter.decRefDeleter(IndexWriter.java:4975)
   [junit4]   2>         at 
org.apache.lucene.index.StandardDirectoryReader.doClose(StandardDirectoryReader.java:381)
   [junit4]   2>         at 
org.apache.lucene.index.IndexReader.decRef(IndexReader.java:251)
   [junit4]   2>         at 
org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:149)
   [junit4]   2>         at 
org.apache.lucene.search.SearcherManager.decRef(SearcherManager.java:58)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.release(ReferenceManager.java:274)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.swapReference(ReferenceManager.java:62)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.close(ReferenceManager.java:146)
   [junit4]   2>         at 
org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:643)
   [junit4]   2>    3) Thread[id=797, 
name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA],
 state=WAITING, group=TGRP-TestSearcherManager]
   [junit4]   2>         at java.lang.Object.wait(Native Method)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1245)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1319)
   [junit4]   2>         at 
org.apache.lucene.search.TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh(TestSearcherManager.java:670)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>    4) Thread[id=801, name=Thread-675, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
   [junit4]   2>         at 
java.lang.Throwable.fillInStackTrace(Throwable.java:783)
   [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
   [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
   [junit4]   2>         at 
java.lang.RuntimeException.<init>(RuntimeException.java:62)
   [junit4]   2>         at 
java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
   [junit4]   2>         at 
org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
   [junit4]   2>         at 
org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
   [junit4]   2> ruj 10, 2016 8:38:20 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2>    2) Thread[id=802, name=Thread-676, state=BLOCKED, 
group=TGRP-TestSearcherManager]
   [junit4]   2>    3) Thread[id=797, 
name=TEST-TestSearcherManager.testConcurrentIndexCloseSearchAndRefresh-seed#[22BFCB6CA5A80CA],
 state=WAITING, group=TGRP-TestSearcherManager]
   [junit4]   2>    4) Thread[id=801, name=Thread-675, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/var/lib/jenkins/jobs/Lucene-Solr-Nightly-6.x/workspace/lucene/build/core/test/J8/temp/lucene.search.TestSearcherManager_22BFCB6CA5A80CA-001
   [junit4]   2> Sep 10, 2016 8:38:23 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=800, name=Thread-674, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
   [junit4]   2>         at 
java.lang.Throwable.fillInStackTrace(Throwable.java:783)
   [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
   [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
   [junit4]   2>         at 
java.lang.RuntimeException.<init>(RuntimeException.java:62)
   [junit4]   2>         at 
java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
   [junit4]   2>         at 
org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.acquire(ReferenceManager.java:98)
   [junit4]   2>         at 
org.apache.lucene.search.TestSearcherManager$9.run(TestSearcherManager.java:588)
   [junit4]   2>    2) Thread[id=802, name=Thread-676, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2>         at java.lang.Thread.holdsLock(Native Method)
   [junit4]   2>         at 
org.apache.lucene.index.IndexWriter.holdsFullFlushLock(IndexWriter.java:3306)
   [junit4]   2>         at 
org.apache.lucene.index.DocumentsWriter.finishFullFlush(DocumentsWriter.java:676)
   [junit4]   2>         at 
org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:468)
   [junit4]   2>         at 
org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:103)
   [junit4]   2>         at 
org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:108)
   [junit4]   2>         at 
org.apache.lucene.search.SearcherManager.<init>(SearcherManager.java:76)
   [junit4]   2>         at 
org.apache.lucene.search.TestSearcherManager$11.run(TestSearcherManager.java:647)
   [junit4]   2>    3) Thread[id=801, name=Thread-675, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]   2>         at java.lang.Throwable.fillInStackTrace(Native Method)
   [junit4]   2>         at 
java.lang.Throwable.fillInStackTrace(Throwable.java:783)
   [junit4]   2>         at java.lang.Throwable.<init>(Throwable.java:265)
   [junit4]   2>         at java.lang.Exception.<init>(Exception.java:66)
   [junit4]   2>         at 
java.lang.RuntimeException.<init>(RuntimeException.java:62)
   [junit4]   2>         at 
java.lang.IllegalStateException.<init>(IllegalStateException.java:55)
   [junit4]   2>         at 
org.apache.lucene.store.AlreadyClosedException.<init>(AlreadyClosedException.java:26)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.ensureOpen(ReferenceManager.java:54)
   [junit4]   2>         at 
org.apache.lucene.search.ReferenceManager.maybeRefreshBlocking(ReferenceManager.java:248)
   [junit4]   2>         at 
org.apache.lucene.search.TestSearcherManager$10.run(TestSearcherManager.java:617)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): 
{date=BlockTreeOrds(blocksize=128), docid=PostingsFormat(name=Asserting), 
titleTokenized=PostingsFormat(name=LuceneFixedGap), 
body=BlockTreeOrds(blocksize=128), title=PostingsFormat(name=MockRandom)}, 
docValues:{docid_intDV=DocValuesFormat(name=Lucene54), 
titleDV=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1354, 
maxMBSortInHeap=5.736770517965361, 
sim=RandomSimilarity(queryNorm=false,coord=yes): {titleTokenized=IB 
SPL-D3(800.0), body=ClassicSimilarity}, locale=hr, 
timezone=America/Port-au-Prince
   [junit4]   2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 
1.8.0_77 (64-bit)/cpus=16,threads=4,free=246890576,total=341311488
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexWriterDelete, 
TestBooleanQuery, TestInPlaceMergeSorter, TestReaderWrapperDVTypeCheck, 
FuzzyTermOnShortTermsTest, TestParallelLeafReader, TestConjunctions, 
TestUTF32ToUTF8, TestPolygon2D, TestCharsRef, TestSimpleFSLockFactory, 
TestIndexWriterWithThreads, TestSpanOrQuery, TestShardSearching, 
TestEarlyTermination, TestTimeLimitingCollector, TestIndexWriterNRTIsCurrent, 
TestSetOnce, TestIndexWriterOnDiskFull, TestSegmentMerger, TestScorerPerf, 
TestIndexableField, TestSearcherManager]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSearcherManager 
-Dtests.seed=22BFCB6CA5A80CA -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=hr -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J8  | TestSearcherManager (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
1800000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=799, name=Thread-673, state=RUNNABLE, 
group=TGRP-TestSearcherManager]
   [junit4]    > Caused by: java.lang.IllegalArgumentException: Document 
contains at least one immense term in field="body" (whose UTF8 encoding is 
longer than the max length 32766), all of which were skipped.  Please correct 
the analyzer to not produce such terms.  The prefix of the first immense term 
is: '[125, 125, 123, 123, 123, 123, 123, 115, 117, 98, 115, 116, 99, 124, 125, 
125, 125, 123, 123, 123, 49, 125, 125, 125, 124, 123, 123, 123, 112, 49]...', 
original message: bytes can be at most 32766 in length; got 94384
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([22BFCB6CA5A80CA]:0)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:772)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:417)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:373)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:231)
   [junit4]    >        at 
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:478)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1562)
   [junit4]    >        at 
org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1307)
   [junit4]    >        at 
org.apache.lucene.search.TestSearcherManager$8.run(TestSearcherManager.java:557)
   [junit4]    >        Suppressed: java.lang.IllegalStateException: close() 
called in wrong state: INCREMENT
   [junit4]    >                at 
org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
   [junit4]    >                at 
org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:292)
   [junit4]    >                at 
org.apache.lucene.analysis.TokenFilter.close(TokenFilter.java:58)
   [junit4]    >                at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:788)
   [junit4]    >                ... 7 more
   [junit4]    > Caused by: 
org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can 
be at most 32766 in length; got 94384
   [junit4]    >        at 
org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:263)
   [junit4]    >        at 
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:149)
   [junit4]    >        at 
org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:762)
   [junit4]    >        ... 7 more
   [junit4] Completed [438/438 (1!)] on J8 in 1823.24s, 3 tests, 3 errors <<< 
FAILURES!
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to