I caused this with LUCENE-6659 ... I just committed a fix, but it was rather hairy.
The problem was I had made DWPTPool fully elastic to incoming threads, and IW.deleteAll relied on it not being elastic, locking all thread states to prevent any concurrent indexing while it deleted the world ... Mike McCandless http://blog.mikemccandless.com On Mon, Jul 13, 2015 at 5:56 AM, Michael McCandless <[email protected]> wrote: > I can reproduce this, with beasting. I'll dig ... > > Mike McCandless > > http://blog.mikemccandless.com > > > On Mon, Jul 13, 2015 at 1:05 AM, Policeman Jenkins Server > <[email protected]> wrote: >> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13439/ >> Java: 32bit/jdk1.8.0_60-ea-b21 -client -XX:+UseSerialGC >> >> 1 tests failed. >> FAILED: >> org.apache.lucene.index.TestIndexWriterDelete.testDeleteAllNoDeadLock >> >> Error Message: >> Captured an uncaught exception in thread: Thread[id=952, name=Thread-760, >> state=RUNNABLE, group=TGRP-TestIndexWriterDelete] >> >> Stack Trace: >> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >> uncaught exception in thread: Thread[id=952, name=Thread-760, >> state=RUNNABLE, group=TGRP-TestIndexWriterDelete] >> at >> __randomizedtesting.SeedInfo.seed([2A15003A7A503DA6:190CEF24FA9387F0]:0) >> Caused by: java.lang.RuntimeException: java.lang.IllegalArgumentException: >> field number 3 is already mapped to field name "null", not "dv" >> at __randomizedtesting.SeedInfo.seed([2A15003A7A503DA6]:0) >> at >> org.apache.lucene.index.TestIndexWriterDelete$1.run(TestIndexWriterDelete.java:340) >> Caused by: java.lang.IllegalArgumentException: field number 3 is already >> mapped to field name "null", not "dv" >> at >> org.apache.lucene.index.FieldInfos$FieldNumbers.verifyConsistent(FieldInfos.java:249) >> at >> org.apache.lucene.index.FieldInfos$Builder.getOrAdd(FieldInfos.java:320) >> at >> org.apache.lucene.index.DefaultIndexingChain.getOrAddField(DefaultIndexingChain.java:472) >> at >> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:341) >> at >> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:234) >> at >> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455) >> at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458) >> at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237) >> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:173) >> at >> org.apache.lucene.index.TestIndexWriterDelete$1.run(TestIndexWriterDelete.java:334) >> >> >> >> >> Build Log: >> [...truncated 1097 lines...] >> [junit4] Suite: org.apache.lucene.index.TestIndexWriterDelete >> [junit4] IGNOR/A 0.00s J2 | TestIndexWriterDelete.testApplyDeletesOnFlush >> [junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly()) >> [junit4] 2> Kor 13, 2015 10:01:25 PD >> com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler >> uncaughtException >> [junit4] 2> WARNING: Uncaught exception in thread: >> Thread[Thread-760,5,TGRP-TestIndexWriterDelete] >> [junit4] 2> java.lang.RuntimeException: >> java.lang.IllegalArgumentException: field number 3 is already mapped to >> field name "null", not "dv" >> [junit4] 2> at >> __randomizedtesting.SeedInfo.seed([2A15003A7A503DA6]:0) >> [junit4] 2> at >> org.apache.lucene.index.TestIndexWriterDelete$1.run(TestIndexWriterDelete.java:340) >> [junit4] 2> Caused by: java.lang.IllegalArgumentException: field number >> 3 is already mapped to field name "null", not "dv" >> [junit4] 2> at >> org.apache.lucene.index.FieldInfos$FieldNumbers.verifyConsistent(FieldInfos.java:249) >> [junit4] 2> at >> org.apache.lucene.index.FieldInfos$Builder.getOrAdd(FieldInfos.java:320) >> [junit4] 2> at >> org.apache.lucene.index.DefaultIndexingChain.getOrAddField(DefaultIndexingChain.java:472) >> [junit4] 2> at >> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:341) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:234) >> [junit4] 2> at >> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458) >> [junit4] 2> at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237) >> [junit4] 2> at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:173) >> [junit4] 2> at >> org.apache.lucene.index.TestIndexWriterDelete$1.run(TestIndexWriterDelete.java:334) >> [junit4] 2> >> [junit4] 2> NOTE: reproduce with: ant test >> -Dtestcase=TestIndexWriterDelete -Dtests.method=testDeleteAllNoDeadLock >> -Dtests.seed=2A15003A7A503DA6 -Dtests.multiplier=3 -Dtests.slow=true >> -Dtests.locale=sq -Dtests.timezone=Asia/Ashkhabad -Dtests.asserts=true >> -Dtests.file.encoding=US-ASCII >> [junit4] ERROR 0.24s J2 | TestIndexWriterDelete.testDeleteAllNoDeadLock >> <<< >> [junit4] > Throwable #1: >> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an >> uncaught exception in thread: Thread[id=952, name=Thread-760, >> state=RUNNABLE, group=TGRP-TestIndexWriterDelete] >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([2A15003A7A503DA6:190CEF24FA9387F0]:0) >> [junit4] > Caused by: java.lang.RuntimeException: >> java.lang.IllegalArgumentException: field number 3 is already mapped to >> field name "null", not "dv" >> [junit4] > at >> __randomizedtesting.SeedInfo.seed([2A15003A7A503DA6]:0) >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterDelete$1.run(TestIndexWriterDelete.java:340) >> [junit4] > Caused by: java.lang.IllegalArgumentException: field number >> 3 is already mapped to field name "null", not "dv" >> [junit4] > at >> org.apache.lucene.index.FieldInfos$FieldNumbers.verifyConsistent(FieldInfos.java:249) >> [junit4] > at >> org.apache.lucene.index.FieldInfos$Builder.getOrAdd(FieldInfos.java:320) >> [junit4] > at >> org.apache.lucene.index.DefaultIndexingChain.getOrAddField(DefaultIndexingChain.java:472) >> [junit4] > at >> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:341) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:234) >> [junit4] > at >> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:455) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1458) >> [junit4] > at >> org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1237) >> [junit4] > at >> org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:173) >> [junit4] > at >> org.apache.lucene.index.TestIndexWriterDelete$1.run(TestIndexWriterDelete.java:334) >> [junit4] 2> NOTE: test params are: codec=Asserting(Lucene53): >> {field=PostingsFormat(name=LuceneVarGapFixedInterval), city=FST50, >> contents=PostingsFormat(name=LuceneVarGapFixedInterval), id=FST50, >> value=PostingsFormat(name=LuceneFixedGap), >> content=PostingsFormat(name=LuceneFixedGap)}, >> docValues:{dv=DocValuesFormat(name=Memory)}, >> sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {field=DFR >> I(n)L3(800.0), contents=DFR I(ne)B2, city=IB LL-D1, id=DFR G1, content=DFR >> GZ(0.3)}, locale=sq, timezone=Asia/Ashkhabad >> [junit4] 2> NOTE: Linux 3.16.0-41-generic i386/Oracle Corporation >> 1.8.0_60-ea (32-bit)/cpus=12,threads=1,free=32591672,total=115048448 >> [junit4] 2> NOTE: All tests run in this JVM: [TestStressDeletes, >> TestNorms, TestAutomatonQueryUnicode, TestQueryBuilder, >> TestNumericRangeQuery32, TestSpanExplanations, TestDemoParallelLeafReader, >> TestTieredMergePolicy, TestConsistentFieldNumbers, >> TestIndexWriterOnJRECrash, TestQueryWrapperFilter, TestVersion, >> TestBooleanCoord, TestSloppyPhraseQuery, TestFilterLeafReader, >> TestSimpleExplanationsOfNonMatches, TestDeterminism, TestSentinelIntSet, >> TestFixedBitDocIdSet, Test2BPostings, TestBooleanOr, TestScorerPerf, >> TestMaxTermFrequency, TestTermsEnum2, TestTopDocsMerge, >> TestSloppyPhraseQuery2, TestSpans, TestBlockPostingsFormat3, >> TestLogMergePolicy, TestNRTThreads, TestByteBlockPool, >> TestSearchWithThreads, TestBytesRefHash, TestIndexWriterMerging, >> TestComplexExplanations, TestTopFieldCollector, TestAtomicUpdate, >> TestCharsRefBuilder, TestSpansEnum, TestMultiThreadTermVectors, >> TestConjunctionDISI, TestNRTReaderCleanup, TestPositiveScoresOnlyCollector, >> TestSort, TestMatchAllDocsQuery, TestUniqueTermCount, TestSparseFixedBitSet, >> TestReadOnlyIndex, TestRollback, TestBooleanScorer, TestCompiledAutomaton, >> TestScoreCachingWrappingScorer, TestMinShouldMatch2, >> TestBooleanMinShouldMatch, TestTerms, TestCachingTokenFilter, >> TestQueryRescorer, TestReusableStringReader, TestSpanMultiTermQueryWrapper, >> TestLSBRadixSorter, TestTragicIndexWriterDeadlock, TestIntroSorter, >> TestOmitTf, TestCachingCollector, TestConcurrentMergeScheduler, >> TestBinaryTerms, TestIndexWriterReader, TestFSTs, TestMultiMMap, >> TestSearcherManager, TestDeletionPolicy, TestIndexWriterDelete] >> [junit4] Completed [187/398] on J2 in 5.68s, 26 tests, 1 error, 1 skipped >> <<< FAILURES! >> >> [...truncated 695 lines...] >> BUILD FAILED >> /home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:526: The following >> error occurred while executing this line: >> /home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following >> error occurred while executing this line: >> /home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following >> error occurred while executing this line: >> /home/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The >> following error occurred while executing this line: >> /home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:50: The >> following error occurred while executing this line: >> /home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1426: >> The following error occurred while executing this line: >> /home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:981: >> There were test failures: 398 suites, 3200 tests, 1 error, 50 ignored (46 >> assumptions) >> >> Total time: 6 minutes 54 seconds >> Build step 'Invoke Ant' marked build as failure >> Archiving artifacts >> Recording test results >> Email was triggered for: Failure - Any >> Sending email for trigger: Failure - Any >> >> >> >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
