Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/266/
5 tests failed. FAILED: org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit Error Message: this IndexWriter is closed Stack Trace: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) at org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit(TestIndexingSequenceNumbers.java:230) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.OutOfMemoryError: Java heap space at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208) FAILED: org.apache.lucene.search.TestFuzzyQuery.testRandom Error Message: Test abandoned because suite timeout was reached. Stack Trace: java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) FAILED: junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler Error Message: ObjectTracker found 7 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) Stack Trace: java.lang.AssertionError: ObjectTracker found 7 object(s) that were not released!!! [NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory, NRTCachingDirectory] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:43) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347) at org.apache.solr.core.MetricsDirectoryFactory.get(MetricsDirectoryFactory.java:201) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:249) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397) at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$0(ReplicationHandler.java:279) at java.lang.Thread.run(Thread.java:745) at __randomizedtesting.SeedInfo.seed([587FB499D0557722]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:269) at sun.reflect.GeneratedMethodAccessor23.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:745) FAILED: org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test Error Message: Stack Trace: java.lang.AssertionError at __randomizedtesting.SeedInfo.seed([587FB499D0557722:D02B8B437EA91ADA]:0) at org.junit.Assert.fail(Assert.java:92) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertTrue(Assert.java:54) at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.test(HdfsWriteToMultipleCollectionsTest.java:137) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 978 lines...] [junit4] Suite: org.apache.lucene.index.TestIndexingSequenceNumbers [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestIndexingSequenceNumbers -Dtests.method=testStressConcurrentCommit -Dtests.seed=9D92D2FD78C8F5D3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=it-CH -Dtests.timezone=Africa/Nairobi -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 517s J0 | TestIndexingSequenceNumbers.testStressConcurrentCommit <<< [junit4] > Throwable #1: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers.testStressConcurrentCommit(TestIndexingSequenceNumbers.java:230) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1049, name=Thread-915, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at java.util.HashMap.newNode(HashMap.java:1742) [junit4] > at java.util.HashMap.putVal(HashMap.java:641) [junit4] > at java.util.HashMap.put(HashMap.java:611) [junit4] > at java.util.HashSet.add(HashSet.java:219) [junit4] > at java.util.AbstractCollection.addAll(AbstractCollection.java:344) [junit4] > at org.apache.lucene.index.SegmentInfos.files(SegmentInfos.java:790) [junit4] > at org.apache.lucene.index.IndexFileDeleter.incRef(IndexFileDeleter.java:552) [junit4] > at org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:519) [junit4] > at org.apache.lucene.index.IndexWriter.checkpointNoSIS(IndexWriter.java:2485) [junit4] > at org.apache.lucene.index.IndexWriter$ReaderPool.commit(IndexWriter.java:672) [junit4] > at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:3017) [junit4] > at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:3236) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3199) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1047, name=Thread-913, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #4: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1042, name=Thread-908, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #5: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1044, name=Thread-910, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1048, name=Thread-914, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1041, name=Thread-907, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #8: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1050, name=Thread-916, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #9: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1046, name=Thread-912, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.RuntimeException: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:218) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter is closed [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:753) [junit4] > at org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:767) [junit4] > at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:3198) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:186) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #10: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1043, name=Thread-909, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.OutOfMemoryError: GC overhead limit exceededThrowable #11: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3163, name=Lucene Merge Thread #2112, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:668) [junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:648) [junit4] > Caused by: org.apache.lucene.store.AlreadyClosedException: refusing to delete any files: this IndexWriter hit an unrecoverable exception [junit4] > at org.apache.lucene.index.IndexFileDeleter.ensureOpen(IndexFileDeleter.java:345) [junit4] > at org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:696) [junit4] > at org.apache.lucene.index.IndexFileDeleter.deleteNewFiles(IndexFileDeleter.java:691) [junit4] > at org.apache.lucene.index.IndexWriter.deleteNewFiles(IndexWriter.java:4948) [junit4] > at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4426) [junit4] > at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3924) [junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588) [junit4] > at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626) [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208)Throwable #12: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1045, name=Thread-911, state=RUNNABLE, group=TGRP-TestIndexingSequenceNumbers] [junit4] > Caused by: java.lang.OutOfMemoryError: Java heap space [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsIndexWriter.<init>(CompressingStoredFieldsIndexWriter.java:94) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:127) [junit4] > at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) [junit4] > at org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) [junit4] > at org.apache.lucene.codecs.asserting.AssertingStoredFieldsFormat.fieldsWriter(AssertingStoredFieldsFormat.java:48) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) [junit4] > at org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:364) [junit4] > at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:398) [junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.updateDocuments(DocumentsWriterPerThread.java:273) [junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocuments(DocumentsWriter.java:433) [junit4] > at org.apache.lucene.index.IndexWriter.updateDocuments(IndexWriter.java:1392) [junit4] > at org.apache.lucene.index.TestIndexingSequenceNumbers$2.run(TestIndexingSequenceNumbers.java:208) [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/J0/temp/lucene.index.TestIndexingSequenceNumbers_9D92D2FD78C8F5D3-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62), sim=RandomSimilarity(queryNorm=false,coord=yes): {id=IB SPL-D1}, locale=it-CH, timezone=Africa/Nairobi [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=1,free=43866488,total=497549312 [junit4] 2> NOTE: All tests run in this JVM: [TestIndexWriterOnVMError, TestIndexWriterExceptions2, TestMaxTermFrequency, TestDocIdSetBuilder, TestDemo, TestFieldValueQuery, TestTransactions, TestClassicSimilarity, TestOfflineSorter, TestElevationComparator, TestCharsRef, TestCustomSearcherSort, TestSearchForDuplicates, TestComplexExplanationsOfNonMatches, TestPointValues, TestByteSlices, TestSortedNumericSortField, TestStandardAnalyzer, TestMinimize, TestSegmentMerger, TestSimpleExplanations, TestNoDeletionPolicy, TestNRTReaderCleanup, TestNumericTokenStream, TestBlendedTermQuery, Test2BDocs, TestSegmentInfos, TestPrefixCodedTerms, TestSpanCollection, TestNRTCachingDirectory, TestBKD, TestFieldMaskingSpanQuery, TestStressIndexing2, TestNumericRangeQuery64, TestLucene50CompoundFormat, TestDocBoost, TestGrowableByteArrayDataOutput, TestIndexingSequenceNumbers] [junit4] Completed [211/451 (1!)] on J0 in 647.04s, 8 tests, 1 error <<< FAILURES! [...truncated 843 lines...] [junit4] Suite: org.apache.lucene.search.TestFuzzyQuery [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.method=testRandom -Dtests.seed=9D92D2FD78C8F5D3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=sr-Latn-BA -Dtests.timezone=Australia/Adelaide -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 7200s J0 | TestFuzzyQuery.testRandom <<< [junit4] > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached. [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1914, maxMBSortInHeap=7.541613537430758, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=sr-Latn-BA, timezone=Australia/Adelaide [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=76516280,total=497549312 [junit4] 2> NOTE: All tests run in this JVM: [TestIndexWriterOnVMError, TestIndexWriterExceptions2, TestMaxTermFrequency, TestDocIdSetBuilder, TestDemo, TestFieldValueQuery, TestTransactions, TestClassicSimilarity, TestOfflineSorter, TestElevationComparator, TestCharsRef, TestCustomSearcherSort, TestSearchForDuplicates, TestComplexExplanationsOfNonMatches, TestPointValues, TestByteSlices, TestSortedNumericSortField, TestStandardAnalyzer, TestMinimize, TestSegmentMerger, TestSimpleExplanations, TestNoDeletionPolicy, TestNRTReaderCleanup, TestNumericTokenStream, TestBlendedTermQuery, Test2BDocs, TestSegmentInfos, TestPrefixCodedTerms, TestSpanCollection, TestNRTCachingDirectory, TestBKD, TestFieldMaskingSpanQuery, TestStressIndexing2, TestNumericRangeQuery64, TestLucene50CompoundFormat, TestDocBoost, TestGrowableByteArrayDataOutput, TestIndexingSequenceNumbers, TestThreadedForceMerge, TestPrefixQuery, TestSpansEnum, TestDoubleValuesSource, TestDocValuesScoring, TestIndexableField, TestNRTThreads, TestDeletionPolicy, TestIndexFileDeleter, TestReqExclBulkScorer, TestGraphTokenStreamFiniteStrings, TestFuzzyQuery] [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestFuzzyQuery -Dtests.seed=9D92D2FD78C8F5D3 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt -Dtests.locale=sr-Latn-BA -Dtests.timezone=Australia/Adelaide -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 0.00s J0 | TestFuzzyQuery (suite) <<< [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). [junit4] > at __randomizedtesting.SeedInfo.seed([9D92D2FD78C8F5D3]:0) [junit4] Completed [425/451 (2!)] on J0 in 7223.78s, 1 test, 2 errors <<< FAILURES! [...truncated 83 lines...] [junit4] JVM J0: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/temp/junit4-J0-20170124_184223_1256545490122415439507.sysout [junit4] >>> JVM J0 emitted unexpected output (verbatim) ---- [junit4] java.lang.OutOfMemoryError: Java heap space [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/heapdumps/java_pid30618.hprof ... [junit4] Heap dump file created [539236366 bytes in 3.478 secs] [junit4] <<< JVM J0: EOF ---- [junit4] JVM J0: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/core/test/temp/junit4-J0-20170124_184223_1258953189232820236377.syserr [junit4] >>> JVM J0 emitted unexpected output (verbatim) ---- [junit4] [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-915" [junit4] [junit4] Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Thread-913" [junit4] <<< JVM J0: EOF ---- [...truncated 11057 lines...] [junit4] Suite: org.apache.solr.handler.TestReplicationHandler [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/init-core-data-001 [junit4] 2> 569498 INFO (SUITE-TestReplicationHandler-seed#[587FB499D0557722]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None) [junit4] 2> 569511 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.SolrTestCaseJ4 ###Starting doTestReplicateAfterWrite2Slave [junit4] 2> 569511 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/collection1 [junit4] 2> 569526 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 569713 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c77faff{/solr,null,AVAILABLE} [junit4] 2> 569714 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@51667b47{HTTP/1.1,[http/1.1]}{127.0.0.1:55657} [junit4] 2> 569714 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.Server Started @573903ms [junit4] 2> 569714 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=55657} [junit4] 2> 569714 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 569714 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0 [junit4] 2> 569714 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null [junit4] 2> 569714 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 569714 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-25T00:25:46.313Z [junit4] 2> 569715 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/solr.xml [junit4] 2> 569736 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 569747 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/. [junit4] 2> 569747 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 569821 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0 [junit4] 2> 569858 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 569861 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id [junit4] 2> 569863 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/./collection1 [junit4] 2> 569863 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/./collection1/data/] [junit4] 2> 569889 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=58.7490234375, floorSegmentMB=2.12890625, forceMergeDeletesPctAllowed=2.3170276999228, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6031755985681237 [junit4] 2> 569940 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 569940 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 569941 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=32.47265625, floorSegmentMB=1.2607421875, forceMergeDeletesPctAllowed=5.37906179917694, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 569941 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@59701ae5[collection1] main] [junit4] 2> 569942 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-001/collection1/conf [junit4] 2> 569942 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema.xml,xslt/dummy.xsl [junit4] 2> 569942 INFO (coreLoadExecutor-2354-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 569943 INFO (searcherExecutor-2355-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@59701ae5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 571236 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/collection1 [junit4] 2> 571252 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028 [junit4] 2> 571342 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@156dc13a{/solr,null,AVAILABLE} [junit4] 2> 571342 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@58539f77{HTTP/1.1,[http/1.1]}{127.0.0.1:57978} [junit4] 2> 571342 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.e.j.s.Server Started @575531ms [junit4] 2> 571342 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=57978} [junit4] 2> 571342 ERROR (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 571342 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 6.5.0 [junit4] 2> 571343 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null [junit4] 2> 571343 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 571343 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-01-25T00:25:47.942Z [junit4] 2> 571343 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/solr.xml [junit4] 2> 571364 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 571383 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/. [junit4] 2> 571384 INFO (TEST-TestReplicationHandler.doTestReplicateAfterWrite2Slave-seed#[587FB499D0557722]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1] [junit4] 2> 571416 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.5.0 [junit4] 2> 571443 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 571450 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.2 with uniqueid field id [junit4] 2> 571451 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/./collection1 [junit4] 2> 571451 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/./collection1/data/] [junit4] 2> 571474 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=58.7490234375, floorSegmentMB=2.12890625, forceMergeDeletesPctAllowed=2.3170276999228, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6031755985681237 [junit4] 2> 571544 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 571544 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 571545 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=32.47265625, floorSegmentMB=1.2607421875, forceMergeDeletesPctAllowed=5.37906179917694, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 571568 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@68096cf0[collection1] main] [junit4] 2> 571569 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler_587FB499D0557722-001/solr-instance-002/collection1/conf [junit4] 2> 571584 INFO (coreLoadExecutor-2364-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 1000ms [junit4] 2> 571584 INFO (searcherExecutor-2365-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@68096cf0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 571621 INFO (qtp104890562-5853) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0 [junit4] 2> 571622 INFO (indexFetcher-2369-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1 [junit4] 2> 571622 INFO (indexFetcher-2369-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 0 [junit4] 2> 571622 INFO (indexFetcher-2369-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1 [junit4] 2> 572237 INFO (qtp104890562-5851) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0 [junit4] 2> 572241 INFO (qtp104890562-5851) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 1 [junit4] 2> 572245 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0 [junit4] 2> 572247 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0 [junit4] 2> 572250 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 1 [junit4] 2> 572255 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0 [junit4] 2> 572257 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0 [junit4] 2> 572259 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0 [junit4] 2> 572262 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 1 [junit4] 2> 572264 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0 [junit4] 2> 572268 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0 [junit4] 2> 572270 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0 [junit4] 2> 572273 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 1 [junit4] 2> 572276 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0 [junit4] 2> 572284 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0 [junit4] 2> 572286 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0 [junit4] 2> 572289 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 1 [junit4] 2> 572291 INFO (qtp104890562-5851) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0 [junit4] 2> 572293 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0 [junit4] 2> 572294 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0 [junit4] 2> 572297 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 1 [junit4] 2> 572299 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0 [junit4] 2> 572301 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0 [junit4] 2> 572305 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0 [junit4] 2> 572313 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 6 [junit4] 2> 572316 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0 [junit4] 2> 572317 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0 [junit4] 2> 572319 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0 [junit4] 2> 572322 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 1 [junit4] 2> 572324 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0 [junit4] 2> 572326 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0 [junit4] 2> 572328 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0 [junit4] 2> 572331 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 1 [junit4] 2> 572333 INFO (qtp104890562-5851) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0 [junit4] 2> 572334 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0 [junit4] 2> 572336 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0 [junit4] 2> 572341 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 3 [junit4] 2> 572343 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0 [junit4] 2> 572345 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0 [junit4] 2> 572348 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 0 [junit4] 2> 572357 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 3 [junit4] 2> 572359 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0 [junit4] 2> 572361 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0 [junit4] 2> 572363 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 0 [junit4] 2> 572366 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 1 [junit4] 2> 572368 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0 [junit4] 2> 572370 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0 [junit4] 2> 572372 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0 [junit4] 2> 572375 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[47]} 0 1 [junit4] 2> 572377 INFO (qtp104890562-5851) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[48]} 0 0 [junit4] 2> 572378 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[49]} 0 0 [junit4] 2> 572380 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[50]} 0 0 [junit4] 2> 572383 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[51]} 0 1 [junit4] 2> 572385 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[52]} 0 0 [junit4] 2> 572387 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[53]} 0 0 [junit4] 2> 572389 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[54]} 0 0 [junit4] 2> 572392 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[55]} 0 1 [junit4] 2> 572394 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[56]} 0 0 [junit4] 2> 572396 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[57]} 0 0 [junit4] 2> 572397 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[58]} 0 0 [junit4] 2> 572400 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[59]} 0 1 [junit4] 2> 572408 INFO (qtp104890562-5855) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[60]} 0 0 [junit4] 2> 572410 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[61]} 0 0 [junit4] 2> 572412 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[62]} 0 0 [junit4] 2> 572415 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[63]} 0 1 [junit4] 2> 572417 INFO (qtp104890562-5851) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[64]} 0 0 [junit4] 2> 572419 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[65]} 0 0 [junit4] 2> 572420 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[66]} 0 0 [junit4] 2> 572424 INFO (qtp104890562-5856) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[67]} 0 1 [junit4] 2> 572426 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[68]} 0 0 [junit4] 2> 572427 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[69]} 0 0 [junit4] 2> 572429 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[70]} 0 0 [junit4] 2> 572572 INFO (qtp104890562-5853) [ x:collection1] o.a.s.c.S.Request [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0 [junit4] 2> 572573 INFO (indexFetcher-2369-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's generation: 1 [junit4] 2> 572573 INFO (indexFetcher-2369-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Master's version: 0 [junit4] 2> 572573 INFO (indexFetcher-2369-thread-1) [ x:collection1] o.a.s.h.IndexFetcher Slave's generation: 1 [junit4] 2> 572786 INFO (qtp104890562-5857) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[71]} 0 355 [junit4] 2> 572789 INFO (qtp104890562-5850) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[72]} 0 0 [junit4] 2> 572791 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[73]} 0 0 [junit4] 2> 572793 INFO (qtp104890562-5854) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/solr path=/update params={wt=jav [...truncated too long message...] > at > com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546) [junit4] 2> at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:226) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:211) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:463) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:213) [junit4] 2> at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:594) [junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72) [junit4] 2> at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68) [junit4] 2> at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:171) [junit4] 2> at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:872) [junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1726) [junit4] 2> at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1705) [junit4] 2> at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:198) [junit4] 2> at org.apache.solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest.teardownClass(HdfsWriteToMultipleCollectionsTest.java:73) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] 2> at java.lang.reflect.Method.invoke(Method.java:498) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713) [junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:870) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> Caused by: java.lang.NullPointerException [junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:203) [junit4] 2> at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3370) [junit4] 2> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:5729) [junit4] 2> ... 53 more [junit4] 2> 6279827 INFO (SUITE-HdfsWriteToMultipleCollectionsTest-seed#[587FB499D0557722]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsWriteToMultipleCollectionsTest_587FB499D0557722-001 [junit4] 2> Jan 25, 2017 2:00:56 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 34 leaked thread(s). [junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=ko, timezone=Pacific/Midway [junit4] 2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 1.8.0_102 (64-bit)/cpus=4,threads=2,free=73988840,total=527433728 [junit4] 2> NOTE: All tests run in this JVM: [TestIntervalFaceting, HLLUtilTest, ZkControllerTest, TestElisionMultitermQuery, TestFieldTypeCollectionResource, DistributedFacetPivotSmallTest, CSVRequestHandlerTest, TestRawResponseWriter, ZkCLITest, DistributedQueryComponentOptimizationTest, DocValuesNotIndexedTest, TestLuceneMatchVersion, TestSolrConfigHandlerConcurrent, TestRestManager, TestGraphMLResponseWriter, TestChildDocTransformer, TestBulkSchemaConcurrent, UpdateRequestProcessorFactoryTest, SortByFunctionTest, TestQueryWrapperFilter, WordBreakSolrSpellCheckerTest, TestQueryUtils, SuggesterFSTTest, TestDownShardTolerantSearch, DistributedIntervalFacetingTest, LeaderElectionContextKeyTest, TestSortByMinMaxFunction, TestMissingGroups, AnalysisErrorHandlingTest, TestLMDirichletSimilarityFactory, TestConfigSetsAPI, TestManagedSchemaAPI, EchoParamsTest, ConjunctionSolrSpellCheckerTest, ReplicaListTransformerTest, BasicFunctionalityTest, HdfsDirectoryTest, ShardRoutingTest, SolrXmlInZkTest, ZkStateReaderTest, TestHashPartitioner, HdfsRecoveryZkTest, SolrSlf4jReporterTest, ConfigSetsAPITest, AddSchemaFieldsUpdateProcessorFactoryTest, TestUniqueKeyFieldResource, TestSweetSpotSimilarityFactory, SolrInfoMBeanTest, TestLRUStatsCache, URLClassifyProcessorTest, TestHashQParserPlugin, TestReRankQParserPlugin, TestFiltering, DistributedFacetPivotLargeTest, TestExceedMaxTermLength, TestFieldCacheSort, TestDistribIDF, MissingSegmentRecoveryTest, TestBlobHandler, TestSearchPerf, DirectoryFactoryTest, LeaderInitiatedRecoveryOnCommitTest, TestPerFieldSimilarityWithDefaultOverride, TestScoreJoinQPNoScore, TestSurroundQueryParser, TestLocalFSCloudBackupRestore, DocValuesTest, RuleEngineTest, SpellCheckComponentTest, TestReplicaProperties, DirectSolrSpellCheckerTest, TestSerializedLuceneMatchVersion, PeerSyncWithIndexFingerprintCachingTest, TestWordDelimiterFilterFactory, TestSolrCloudSnapshots, JavabinLoaderTest, OverseerRolesTest, SolrGangliaReporterTest, TestSchemalessBufferedUpdates, AliasIntegrationTest, OpenCloseCoreStressTest, SpellCheckCollatorTest, RollingRestartTest, TermVectorComponentTest, TestCopyFieldCollectionResource, HdfsThreadLeakTest, TestDistributedGrouping, SolrMetricManagerTest, ClassificationUpdateProcessorIntegrationTest, SearchHandlerTest, TestSchemaResource, PreAnalyzedUpdateProcessorTest, DirectSolrConnectionTest, HighlighterTest, TestSubQueryTransformerDistrib, TestComplexPhraseLeadingWildcard, HdfsBasicDistributedZkTest, IndexBasedSpellCheckerTest, TestCloudRecovery, DistributedTermsComponentTest, TestXmlQParser, TestSQLHandler, TestConfigSetImmutable, ZkSolrClientTest, TestNamedUpdateProcessors, TestNumericTerms64, ShardSplitTest, TestBM25SimilarityFactory, CollectionsAPIAsyncDistributedZkTest, TestSearcherReuse, TestExpandComponent, SimpleCollectionCreateDeleteTest, TestQueryTypes, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, CollectionReloadTest, CollectionStateFormat2Test, CollectionTooManyReplicasTest, ConnectionManagerTest, CreateCollectionCleanupTest, CustomCollectionTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DeleteShardTest, DeleteStatusTest, DistribCursorPagingTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnShardRestartTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, OverseerStatusTest, ReplaceNodeTest, RestartWhileUpdatingTest, TestCloudDeleteByQuery, TestCloudInspectUtil, TestCloudPivotFacet, TestCloudPseudoReturnFields, TestClusterProperties, TestCollectionAPI, TestHdfsCloudBackupRestore, TestLeaderElectionZkExpiry, TestRandomFlRTGCloud, TestTolerantUpdateProcessorCloud, TlogReplayBufferedWhileIndexingTest, HdfsNNFailoverTest, HdfsRecoverLeaseTest, HdfsRestartWhileUpdatingTest, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest] [junit4] Completed [513/681 (2!)] on J1 in 47.17s, 1 test, 1 failure <<< FAILURES! [...truncated 12220 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:783: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:727: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created: * java_pid30618.hprof Total time: 468 minutes 49 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org