Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21344/ Java: 64bit/jdk-10-ea+37 -XX:-UseCompressedOops -XX:+UseG1GC
5 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest Error Message: Suite timeout exceeded (>= 7200000 msec). Stack Trace: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger Error Message: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger: 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) at java.base@10-ea/java.lang.Thread.run(Thread.java:844) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger: 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) at java.base@10-ea/java.lang.Thread.run(Thread.java:844) at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger Error Message: There are still zombie threads that couldn't be terminated: 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) at java.base@10-ea/java.lang.Thread.run(Thread.java:844) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated: 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) at java.base@10-ea/java.lang.Thread.run(Thread.java:844) at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0) FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test Error Message: Test abandoned because suite timeout was reached. Stack Trace: java.lang.Exception: Test abandoned because suite timeout was reached. at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0) FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger Error Message: Stack Trace: java.lang.AssertionError at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66:CAB2E2969626DD29]:0) at org.junit.Assert.fail(Assert.java:92) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.junit.Assert.assertNull(Assert.java:562) at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:564) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.base/java.lang.Thread.run(Thread.java:844) Build Log: [...truncated 11863 lines...] [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger [junit4] 2> 224355 INFO (SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestNodeAddedTrigger_70BED519C9CE0B66-001/init-core-data-001 [junit4] 2> 224355 WARN (SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6 [junit4] 2> 224356 INFO (SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true [junit4] 2> 224356 INFO (SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0) [junit4] 2> 224384 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger [junit4] 2> 224385 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache... [junit4] 2> 224385 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase [junit4] 2> [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############ [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 3 [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 3 [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 1 [junit4] 2> 224675 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10003_solr [junit4] 2> 224676 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [] [junit4] 2> 224676 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0 [junit4] 2> 224676 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0 [junit4] 2> 224676 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 0 [junit4] 2> 224676 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ########## [junit4] 2> 224676 INFO (TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ########### [junit4] 2> 224678 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testListenerAcceptance [junit4] 2> 224678 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache... [junit4] 2> 224679 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Interrupted [junit4] 2> java.lang.InterruptedException [junit4] 2> at java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1259) [junit4] 2> at java.base/java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:317) [junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:154) [junit4] 2> at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testListenerAcceptance [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase [junit4] 2> [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############ [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 2 [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 2 [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 0 [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [] [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0 [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0 [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 0 [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ########## [junit4] 2> 224780 INFO (TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ########### [junit4] 2> 224782 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testRestoreState [junit4] 2> 224782 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache... [junit4] 2> 224782 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed, exiting. [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testRestoreState [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase [junit4] 2> [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############ [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 2 [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 2 [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 0 [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [] [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0 [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0 [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 0 [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ########## [junit4] 2> 224945 INFO (TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ########### [junit4] 2> 224947 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testActionLifecycle [junit4] 2> 224947 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache... [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testActionLifecycle [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase [junit4] 2> [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############ [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 1 [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 1 [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 0 [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [] [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0 [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0 [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 0 [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ########## [junit4] 2> 225048 INFO (TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ########### [junit4] 2> 225049 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 225049 INFO (SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released [junit4] 2> Jan 25, 2018 7:58:50 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> Jan 25, 2018 7:59:10 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger: [junit4] 2> 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] [junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) [junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844) [junit4] 2> Jan 25, 2018 7:59:10 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll [junit4] 2> INFO: Starting to interrupt leaked threads: [junit4] 2> 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] [junit4] 2> Jan 25, 2018 7:59:13 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll [junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated: [junit4] 2> 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] [junit4] 2> at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) [junit4] 2> at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) [junit4] 2> at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) [junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844) [junit4] 2> NOTE: test params are: codec=CheapBastard, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@59c24dc2), locale=hi, timezone=Europe/Bratislava [junit4] 2> NOTE: Linux 4.13.0-31-generic amd64/Oracle Corporation 10-ea (64-bit)/cpus=8,threads=2,free=151319856,total=536870912 [junit4] 2> NOTE: All tests run in this JVM: [TestStressRecovery, TestSolrXml, TestDistribIDF, TestRequestStatusCollectionAPI, TestFieldTypeResource, TestBM25SimilarityFactory, SyncSliceTest, FieldMutatingUpdateProcessorTest, TestStressLiveNodes, TestZkChroot, SOLR749Test, TestLegacyNumericUtils, TestHdfsUpdateLog, HdfsThreadLeakTest, HttpSolrCallGetCoreTest, DirectUpdateHandlerOptimizeTest, DistributedMLTComponentTest, ClassificationUpdateProcessorIntegrationTest, TestNodeAddedTrigger] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestNodeAddedTrigger -Dtests.seed=70BED519C9CE0B66 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hi -Dtests.timezone=Europe/Bratislava -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 0.00s J1 | TestNodeAddedTrigger (suite) <<< [junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger: [junit4] > 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] [junit4] > at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) [junit4] > at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) [junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) [junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) [junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) [junit4] > at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) [junit4] > at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) [junit4] > at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) [junit4] > at java.base@10-ea/java.lang.Thread.run(Thread.java:844) [junit4] > at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated: [junit4] > 1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer autoscaling triggers] [junit4] > at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method) [junit4] > at java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194) [junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883) [junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915) [junit4] > at java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238) [junit4] > at java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280) [junit4] > at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127) [junit4] > at app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502) [junit4] > at app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121) [junit4] > at java.base@10-ea/java.lang.Thread.run(Thread.java:844) [junit4] > at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0) [junit4] Completed [69/768 (1!)] on J1 in 23.78s, 4 tests, 2 errors <<< FAILURES! [...truncated 1708 lines...] [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest [junit4] 2> 453471 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/init-core-data-001 [junit4] 2> 453471 WARN (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9 [junit4] 2> 453471 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true [junit4] 2> 453472 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0) [junit4] 2> 453472 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001 [junit4] 2> 453472 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 453472 INFO (Thread-2728) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 453472 INFO (Thread-2728) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 453473 ERROR (Thread-2728) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 453572 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:40517 [junit4] 2> 453574 INFO (zkConnectionManagerCallback-704-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453575 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 453575 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 453576 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 453576 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 453576 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 453576 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 453576 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 453576 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 453576 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33b873a1{/solr,null,AVAILABLE} [junit4] 2> 453577 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4825d753{HTTP/1.1,[http/1.1]}{127.0.0.1:36043} [junit4] 2> 453577 INFO (jetty-launcher-701-thread-1) [ ] o.e.j.s.Server Started @455248ms [junit4] 2> 453577 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36043} [junit4] 2> 453577 ERROR (jetty-launcher-701-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 453577 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 453577 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 453577 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 453577 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-25T20:02:39.275342Z [junit4] 2> 453577 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@220745c3{/solr,null,AVAILABLE} [junit4] 2> 453578 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@312d53b4{HTTP/1.1,[http/1.1]}{127.0.0.1:41665} [junit4] 2> 453578 INFO (jetty-launcher-701-thread-2) [ ] o.e.j.s.Server Started @455249ms [junit4] 2> 453578 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41665} [junit4] 2> 453578 ERROR (jetty-launcher-701-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 453578 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 453578 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 453578 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 453578 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-25T20:02:39.276491Z [junit4] 2> 453581 INFO (zkConnectionManagerCallback-706-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453581 INFO (zkConnectionManagerCallback-708-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453581 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 453581 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 453591 INFO (jetty-launcher-701-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr [junit4] 2> 453591 INFO (jetty-launcher-701-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr [junit4] 2> 453593 INFO (zkConnectionManagerCallback-714-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453594 INFO (zkConnectionManagerCallback-716-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453594 INFO (zkConnectionManagerCallback-718-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453595 INFO (zkConnectionManagerCallback-720-thread-1-processing-n:127.0.0.1:41665_solr) [n:127.0.0.1:41665_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453625 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:41665_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 453625 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 453626 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36043_solr [junit4] 2> 453626 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:41665_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41665_solr [junit4] 2> 453626 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.Overseer Overseer (id=99412250405830661-127.0.0.1:36043_solr-n_0000000000) starting [junit4] 2> 453627 INFO (zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) [n:127.0.0.1:41665_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 453627 INFO (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 453633 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger [junit4] 2> 453634 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 453634 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36043_solr [junit4] 2> 453634 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:41665_solr] [junit4] 2> 453634 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1 [junit4] 2> 453634 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 453634 INFO (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 453634 INFO (zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) [n:127.0.0.1:41665_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 453637 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 453637 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 453637 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 453659 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:41665_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41665.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453670 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:41665_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41665.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453670 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:41665_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41665.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453671 INFO (jetty-launcher-701-thread-2) [n:127.0.0.1:41665_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node2/. [junit4] 2> 453680 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36043.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453697 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36043.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453697 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36043.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453698 INFO (jetty-launcher-701-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node1/. [junit4] 2> 453724 INFO (zkConnectionManagerCallback-726-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453726 INFO (zkConnectionManagerCallback-730-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453727 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 453727 INFO (SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40517/solr ready [junit4] 2> 453733 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCooldown [junit4] 2> 453733 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2 [junit4] 2> 453733 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2 [junit4] 2> 453733 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2 [junit4] 2> 453734 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 453734 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 453734 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2 [junit4] 2> 453738 INFO (qtp2006514474-6422) [n:127.0.0.1:36043_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 453742 INFO (qtp357965713-6363) [n:127.0.0.1:41665_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 453742 DEBUG (qtp2006514474-6362) [n:127.0.0.1:36043_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 453742 INFO (qtp2006514474-6362) [n:127.0.0.1:36043_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=6 [junit4] 2> 453742 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3 [junit4] 2> 453743 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:41665_solr, 127.0.0.1:36043_solr] [junit4] 2> 453743 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true} [junit4] 2> 453743 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3 [junit4] 2> 453744 INFO (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init [junit4] 2> 453744 INFO (qtp2006514474-6374) [n:127.0.0.1:36043_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 453744 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger [junit4] 2> 453744 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2 [junit4] 2> 453745 INFO (qtp357965713-6371) [n:127.0.0.1:41665_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 453745 DEBUG (qtp2006514474-6370) [n:127.0.0.1:36043_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 453745 INFO (qtp2006514474-6370) [n:127.0.0.1:36043_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=2 [junit4] 2> 453746 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4 [junit4] 2> 453746 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:41665_solr, 127.0.0.1:36043_solr] [junit4] 2> 453746 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true} [junit4] 2> 453746 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 453749 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 453749 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 3 [junit4] 2> 453749 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4 [junit4] 2> 453749 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 453750 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4 [junit4] 2> 453765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 453765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 453765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 453765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@45eb2bb{/solr,null,AVAILABLE} [junit4] 2> 453766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@79d1e2e9{HTTP/1.1,[http/1.1]}{127.0.0.1:41773} [junit4] 2> 453766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server Started @455437ms [junit4] 2> 453766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41773} [junit4] 2> 453766 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 453766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 453766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 453766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 453766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-25T20:02:39.464474Z [junit4] 2> 453772 INFO (zkConnectionManagerCallback-732-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453773 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 453782 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr [junit4] 2> 453783 INFO (zkConnectionManagerCallback-736-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453785 INFO (zkConnectionManagerCallback-738-thread-1-processing-n:127.0.0.1:41773_solr) [n:127.0.0.1:41773_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 453787 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:41773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 453788 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:41773_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 453788 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:41773_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41773_solr [junit4] 2> 453789 INFO (zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) [n:127.0.0.1:41665_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 453789 INFO (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 453793 INFO (zkCallback-729-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 453794 INFO (zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) [n:127.0.0.1:41773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 453820 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:41773_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41773.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453826 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:41773_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41773.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453826 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:41773_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41773.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 453827 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:41773_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node3/. [junit4] 2> 454745 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger [junit4] 2> 454745 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3 [junit4] 2> 454745 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:41773_solr at time 204344772087164 [junit4] 2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger [junit4] 2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3 [junit4] 2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:41773_solr] added at times [204344772087164], now=204345772952955 [junit4] 2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"b9d9b98d4d7cTb49ekn0lnbgypbkl54kbmtxp7", [junit4] 2> "source":"node_added_cooldown_trigger", [junit4] 2> "eventTime":204344772087164, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[204344772087164], [junit4] 2> "nodeNames":["127.0.0.1:41773_solr"]}} [junit4] 2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_cooldown_trigger] [junit4] 2> 455747 INFO (ScheduledTrigger-1686-thread-2) [n:127.0.0.1:36043_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging. [junit4] 2> 455747 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"b9d9b98d4d7cTb49ekn0lnbgypbkl54kbmtxp7", [junit4] 2> "source":"node_added_cooldown_trigger", [junit4] 2> "eventTime":204344772087164, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[204344772087164], [junit4] 2> "_enqueue_time_":204345773330950, [junit4] 2> "nodeNames":["127.0.0.1:41773_solr"]}} [junit4] 2> 455748 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 5000ms [junit4] 2> 455748 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event id=b9d9b98d4d7cTb49ekn0lnbgypbkl54kbmtxp7 [junit4] 2> 456748 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@603cb8bd{/solr,null,AVAILABLE} [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@79908bd0{HTTP/1.1,[http/1.1]}{127.0.0.1:39233} [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server Started @458420ms [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39233} [junit4] 2> 456749 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 456749 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 456750 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 456750 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 456750 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-25T20:02:42.448063Z [junit4] 2> 456751 INFO (zkConnectionManagerCallback-742-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 456751 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 456755 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr [junit4] 2> 456756 INFO (zkConnectionManagerCallback-746-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 456758 INFO (zkConnectionManagerCallback-748-thread-1-processing-n:127.0.0.1:39233_solr) [n:127.0.0.1:39233_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 456760 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:39233_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 456761 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:39233_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 456761 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:39233_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39233_solr [junit4] 2> 456762 INFO (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 456762 INFO (zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) [n:127.0.0.1:41665_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 456762 INFO (zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) [n:127.0.0.1:41773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 456762 INFO (zkCallback-729-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 456762 INFO (zkCallback-747-thread-1-processing-n:127.0.0.1:39233_solr) [n:127.0.0.1:39233_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 456792 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:39233_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39233.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 456797 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:39233_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39233.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 456798 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:39233_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39233.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 456798 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:39233_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node4/. [junit4] 2> 460748 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger [junit4] 2> 460748 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4 [junit4] 2> 460748 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:39233_solr at time 204350775381291 [junit4] 2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger [junit4] 2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4 [junit4] 2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:39233_solr] added at times [204350775381291], now=204351776149936 [junit4] 2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"b9db1f604d2bTb49ekn0lnbgypbkl54kbmtxp9", [junit4] 2> "source":"node_added_cooldown_trigger", [junit4] 2> "eventTime":204350775381291, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[204350775381291], [junit4] 2> "nodeNames":["127.0.0.1:39233_solr"]}} [junit4] 2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_cooldown_trigger] [junit4] 2> 461750 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"b9db1f604d2bTb49ekn0lnbgypbkl54kbmtxp9", [junit4] 2> "source":"node_added_cooldown_trigger", [junit4] 2> "eventTime":204350775381291, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[204350775381291], [junit4] 2> "_enqueue_time_":204351776273800, [junit4] 2> "nodeNames":["127.0.0.1:39233_solr"]}} [junit4] 2> 461750 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 5000ms [junit4] 2> 461750 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=b9db1f604d2bTb49ekn0lnbgypbkl54kbmtxp9 [junit4] 2> 463754 INFO (qtp2006514474-6372) [n:127.0.0.1:36043_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 463755 INFO (qtp54956395-6455) [n:127.0.0.1:39233_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 463757 INFO (qtp357965713-6375) [n:127.0.0.1:41665_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 463758 INFO (qtp422151251-6429) [n:127.0.0.1:41773_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core} status=0 QTime=0 [junit4] 2> 463758 DEBUG (qtp2006514474-6421) [n:127.0.0.1:36043_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 463758 INFO (qtp2006514474-6421) [n:127.0.0.1:36043_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=7 [junit4] 2> 463759 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5 [junit4] 2> 463759 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:41773_solr, 127.0.0.1:39233_solr, 127.0.0.1:41665_solr, 127.0.0.1:36043_solr] [junit4] 2> 463759 DEBUG (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, waitFor=1, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true} [junit4] 2> 463759 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5 [junit4] 2> 463759 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: triggerCooldownPeriodSeconds from: 5 to: 7 [junit4] 2> 463759 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 463760 DEBUG (OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000) [n:127.0.0.1:36043_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5 [junit4] 2> 463760 INFO (qtp2006514474-6370) [n:127.0.0.1:36043_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=0 [junit4] 2> 463760 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 463764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 463764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 463764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session Scavenging every 660000ms [junit4] 2> 463764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22931023{/solr,null,AVAILABLE} [junit4] 2> 463764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@73e9e560{HTTP/1.1,[http/1.1]}{127.0.0.1:33969} [junit4] 2> 463764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server Started @465436ms [junit4] 2> 463764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33969} [junit4] 2> 463764 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 463765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 463765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 463765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 463765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-25T20:02:49.463122Z [junit4] 2> 463766 INFO (zkConnectionManagerCallback-752-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 463766 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 463770 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr [junit4] 2> 463771 INFO (zkConnectionManagerCallback-756-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 463773 INFO (zkConnectionManagerCallback-758-thread-1-processing-n:127.0.0.1:33969_solr) [n:127.0.0.1:33969_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 463775 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:33969_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 463775 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:33969_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 463776 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:33969_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33969_solr [junit4] 2> 463777 INFO (zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) [n:127.0.0.1:41665_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 463777 INFO (zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) [n:127.0.0.1:41773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 463777 INFO (zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 463777 INFO (zkCallback-729-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 463777 INFO (zkCallback-747-thread-1-processing-n:127.0.0.1:39233_solr) [n:127.0.0.1:39233_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 463777 INFO (zkCallback-757-thread-1-processing-n:127.0.0.1:33969_solr) [n:127.0.0.1:33969_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5) [junit4] 2> 463804 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:33969_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33969.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 463810 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:33969_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33969.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 463810 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:33969_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33969.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff [junit4] 2> 463811 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:33969_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node5/. [junit4] 2> 466750 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger [junit4] 2> 466750 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5 [junit4] 2> 466750 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:33969_solr at time 204356777593793 [junit4] 2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_cooldown_trigger [junit4] 2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5 [junit4] 2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_cooldown_trigger firing registered processor for nodes: [127.0.0.1:33969_solr] added at times [204356777593793], now=204357778344298 [junit4] 2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"b9dc8522cbc1Tb49ekn0lnbgypbkl54kbmtxpa", [junit4] 2> "source":"node_added_cooldown_trigger", [junit4] 2> "eventTime":204356777593793, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[204356777593793], [junit4] 2> "nodeNames":["127.0.0.1:33969_solr"]}} [junit4] 2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_added_cooldown_trigger] [junit4] 2> 467752 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"b9dc8522cbc1Tb49ekn0lnbgypbkl54kbmtxpa", [junit4] 2> "source":"node_added_cooldown_trigger", [junit4] 2> "eventTime":204356777593793, [junit4] 2> "eventType":"NODEADDED", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[204356777593793], [junit4] 2> "_enqueue_time_":204357778476464, [junit4] 2> "nodeNames":["127.0.0.1:33969_solr"]}} [junit4] 2> 467752 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_cooldown_trigger after 7000ms [junit4] 2> 467752 DEBUG (AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) [n:127.0.0.1:36043_solr ] o.a.s.c.a.ScheduledTriggers -- processing took 0 ms for event id=b9dc8522cbc1Tb49ekn0lnbgypbkl54kbmtxpa [junit4] 2> 467752 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 467753 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 467753 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 467753 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 467753 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d0bbc2b{/solr,null,AVAILABLE} [junit4] 2> 467753 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@416bb1a2{HTTP/1.1,[http/1.1]}{127.0.0.1:38959} [junit4] 2> 467753 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.e.j.s.Server Started @469425ms [junit4] 2> 467754 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38959} [junit4] 2> 467754 ERROR (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 467754 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 467754 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 467754 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 467754 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-25T20:02:53.452311Z [junit4] 2> 467755 INFO (zkConnectionManagerCallback-762-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 467755 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 467759 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr [junit4] 2> 467760 INFO (zkConnectionManagerCallback-766-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 467762 INFO (zkConnectionManagerCallback-768-thread-1-processing-n:127.0.0.1:38959_solr) [n:127.0.0.1:38959_solr ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 467764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:38959_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5) [junit4] 2> 467764 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:38959_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 467765 INFO (TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [n:127.0.0.1:38959_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38959_solr [junit4] 2> 467766 INFO (zkCallback-757-thread-1-processing-n:127.0.0.1:33969_solr) [n:127.0.0.1:33969_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 467766 INFO (zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) [n:127.0.0.1:41665_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 467766 INFO (zkCallback-747-thread-1-processing-n:127.0.0.1:39233_solr) [n:127.0.0.1:39233_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 467766 INFO (zkCallback-729-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6) [junit4] 2> 467766 INFO (zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) [n:127.0.0.1:41773_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKe [...truncated too long message...] tAllByName0(InetAddress.java:1415) [junit4] 2> at java.base@10-ea/java.net.SocketPermission.getIP(SocketPermission.java:796) [junit4] 2> at java.base@10-ea/java.net.SocketPermission.impliesIgnoreMask(SocketPermission.java:958) [junit4] 2> at java.base@10-ea/java.net.SocketPermissionCollection.implies(SocketPermission.java:1417) [junit4] 2> at java.base@10-ea/java.security.Permissions.implies(Permissions.java:179) [junit4] 2> at java.base@10-ea/sun.security.provider.PolicyFile.implies(PolicyFile.java:1037) [junit4] 2> at java.base@10-ea/java.security.ProtectionDomain.implies(ProtectionDomain.java:308) [junit4] 2> at java.base@10-ea/java.security.ProtectionDomain.impliesWithAltFilePerm(ProtectionDomain.java:340) [junit4] 2> at java.base@10-ea/java.security.AccessControlContext.checkPermission(AccessControlContext.java:450) [junit4] 2> at java.base@10-ea/java.security.AccessController.checkPermission(AccessController.java:895) [junit4] 2> at java.base@10-ea/java.lang.SecurityManager.checkPermission(SecurityManager.java:335) [junit4] 2> at java.base@10-ea/java.lang.SecurityManager.checkConnect(SecurityManager.java:837) [junit4] 2> at java.base@10-ea/java.net.Socket.connect(Socket.java:584) [junit4] 2> at java.base@10-ea/java.net.Socket.connect(Socket.java:540) [junit4] 2> at java.base@10-ea/java.net.Socket.<init>(Socket.java:436) [junit4] 2> at java.base@10-ea/java.net.Socket.<init>(Socket.java:213) [junit4] 2> at app//org.apache.solr.cloud.ZkTestServer.send4LetterWord(ZkTestServer.java:579) [junit4] 2> at app//org.apache.solr.cloud.ZkTestServer.waitForServerDown(ZkTestServer.java:539) [junit4] 2> at app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.shutdown(ZkTestServer.java:337) [junit4] 2> at app//org.apache.solr.cloud.ZkTestServer.shutdown(ZkTestServer.java:526) [junit4] 2> at app//org.apache.solr.cloud.AbstractDistribZkTestBase.distribTearDown(AbstractDistribZkTestBase.java:318) [junit4] 2> at app//org.apache.solr.cloud.AbstractFullDistribZkTestBase.distribTearDown(AbstractFullDistribZkTestBase.java:1575) [junit4] 2> at app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:970) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [junit4] 2> at app//org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) [junit4] 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at app//org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [junit4] 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) [junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) [junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) [junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) [junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) [junit4] 2> at app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) [junit4] 2> at app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at app//org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at app//org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) [junit4] 2> at app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) [junit4] 2> at app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) [junit4] 2> at app//org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) [junit4] 2> at app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4] 2> at app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) [junit4] 2> at java.base@10-ea/java.lang.Thread.run(Thread.java:844) [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=BlockTreeOrds(blocksize=128), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=BlockTreeOrds(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Memory), a_i=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1424, maxMBSortInHeap=5.489195478434274, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@9c63453), locale=es-VE, timezone=Asia/Hovd [junit4] 2> NOTE: Linux 4.13.0-31-generic amd64/Oracle Corporation 10-ea (64-bit)/cpus=8,threads=2,free=214771392,total=314572800 [junit4] 2> NOTE: All tests run in this JVM: [DebugComponentTest, TestDocumentBuilder, TestMiniSolrCloudClusterSSL, ForceLeaderTest, TestZkAclsWithHadoopAuth, DistributedExpandComponentTest, TestSolrConfigHandler, ManagedSchemaRoundRobinCloudTest, RequestHandlersTest, OverseerCollectionConfigSetProcessorTest, TestXmlQParserPlugin, MetricsConfigTest, CollectionTooManyReplicasTest, TestLargeCluster, SpellingQueryConverterTest, TestLegacyNumericRangeQueryBuilder, MoveReplicaHDFSTest, TestDefaultStatsCache, HdfsSyncSliceTest, TestApiFramework, TestRTimerTree, TestBlendedInfixSuggestions, TestDistribStateManager, TestMergePolicyConfig, TermVectorComponentDistributedTest, FieldAnalysisRequestHandlerTest, TestRestoreCore, TestLMDirichletSimilarityFactory, TestHighFrequencyDictionaryFactory, TestBinaryResponseWriter, CloudExitableDirectoryReaderTest, TestRandomRequestDistribution, TriggerIntegrationTest, TestCloudRecovery, TestPayloadCheckQParserPlugin, ShardRoutingTest, ExternalFileFieldSortTest, TestPushWriter, TestRandomFaceting, OpenExchangeRatesOrgProviderTest, UtilsToolTest, AddSchemaFieldsUpdateProcessorFactoryTest, ClassificationUpdateProcessorFactoryTest, ChaosMonkeySafeLeaderWithPullReplicasTest] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderWithPullReplicasTest -Dtests.seed=70BED519C9CE0B66 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-VE -Dtests.timezone=Asia/Hovd -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] ERROR 0.00s J0 | ChaosMonkeySafeLeaderWithPullReplicasTest (suite) <<< [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). [junit4] > at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0) [junit4] Completed [685/768 (3!)] on J0 in 7223.73s, 1 test, 2 errors <<< FAILURES! [...truncated 256 lines...] [junit4] JVM J0: stdout was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20180125_195503_99017611083384496915955.sysout [junit4] >>> JVM J0 emitted unexpected output (verbatim) ---- [junit4] java.lang.OutOfMemoryError: Java heap space [junit4] Dumping heap to /home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps/java_pid19789.hprof ... [junit4] Heap dump file created [326570131 bytes in 0.485 secs] [junit4] <<< JVM J0: EOF ---- [...truncated 8582 lines...] BUILD FAILED /home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:836: The following error occurred while executing this line: /home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:788: Some of the tests produced a heap dump, but did not fail. Maybe a suppressed OutOfMemoryError? Dumps created: * java_pid19789.hprof Total time: 163 minutes 21 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts [WARNINGS] Skipping publisher since build result is FAILURE Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org