Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21344/
Java: 64bit/jdk-10-ea+37 -XX:-UseCompressedOops -XX:+UseG1GC

5 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger:     1) 
Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, 
group=Simulated Overseer autoscaling triggers]         at 
java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
         at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger: 
   1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, 
state=WAITING, group=Simulated Overseer autoscaling triggers]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
        at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
        at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
        at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
        at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
        at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
        at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, state=WAITING, 
group=Simulated Overseer autoscaling triggers]         at 
java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)         at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
         at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
         at java.base@10-ea/java.lang.Thread.run(Thread.java:844)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=9163, name=Simulated OverseerAutoScalingTriggerThread, 
state=WAITING, group=Simulated Overseer autoscaling triggers]
        at java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
        at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
        at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
        at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
        at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
        at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
        at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
        at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
        at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
        at java.base@10-ea/java.lang.Thread.run(Thread.java:844)
        at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)


FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)


FAILED:  
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([70BED519C9CE0B66:CAB2E2969626DD29]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.junit.Assert.assertNull(Assert.java:562)
        at 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 11863 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger
   [junit4]   2> 224355 INFO  
(SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.sim.TestNodeAddedTrigger_70BED519C9CE0B66-001/init-core-data-001
   [junit4]   2> 224355 WARN  
(SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> 224356 INFO  
(SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 224356 INFO  
(SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 224384 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testTrigger
   [junit4]   2> 224385 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing 
object cache...
   [junit4]   2> 224385 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testTrigger
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase 
   [junit4]   2> 
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes:            3
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes:   3
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes:            1
   [junit4]   2> 224675 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ##                127.0.0.1:10003_solr
   [junit4]   2> 224676 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Collections:   []
   [junit4]   2> 224676 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0
   [junit4]   2> 224676 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0
   [junit4]   2> 224676 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas:                0
   [junit4]   2> 224676 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
   [junit4]   2> 224676 INFO  
(TEST-TestNodeAddedTrigger.testTrigger-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
   [junit4]   2> 224678 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.SolrTestCaseJ4 ###Starting testListenerAcceptance
   [junit4]   2> 224678 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing 
object cache...
   [junit4]   2> 224679 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2>        at 
java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireInterruptibly(AbstractQueuedSynchronizer.java:1259)
   [junit4]   2>        at 
java.base/java.util.concurrent.locks.ReentrantLock.lockInterruptibly(ReentrantLock.java:317)
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:154)
   [junit4]   2>        at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.SolrTestCaseJ4 ###Ending testListenerAcceptance
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase 
   [junit4]   2> 
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes:         2
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes:        2
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes:         0
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections:        []
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node:      0
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node:      0
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas:             0
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
   [junit4]   2> 224780 INFO  
(TEST-TestNodeAddedTrigger.testListenerAcceptance-seed#[70BED519C9CE0B66]) [    
] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts 
###########
   [junit4]   2> 224782 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testRestoreState
   [junit4]   2> 224782 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing 
object cache...
   [junit4]   2> 224782 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed, 
exiting.
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testRestoreState
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase 
   [junit4]   2> 
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes:               2
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes:      2
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes:               0
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Collections:      []
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node:    0
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node:    0
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas:           0
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
   [junit4]   2> 224945 INFO  
(TEST-TestNodeAddedTrigger.testRestoreState-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
   [junit4]   2> 224947 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testActionLifecycle
   [junit4]   2> 224947 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing 
object cache...
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testActionLifecycle
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase 
   [junit4]   2> 
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase #############################################
   [junit4]   2> 
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes:            1
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes:   1
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes:            0
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Collections:   []
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 0
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas:                0
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ##########
   [junit4]   2> 225048 INFO  
(TEST-TestNodeAddedTrigger.testActionLifecycle-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ###########
   [junit4]   2> 225049 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 225049 INFO  
(SUITE-TestNodeAddedTrigger-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ------------------------------------------------------- 
Done waiting for tracked resources to be released
   [junit4]   2> Jan 25, 2018 7:58:50 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> Jan 25, 2018 7:59:10 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger: 
   [junit4]   2>    1) Thread[id=9163, name=Simulated 
OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer 
autoscaling triggers]
   [junit4]   2>         at 
java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
   [junit4]   2>         at 
java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Jan 25, 2018 7:59:10 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=9163, name=Simulated 
OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer 
autoscaling triggers]
   [junit4]   2> Jan 25, 2018 7:59:13 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=9163, name=Simulated 
OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer 
autoscaling triggers]
   [junit4]   2>         at 
java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
   [junit4]   2>         at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
   [junit4]   2>         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
   [junit4]   2>         at 
java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@59c24dc2),
 locale=hi, timezone=Europe/Bratislava
   [junit4]   2> NOTE: Linux 4.13.0-31-generic amd64/Oracle Corporation 10-ea 
(64-bit)/cpus=8,threads=2,free=151319856,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestStressRecovery, 
TestSolrXml, TestDistribIDF, TestRequestStatusCollectionAPI, 
TestFieldTypeResource, TestBM25SimilarityFactory, SyncSliceTest, 
FieldMutatingUpdateProcessorTest, TestStressLiveNodes, TestZkChroot, 
SOLR749Test, TestLegacyNumericUtils, TestHdfsUpdateLog, HdfsThreadLeakTest, 
HttpSolrCallGetCoreTest, DirectUpdateHandlerOptimizeTest, 
DistributedMLTComponentTest, ClassificationUpdateProcessorIntegrationTest, 
TestNodeAddedTrigger]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestNodeAddedTrigger -Dtests.seed=70BED519C9CE0B66 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hi 
-Dtests.timezone=Europe/Bratislava -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestNodeAddedTrigger (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.autoscaling.sim.TestNodeAddedTrigger: 
   [junit4]    >    1) Thread[id=9163, name=Simulated 
OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer 
autoscaling triggers]
   [junit4]    >         at 
java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
   [junit4]    >         at 
java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=9163, name=Simulated 
OverseerAutoScalingTriggerThread, state=WAITING, group=Simulated Overseer 
autoscaling triggers]
   [junit4]    >         at 
java.base@10-ea/jdk.internal.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:883)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:915)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1238)
   [junit4]    >         at 
java.base@10-ea/java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:267)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.refreshAutoScalingConf(OverseerTriggerThread.java:295)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.access$000(OverseerTriggerThread.java:56)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread$AutoScalingWatcher.process(OverseerTriggerThread.java:280)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager$Node.setData(SimDistribStateManager.java:127)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.sim.SimDistribStateManager.setData(SimDistribStateManager.java:502)
   [junit4]    >         at 
app//org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:121)
   [junit4]    >         at 
java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)
   [junit4] Completed [69/768 (1!)] on J1 in 23.78s, 4 tests, 2 errors <<< 
FAILURES!

[...truncated 1708 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> 453471 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/init-core-data-001
   [junit4]   2> 453471 WARN  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 453471 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 453472 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 453472 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001
   [junit4]   2> 453472 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 453472 INFO  (Thread-2728) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 453472 INFO  (Thread-2728) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 453473 ERROR (Thread-2728) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 453572 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:40517
   [junit4]   2> 453574 INFO  (zkConnectionManagerCallback-704-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453575 INFO  (jetty-launcher-701-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 453575 INFO  (jetty-launcher-701-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 453576 INFO  (jetty-launcher-701-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 453576 INFO  (jetty-launcher-701-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 453576 INFO  (jetty-launcher-701-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 453576 INFO  (jetty-launcher-701-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 453576 INFO  (jetty-launcher-701-thread-1) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 453576 INFO  (jetty-launcher-701-thread-2) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 453576 INFO  (jetty-launcher-701-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@33b873a1{/solr,null,AVAILABLE}
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@4825d753{HTTP/1.1,[http/1.1]}{127.0.0.1:36043}
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-1) [    ] 
o.e.j.s.Server Started @455248ms
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36043}
   [junit4]   2> 453577 ERROR (jetty-launcher-701-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-25T20:02:39.275342Z
   [junit4]   2> 453577 INFO  (jetty-launcher-701-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@220745c3{/solr,null,AVAILABLE}
   [junit4]   2> 453578 INFO  (jetty-launcher-701-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@312d53b4{HTTP/1.1,[http/1.1]}{127.0.0.1:41665}
   [junit4]   2> 453578 INFO  (jetty-launcher-701-thread-2) [    ] 
o.e.j.s.Server Started @455249ms
   [junit4]   2> 453578 INFO  (jetty-launcher-701-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=41665}
   [junit4]   2> 453578 ERROR (jetty-launcher-701-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 453578 INFO  (jetty-launcher-701-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 453578 INFO  (jetty-launcher-701-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 453578 INFO  (jetty-launcher-701-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 453578 INFO  (jetty-launcher-701-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-25T20:02:39.276491Z
   [junit4]   2> 453581 INFO  (zkConnectionManagerCallback-706-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453581 INFO  (zkConnectionManagerCallback-708-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453581 INFO  (jetty-launcher-701-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 453581 INFO  (jetty-launcher-701-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 453591 INFO  (jetty-launcher-701-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr
   [junit4]   2> 453591 INFO  (jetty-launcher-701-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr
   [junit4]   2> 453593 INFO  (zkConnectionManagerCallback-714-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453594 INFO  (zkConnectionManagerCallback-716-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453594 INFO  
(zkConnectionManagerCallback-718-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453595 INFO  
(zkConnectionManagerCallback-720-thread-1-processing-n:127.0.0.1:41665_solr) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453625 INFO  (jetty-launcher-701-thread-2) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 453625 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 453626 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:36043_solr
   [junit4]   2> 453626 INFO  (jetty-launcher-701-thread-2) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41665_solr
   [junit4]   2> 453626 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.Overseer Overseer 
(id=99412250405830661-127.0.0.1:36043_solr-n_0000000000) starting
   [junit4]   2> 453627 INFO  
(zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 453627 INFO  
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 453633 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 453634 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 1
   [junit4]   2> 453634 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36043_solr
   [junit4]   2> 453634 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:41665_solr]
   [junit4]   2> 453634 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 453634 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 1
   [junit4]   2> 453634 INFO  
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 453634 INFO  
(zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 453637 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 453637 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 453637 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 2
   [junit4]   2> 453659 INFO  (jetty-launcher-701-thread-2) 
[n:127.0.0.1:41665_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41665.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453670 INFO  (jetty-launcher-701-thread-2) 
[n:127.0.0.1:41665_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41665.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453670 INFO  (jetty-launcher-701-thread-2) 
[n:127.0.0.1:41665_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41665.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453671 INFO  (jetty-launcher-701-thread-2) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node2/.
   [junit4]   2> 453680 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36043.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453697 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36043.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453697 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36043.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453698 INFO  (jetty-launcher-701-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node1/.
   [junit4]   2> 453724 INFO  (zkConnectionManagerCallback-726-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453726 INFO  (zkConnectionManagerCallback-730-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453727 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 453727 INFO  
(SUITE-TriggerIntegrationTest-seed#[70BED519C9CE0B66]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40517/solr ready
   [junit4]   2> 453733 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testCooldown
   [junit4]   2> 453733 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 453733 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 2
   [junit4]   2> 453733 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 2
   [junit4]   2> 453734 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 453734 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 453734 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 453738 INFO  (qtp2006514474-6422) [n:127.0.0.1:36043_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 453742 INFO  (qtp357965713-6363) [n:127.0.0.1:41665_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 453742 DEBUG (qtp2006514474-6362) [n:127.0.0.1:36043_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 453742 INFO  (qtp2006514474-6362) [n:127.0.0.1:36043_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 453742 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 3
   [junit4]   2> 453743 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:41665_solr, 127.0.0.1:36043_solr]
   [junit4]   2> 453743 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, 
waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 453743 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 3
   [junit4]   2> 453744 INFO  
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 453744 INFO  (qtp2006514474-6374) [n:127.0.0.1:36043_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 453744 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 453744 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 453745 INFO  (qtp357965713-6371) [n:127.0.0.1:41665_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 453745 DEBUG (qtp2006514474-6370) [n:127.0.0.1:36043_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 453745 INFO  (qtp2006514474-6370) [n:127.0.0.1:36043_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 453746 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 4
   [junit4]   2> 453746 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:41665_solr, 127.0.0.1:36043_solr]
   [junit4]   2> 453746 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, 
waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 453746 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 453749 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 453749 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 4, lastZnodeVersion 3
   [junit4]   2> 453749 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 4
   [junit4]   2> 453749 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 453750 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 453765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 453765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 453765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 453765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@45eb2bb{/solr,null,AVAILABLE}
   [junit4]   2> 453766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@79d1e2e9{HTTP/1.1,[http/1.1]}{127.0.0.1:41773}
   [junit4]   2> 453766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server Started @455437ms
   [junit4]   2> 453766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=41773}
   [junit4]   2> 453766 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 453766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 453766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 453766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 453766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-25T20:02:39.464474Z
   [junit4]   2> 453772 INFO  (zkConnectionManagerCallback-732-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453773 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 453782 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr
   [junit4]   2> 453783 INFO  (zkConnectionManagerCallback-736-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453785 INFO  
(zkConnectionManagerCallback-738-thread-1-processing-n:127.0.0.1:41773_solr) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 453787 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 453788 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 453788 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41773_solr
   [junit4]   2> 453789 INFO  
(zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 453789 INFO  
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 453793 INFO  (zkCallback-729-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 453794 INFO  
(zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 453820 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:41773_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41773.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453826 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:41773_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41773.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453826 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:41773_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41773.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 453827 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node3/.
   [junit4]   2> 454745 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 454745 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 454745 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:41773_solr at time 204344772087164
   [junit4]   2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger firing registered processor for nodes: 
[127.0.0.1:41773_solr] added at times [204344772087164], now=204345772952955
   [junit4]   2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"b9d9b98d4d7cTb49ekn0lnbgypbkl54kbmtxp7",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":204344772087164,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[204344772087164],
   [junit4]   2>     "nodeNames":["127.0.0.1:41773_solr"]}}
   [junit4]   2> 455746 DEBUG (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_cooldown_trigger]
   [junit4]   2> 455747 INFO  (ScheduledTrigger-1686-thread-2) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 455747 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"b9d9b98d4d7cTb49ekn0lnbgypbkl54kbmtxp7",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":204344772087164,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[204344772087164],
   [junit4]   2>     "_enqueue_time_":204345773330950,
   [junit4]   2>     "nodeNames":["127.0.0.1:41773_solr"]}}
   [junit4]   2> 455748 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_cooldown_trigger after 5000ms
   [junit4]   2> 455748 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 1 
ms for event id=b9d9b98d4d7cTb49ekn0lnbgypbkl54kbmtxp7
   [junit4]   2> 456748 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@603cb8bd{/solr,null,AVAILABLE}
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@79908bd0{HTTP/1.1,[http/1.1]}{127.0.0.1:39233}
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server Started @458420ms
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=39233}
   [junit4]   2> 456749 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 456749 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 456750 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 456750 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 456750 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-25T20:02:42.448063Z
   [junit4]   2> 456751 INFO  (zkConnectionManagerCallback-742-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 456751 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 456755 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr
   [junit4]   2> 456756 INFO  (zkConnectionManagerCallback-746-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 456758 INFO  
(zkConnectionManagerCallback-748-thread-1-processing-n:127.0.0.1:39233_solr) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 456760 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 456761 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 456761 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:39233_solr
   [junit4]   2> 456762 INFO  
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 456762 INFO  
(zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 456762 INFO  
(zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 456762 INFO  (zkCallback-729-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 456762 INFO  
(zkCallback-747-thread-1-processing-n:127.0.0.1:39233_solr) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 456792 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:39233_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39233.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 456797 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:39233_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39233.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 456798 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:39233_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_39233.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 456798 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node4/.
   [junit4]   2> 460748 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 460748 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 460748 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:39233_solr at time 204350775381291
   [junit4]   2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger firing registered processor for nodes: 
[127.0.0.1:39233_solr] added at times [204350775381291], now=204351776149936
   [junit4]   2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"b9db1f604d2bTb49ekn0lnbgypbkl54kbmtxp9",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":204350775381291,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[204350775381291],
   [junit4]   2>     "nodeNames":["127.0.0.1:39233_solr"]}}
   [junit4]   2> 461749 DEBUG (ScheduledTrigger-1686-thread-1) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_cooldown_trigger]
   [junit4]   2> 461750 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"b9db1f604d2bTb49ekn0lnbgypbkl54kbmtxp9",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":204350775381291,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[204350775381291],
   [junit4]   2>     "_enqueue_time_":204351776273800,
   [junit4]   2>     "nodeNames":["127.0.0.1:39233_solr"]}}
   [junit4]   2> 461750 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_cooldown_trigger after 5000ms
   [junit4]   2> 461750 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 
ms for event id=b9db1f604d2bTb49ekn0lnbgypbkl54kbmtxp9
   [junit4]   2> 463754 INFO  (qtp2006514474-6372) [n:127.0.0.1:36043_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 463755 INFO  (qtp54956395-6455) [n:127.0.0.1:39233_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 463757 INFO  (qtp357965713-6375) [n:127.0.0.1:41665_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 463758 INFO  (qtp422151251-6429) [n:127.0.0.1:41773_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 463758 DEBUG (qtp2006514474-6421) [n:127.0.0.1:36043_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 463758 INFO  (qtp2006514474-6421) [n:127.0.0.1:36043_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 463759 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 5
   [junit4]   2> 463759 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:41773_solr, 127.0.0.1:39233_solr, 127.0.0.1:41665_solr, 
127.0.0.1:36043_solr]
   [junit4]   2> 463759 DEBUG 
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger instantiated with properties: {event=nodeAdded, 
waitFor=1, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 463759 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 5
   [junit4]   2> 463759 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers Changing value of 
autoscaling property: triggerCooldownPeriodSeconds from: 5 to: 7
   [junit4]   2> 463759 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 463760 DEBUG 
(OverseerAutoScalingTriggerThread-99412250405830661-127.0.0.1:36043_solr-n_0000000000)
 [n:127.0.0.1:36043_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 463760 INFO  (qtp2006514474-6370) [n:127.0.0.1:36043_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 463760 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 463764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 463764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 463764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 463764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@22931023{/solr,null,AVAILABLE}
   [junit4]   2> 463764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@73e9e560{HTTP/1.1,[http/1.1]}{127.0.0.1:33969}
   [junit4]   2> 463764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server Started @465436ms
   [junit4]   2> 463764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=33969}
   [junit4]   2> 463764 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 463765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 463765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 463765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 463765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-25T20:02:49.463122Z
   [junit4]   2> 463766 INFO  (zkConnectionManagerCallback-752-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 463766 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 463770 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr
   [junit4]   2> 463771 INFO  (zkConnectionManagerCallback-756-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 463773 INFO  
(zkConnectionManagerCallback-758-thread-1-processing-n:127.0.0.1:33969_solr) 
[n:127.0.0.1:33969_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 463775 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:33969_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (4)
   [junit4]   2> 463775 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:33969_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 463776 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:33969_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:33969_solr
   [junit4]   2> 463777 INFO  
(zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 463777 INFO  
(zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 463777 INFO  
(zkCallback-717-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 463777 INFO  (zkCallback-729-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 463777 INFO  
(zkCallback-747-thread-1-processing-n:127.0.0.1:39233_solr) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 463777 INFO  
(zkCallback-757-thread-1-processing-n:127.0.0.1:33969_solr) 
[n:127.0.0.1:33969_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 463804 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:33969_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33969.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 463810 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:33969_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33969.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 463810 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:33969_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_33969.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@5673f0ff
   [junit4]   2> 463811 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:33969_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.TriggerIntegrationTest_70BED519C9CE0B66-001/tempDir-001/node5/.
   [junit4]   2> 466750 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 466750 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5
   [junit4]   2> 466750 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:33969_solr at time 204356777593793
   [junit4]   2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_cooldown_trigger
   [junit4]   2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 5
   [junit4]   2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_cooldown_trigger firing registered processor for nodes: 
[127.0.0.1:33969_solr] added at times [204356777593793], now=204357778344298
   [junit4]   2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"b9dc8522cbc1Tb49ekn0lnbgypbkl54kbmtxpa",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":204356777593793,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[204356777593793],
   [junit4]   2>     "nodeNames":["127.0.0.1:33969_solr"]}}
   [junit4]   2> 467751 DEBUG (ScheduledTrigger-1686-thread-3) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_cooldown_trigger]
   [junit4]   2> 467752 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"b9dc8522cbc1Tb49ekn0lnbgypbkl54kbmtxpa",
   [junit4]   2>   "source":"node_added_cooldown_trigger",
   [junit4]   2>   "eventTime":204356777593793,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[204356777593793],
   [junit4]   2>     "_enqueue_time_":204357778476464,
   [junit4]   2>     "nodeNames":["127.0.0.1:33969_solr"]}}
   [junit4]   2> 467752 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_cooldown_trigger after 7000ms
   [junit4]   2> 467752 DEBUG 
(AutoscalingActionExecutor-1687-thread-1-processing-n:127.0.0.1:36043_solr) 
[n:127.0.0.1:36043_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 0 
ms for event id=b9dc8522cbc1Tb49ekn0lnbgypbkl54kbmtxpa
   [junit4]   2> 467752 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-21T15:27:37-06:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 467753 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 467753 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 467753 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 467753 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@4d0bbc2b{/solr,null,AVAILABLE}
   [junit4]   2> 467753 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@416bb1a2{HTTP/1.1,[http/1.1]}{127.0.0.1:38959}
   [junit4]   2> 467753 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.e.j.s.Server Started @469425ms
   [junit4]   2> 467754 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=38959}
   [junit4]   2> 467754 ERROR 
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 467754 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
8.0.0
   [junit4]   2> 467754 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 467754 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 467754 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-01-25T20:02:53.452311Z
   [junit4]   2> 467755 INFO  (zkConnectionManagerCallback-762-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 467755 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 467759 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40517/solr
   [junit4]   2> 467760 INFO  (zkConnectionManagerCallback-766-thread-1) [    ] 
o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 467762 INFO  
(zkConnectionManagerCallback-768-thread-1-processing-n:127.0.0.1:38959_solr) 
[n:127.0.0.1:38959_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 467764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:38959_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (5)
   [junit4]   2> 467764 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:38959_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 467765 INFO  
(TEST-TriggerIntegrationTest.testCooldown-seed#[70BED519C9CE0B66]) 
[n:127.0.0.1:38959_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38959_solr
   [junit4]   2> 467766 INFO  
(zkCallback-757-thread-1-processing-n:127.0.0.1:33969_solr) 
[n:127.0.0.1:33969_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 467766 INFO  
(zkCallback-719-thread-1-processing-n:127.0.0.1:41665_solr) 
[n:127.0.0.1:41665_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 467766 INFO  
(zkCallback-747-thread-1-processing-n:127.0.0.1:39233_solr) 
[n:127.0.0.1:39233_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (5) -> (6)
   [junit4]   2> 467766 INFO  (zkCallback-729-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
   [junit4]   2> 467766 INFO  
(zkCallback-737-thread-1-processing-n:127.0.0.1:41773_solr) 
[n:127.0.0.1:41773_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKe

[...truncated too long message...]

tAllByName0(InetAddress.java:1415)
   [junit4]   2>         at 
java.base@10-ea/java.net.SocketPermission.getIP(SocketPermission.java:796)
   [junit4]   2>         at 
java.base@10-ea/java.net.SocketPermission.impliesIgnoreMask(SocketPermission.java:958)
   [junit4]   2>         at 
java.base@10-ea/java.net.SocketPermissionCollection.implies(SocketPermission.java:1417)
   [junit4]   2>         at 
java.base@10-ea/java.security.Permissions.implies(Permissions.java:179)
   [junit4]   2>         at 
java.base@10-ea/sun.security.provider.PolicyFile.implies(PolicyFile.java:1037)
   [junit4]   2>         at 
java.base@10-ea/java.security.ProtectionDomain.implies(ProtectionDomain.java:308)
   [junit4]   2>         at 
java.base@10-ea/java.security.ProtectionDomain.impliesWithAltFilePerm(ProtectionDomain.java:340)
   [junit4]   2>         at 
java.base@10-ea/java.security.AccessControlContext.checkPermission(AccessControlContext.java:450)
   [junit4]   2>         at 
java.base@10-ea/java.security.AccessController.checkPermission(AccessController.java:895)
   [junit4]   2>         at 
java.base@10-ea/java.lang.SecurityManager.checkPermission(SecurityManager.java:335)
   [junit4]   2>         at 
java.base@10-ea/java.lang.SecurityManager.checkConnect(SecurityManager.java:837)
   [junit4]   2>         at 
java.base@10-ea/java.net.Socket.connect(Socket.java:584)
   [junit4]   2>         at 
java.base@10-ea/java.net.Socket.connect(Socket.java:540)
   [junit4]   2>         at 
java.base@10-ea/java.net.Socket.<init>(Socket.java:436)
   [junit4]   2>         at 
java.base@10-ea/java.net.Socket.<init>(Socket.java:213)
   [junit4]   2>         at 
app//org.apache.solr.cloud.ZkTestServer.send4LetterWord(ZkTestServer.java:579)
   [junit4]   2>         at 
app//org.apache.solr.cloud.ZkTestServer.waitForServerDown(ZkTestServer.java:539)
   [junit4]   2>         at 
app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.shutdown(ZkTestServer.java:337)
   [junit4]   2>         at 
app//org.apache.solr.cloud.ZkTestServer.shutdown(ZkTestServer.java:526)
   [junit4]   2>         at 
app//org.apache.solr.cloud.AbstractDistribZkTestBase.distribTearDown(AbstractDistribZkTestBase.java:318)
   [junit4]   2>         at 
app//org.apache.solr.cloud.AbstractFullDistribZkTestBase.distribTearDown(AbstractFullDistribZkTestBase.java:1575)
   [junit4]   2>         at 
app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:970)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2>         at 
app//org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
app//org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
   [junit4]   2>         at 
java.base@10-ea/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{rnd_b=BlockTreeOrds(blocksize=128), 
a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))),
 id=BlockTreeOrds(blocksize=128)}, 
docValues:{_version_=DocValuesFormat(name=Memory), 
a_i=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1424, 
maxMBSortInHeap=5.489195478434274, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@9c63453),
 locale=es-VE, timezone=Asia/Hovd
   [junit4]   2> NOTE: Linux 4.13.0-31-generic amd64/Oracle Corporation 10-ea 
(64-bit)/cpus=8,threads=2,free=214771392,total=314572800
   [junit4]   2> NOTE: All tests run in this JVM: [DebugComponentTest, 
TestDocumentBuilder, TestMiniSolrCloudClusterSSL, ForceLeaderTest, 
TestZkAclsWithHadoopAuth, DistributedExpandComponentTest, 
TestSolrConfigHandler, ManagedSchemaRoundRobinCloudTest, RequestHandlersTest, 
OverseerCollectionConfigSetProcessorTest, TestXmlQParserPlugin, 
MetricsConfigTest, CollectionTooManyReplicasTest, TestLargeCluster, 
SpellingQueryConverterTest, TestLegacyNumericRangeQueryBuilder, 
MoveReplicaHDFSTest, TestDefaultStatsCache, HdfsSyncSliceTest, 
TestApiFramework, TestRTimerTree, TestBlendedInfixSuggestions, 
TestDistribStateManager, TestMergePolicyConfig, 
TermVectorComponentDistributedTest, FieldAnalysisRequestHandlerTest, 
TestRestoreCore, TestLMDirichletSimilarityFactory, 
TestHighFrequencyDictionaryFactory, TestBinaryResponseWriter, 
CloudExitableDirectoryReaderTest, TestRandomRequestDistribution, 
TriggerIntegrationTest, TestCloudRecovery, TestPayloadCheckQParserPlugin, 
ShardRoutingTest, ExternalFileFieldSortTest, TestPushWriter, 
TestRandomFaceting, OpenExchangeRatesOrgProviderTest, UtilsToolTest, 
AddSchemaFieldsUpdateProcessorFactoryTest, 
ClassificationUpdateProcessorFactoryTest, 
ChaosMonkeySafeLeaderWithPullReplicasTest]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=ChaosMonkeySafeLeaderWithPullReplicasTest 
-Dtests.seed=70BED519C9CE0B66 -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=es-VE -Dtests.timezone=Asia/Hovd -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | ChaosMonkeySafeLeaderWithPullReplicasTest 
(suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([70BED519C9CE0B66]:0)
   [junit4] Completed [685/768 (3!)] on J0 in 7223.73s, 1 test, 2 errors <<< 
FAILURES!

[...truncated 256 lines...]
   [junit4] JVM J0: stdout was not empty, see: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20180125_195503_99017611083384496915955.sysout
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/home/jenkins/workspace/Lucene-Solr-master-Linux/heapdumps/java_pid19789.hprof 
...
   [junit4] Heap dump file created [326570131 bytes in 0.485 secs]
   [junit4] <<< JVM J0: EOF ----

[...truncated 8582 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:836: The following 
error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:788: Some of the 
tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid19789.hprof

Total time: 163 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to