Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Solaris/925/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

4 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners

Error Message:
The trigger did not fire at all

Stack Trace:
java.lang.AssertionError: The trigger did not fire at all
        at 
__randomizedtesting.SeedInfo.seed([A0121F8A68651D2F:4DD2889AD50980F6]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testListeners(TriggerIntegrationTest.java:648)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
SolrCore.getOpenCount()==2

Stack Trace:
java.lang.RuntimeException: SolrCore.getOpenCount()==2
        at __randomizedtesting.SeedInfo.seed([A0121F8A68651D2F]:0)
        at org.apache.solr.util.TestHarness.close(TestHarness.java:380)
        at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:802)
        at 
org.apache.solr.cloud.AbstractZkTestCase.azt_afterClass(AbstractZkTestCase.java:147)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
4 threads leaked from SUITE scope at 
org.apache.solr.rest.TestManagedResourceStorage:     1) Thread[id=37352, 
name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestManagedResourceStorage]         at java.lang.Object.wait(Native 
Method)         at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147) 
   2) Thread[id=37350, name=Thread-7112, state=WAITING, 
group=TGRP-TestManagedResourceStorage]         at java.lang.Object.wait(Native 
Method)         at java.lang.Thread.join(Thread.java:1252)         at 
java.lang.Thread.join(Thread.java:1326)         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
         at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
         at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)    
3) Thread[id=37351, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, 
state=RUNNABLE, group=TGRP-TestManagedResourceStorage]         at 
sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)         at 
sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)         at 
sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
         at java.lang.Thread.run(Thread.java:748)    4) Thread[id=37354, 
name=ProcessThread(sid:0 cport:49550):, state=WAITING, 
group=TGRP-TestManagedResourceStorage]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE 
scope at org.apache.solr.rest.TestManagedResourceStorage: 
   1) Thread[id=37352, name=SessionTracker, state=TIMED_WAITING, 
group=TGRP-TestManagedResourceStorage]
        at java.lang.Object.wait(Native Method)
        at 
org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:147)
   2) Thread[id=37350, name=Thread-7112, state=WAITING, 
group=TGRP-TestManagedResourceStorage]
        at java.lang.Object.wait(Native Method)
        at java.lang.Thread.join(Thread.java:1252)
        at java.lang.Thread.join(Thread.java:1326)
        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:313)
        at 
org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:313)
        at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:496)
   3) Thread[id=37351, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, 
state=RUNNABLE, group=TGRP-TestManagedResourceStorage]
        at sun.nio.ch.DevPollArrayWrapper.poll0(Native Method)
        at sun.nio.ch.DevPollArrayWrapper.poll(DevPollArrayWrapper.java:223)
        at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:98)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
        at java.lang.Thread.run(Thread.java:748)
   4) Thread[id=37354, name=ProcessThread(sid:0 cport:49550):, state=WAITING, 
group=TGRP-TestManagedResourceStorage]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:123)
        at __randomizedtesting.SeedInfo.seed([A0121F8A68651D2F]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.rest.TestManagedResourceStorage

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=37351, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, 
group=TGRP-TestManagedResourceStorage]         at 
sun.nio.ch.IOUtil.drain(Native Method)         at 
sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:109)         
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)         at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)         at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
         at java.lang.Thread.run(Thread.java:748)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=37351, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, 
state=RUNNABLE, group=TGRP-TestManagedResourceStorage]
        at sun.nio.ch.IOUtil.drain(Native Method)
        at sun.nio.ch.DevPollSelectorImpl.doSelect(DevPollSelectorImpl.java:109)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:196)
        at java.lang.Thread.run(Thread.java:748)
        at __randomizedtesting.SeedInfo.seed([A0121F8A68651D2F]:0)




Build Log:
[...truncated 12807 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> 477319 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A0121F8A68651D2F-001/init-core-data-001
   [junit4]   2> 477319 WARN  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
   [junit4]   2> 477320 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 477321 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 477321 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A0121F8A68651D2F-001/tempDir-001
   [junit4]   2> 477322 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 477322 INFO  (Thread-1996) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 477322 INFO  (Thread-1996) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 477324 ERROR (Thread-1996) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 477422 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:62081
   [junit4]   2> 477428 INFO  (zkConnectionManagerCallback-2017-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 477432 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 477433 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 477433 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 477433 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 477434 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 477434 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@34ac5167{/solr,null,AVAILABLE}
   [junit4]   2> 477435 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@12621b2e{HTTP/1.1,[http/1.1]}{127.0.0.1:37855}
   [junit4]   2> 477435 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.e.j.s.Server Started @477928ms
   [junit4]   2> 477436 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37855}
   [junit4]   2> 477436 ERROR (jetty-launcher-2014-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 477436 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 477438 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.7.0
   [junit4]   2> 477438 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 477438 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 477438 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-11-24T04:20:59.468Z
   [junit4]   2> 477439 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 477439 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 477439 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 477439 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@465733c3{/solr,null,AVAILABLE}
   [junit4]   2> 477439 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.e.j.s.AbstractConnector Started 
ServerConnector@14acd4ad{HTTP/1.1,[http/1.1]}{127.0.0.1:34787}
   [junit4]   2> 477439 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.e.j.s.Server Started @477932ms
   [junit4]   2> 477440 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=34787}
   [junit4]   2> 477440 ERROR (jetty-launcher-2014-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 477440 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 477440 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.7.0
   [junit4]   2> 477440 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 477440 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 477440 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-11-24T04:20:59.470Z
   [junit4]   2> 477448 INFO  (zkConnectionManagerCallback-2019-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 477448 INFO  (zkConnectionManagerCallback-2021-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 477448 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 477448 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 478112 INFO  (jetty-launcher-2014-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62081/solr
   [junit4]   2> 478124 INFO  (zkConnectionManagerCallback-2025-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478142 INFO  (zkConnectionManagerCallback-2027-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478249 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:34787_solr
   [junit4]   2> 478250 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.Overseer Overseer 
(id=72112789135753220-127.0.0.1:34787_solr-n_0000000000) starting
   [junit4]   2> 478256 INFO  (zkConnectionManagerCallback-2034-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478258 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:62081/solr ready
   [junit4]   2> 478259 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:34787_solr
   [junit4]   2> 478278 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 478296 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_34787.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 478300 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_34787.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 478301 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_34787.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 478302 INFO  (jetty-launcher-2014-thread-2) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A0121F8A68651D2F-001/tempDir-001/node2/.
   [junit4]   2> 478302 INFO  
(OverseerStateUpdate-72112789135753220-127.0.0.1:34787_solr-n_0000000000) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:34787_solr
   [junit4]   2> 478329 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 478330 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 478330 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion -1
   [junit4]   2> 478330 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 1
   [junit4]   2> 478345 INFO  
(OverseerStateUpdate-72112789135753220-127.0.0.1:34787_solr-n_0000000000) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 478346 INFO  (zkCallback-2033-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 478349 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:34787_solr]
   [junit4]   2> 478350 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 478350 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, 
lastZnodeVersion 1
   [junit4]   2> 478355 DEBUG (ScheduledTrigger-2727-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 478506 INFO  (jetty-launcher-2014-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62081/solr
   [junit4]   2> 478508 INFO  (zkConnectionManagerCallback-2039-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478510 INFO  (zkConnectionManagerCallback-2041-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478519 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 478525 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 478525 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37855_solr
   [junit4]   2> 478536 INFO  (zkCallback-2033-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 478537 INFO  (zkCallback-2026-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 478538 INFO  (zkCallback-2040-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 478546 INFO  (zkConnectionManagerCallback-2048-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478547 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 478549 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:62081/solr ready
   [junit4]   2> 478549 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 478559 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37855.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 478564 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37855.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 478564 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37855.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 478565 INFO  (jetty-launcher-2014-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A0121F8A68651D2F-001/tempDir-001/node1/.
   [junit4]   2> 478583 INFO  (zkConnectionManagerCallback-2051-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478584 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x10032331c330009, likely client has closed socket
   [junit4]   2> 478587 INFO  (zkConnectionManagerCallback-2056-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478589 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 478590 INFO  
(SUITE-TriggerIntegrationTest-seed#[A0121F8A68651D2F]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62081/solr ready
   [junit4]   2> 478599 INFO  (qtp1736325798-7416) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=1
   [junit4]   2> 478602 INFO  (qtp854607197-7426) [n:127.0.0.1:34787_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 478602 DEBUG (qtp1736325798-7420) [n:127.0.0.1:37855_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 478602 INFO  (qtp1736325798-7420) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=6
   [junit4]   2> 478603 DEBUG (zkCallback-2033-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 478605 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 2
   [junit4]   2> 478629 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerThrottling
   [junit4]   2> 478631 INFO  (zkConnectionManagerCallback-2058-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 478633 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 478633 INFO  (qtp1736325798-7419) [n:127.0.0.1:37855_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 478633 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, 
lastZnodeVersion 2
   [junit4]   2> 478644 INFO  (qtp1736325798-7419) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=10
   [junit4]   2> 478645 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 478647 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 3
   [junit4]   2> 478648 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 478649 DEBUG (zkCallback-2033-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 478649 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 3
   [junit4]   2> 478649 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 478651 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.AbstractConnector Stopped 
ServerConnector@14acd4ad{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 478655 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2091382610
   [junit4]   2> 478655 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 478655 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6b95c50: rootName = 
solr_34787, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@604dc3bb
   [junit4]   2> 478656 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 478658 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, 
lastZnodeVersion 3
   [junit4]   2> 478660 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 478660 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@82bff9b: rootName = 
solr_34787, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@c70e2fe
   [junit4]   2> 478663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 478663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@34b5a325: rootName = 
solr_34787, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@4173a1df
   [junit4]   2> 478665 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:34787_solr
   [junit4]   2> 478666 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 478666 INFO  (zkCallback-2055-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 478667 INFO  (zkCallback-2055-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 478667 INFO  (zkCallback-2026-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 478667 INFO  (zkCallback-2040-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 478668 INFO  (zkCallback-2033-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 478668 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 478668 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.Overseer Overseer 
(id=72112789135753220-127.0.0.1:34787_solr-n_0000000000) closing
   [junit4]   2> 478668 INFO  
(OverseerStateUpdate-72112789135753220-127.0.0.1:34787_solr-n_0000000000) 
[n:127.0.0.1:34787_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:34787_solr
   [junit4]   2> 478668 DEBUG 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 478668 WARN  
(OverseerAutoScalingTriggerThread-72112789135753220-127.0.0.1:34787_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 478668 DEBUG 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 478669 DEBUG 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 478669 DEBUG 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 478670 DEBUG 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 478670 DEBUG 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 478672 INFO  (zkCallback-2047-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 478675 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@465733c3{/solr,null,UNAVAILABLE}
   [junit4]   2> 478675 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 478677 INFO  (zkCallback-2040-thread-1) [    ] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37855_solr
   [junit4]   2> 478679 INFO  (zkCallback-2040-thread-1) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.Overseer Overseer 
(id=72112789135753223-127.0.0.1:37855_solr-n_0000000001) starting
   [junit4]   2> 478686 INFO  
(OverseerStateUpdate-72112789135753223-127.0.0.1:37855_solr-n_0000000001) 
[n:127.0.0.1:37855_solr    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:37855_solr
   [junit4]   2> 478687 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 478689 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 4
   [junit4]   2> 478689 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, 
lastZnodeVersion -1
   [junit4]   2> 478689 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 4
   [junit4]   2> 478693 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:37855_solr]
   [junit4]   2> 478693 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 478694 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, 
lastZnodeVersion 4
   [junit4]   2> 478694 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 479696 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 480697 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 481697 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 482698 DEBUG (ScheduledTrigger-2743-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 483679 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@759c23e5{/solr,null,AVAILABLE}
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.AbstractConnector Started 
ServerConnector@1b5c7dc4{HTTP/1.1,[http/1.1]}{127.0.0.1:37940}
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.Server Started @484204ms
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37940}
   [junit4]   2> 483680 ERROR 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.7.0
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port 
null
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 483680 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-11-24T04:21:05.710Z
   [junit4]   2> 483685 INFO  (zkConnectionManagerCallback-2062-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 483686 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 483698 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1
   [junit4]   2> 484537 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62081/solr
   [junit4]   2> 484539 INFO  (zkConnectionManagerCallback-2066-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484542 INFO  (zkConnectionManagerCallback-2068-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484556 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 484563 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating 
transient cache for 2147483647 transient cores
   [junit4]   2> 484563 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37940_solr
   [junit4]   2> 484565 INFO  (zkCallback-2040-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 484565 INFO  (zkCallback-2055-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 484565 INFO  (zkCallback-2047-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 484565 INFO  (zkCallback-2055-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 484566 INFO  (zkCallback-2067-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 484584 INFO  (zkConnectionManagerCallback-2075-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484586 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 484587 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:62081/solr ready
   [junit4]   2> 484588 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 484599 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37940.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 484605 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37940.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 484605 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_37940.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 484606 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) 
[n:127.0.0.1:37940_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A0121F8A68651D2F-001/tempDir-001/node3/.
   [junit4]   2> 484641 INFO  (qtp1736325798-7419) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 484643 INFO  (qtp1068046960-7512) [n:127.0.0.1:37940_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 484643 DEBUG (qtp1736325798-7423) [n:127.0.0.1:37855_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 484644 INFO  (qtp1736325798-7423) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=8
   [junit4]   2> 484645 DEBUG (zkCallback-2047-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
5
   [junit4]   2> 484645 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 5
   [junit4]   2> 484648 INFO  (qtp1736325798-7423) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 484649 INFO  (qtp1068046960-7508) [n:127.0.0.1:37940_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 484649 DEBUG (qtp1736325798-7418) [n:127.0.0.1:37855_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 484650 INFO  (qtp1736325798-7418) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 484650 DEBUG (zkCallback-2047-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
6
   [junit4]   2> 484651 INFO  
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 484651 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 - 
Initial livenodes: [127.0.0.1:37855_solr, 127.0.0.1:37940_solr]
   [junit4]   2> 484651 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 
instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
 enabled=true}
   [junit4]   2> 484652 DEBUG (ScheduledTrigger-2743-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 484652 DEBUG (ScheduledTrigger-2743-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 484657 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, 
lastZnodeVersion 5
   [junit4]   2> 484657 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 6
   [junit4]   2> 484660 INFO  
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 484660 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 - 
Initial livenodes: [127.0.0.1:37855_solr, 127.0.0.1:37940_solr]
   [junit4]   2> 484660 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 
instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}],
 enabled=true}
   [junit4]   2> 484661 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
   [junit4]   2> 484661 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 484661 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, 
lastZnodeVersion 6
   [junit4]   2> 484662 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.Server jetty-9.4.11.v20180605; built: 2018-06-05T18:24:03.829Z; git: 
d5fc0523cfa96bfebfbda19606cad384d772f04c; jvm 1.8.0_191-b12
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session node0 Scavenging every 600000ms
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6140c7f{/solr,null,AVAILABLE}
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.AbstractConnector Started 
ServerConnector@371ad43c{HTTP/1.1,[http/1.1]}{127.0.0.1:37520}
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.Server Started @485188ms
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=37520}
   [junit4]   2> 484663 ERROR 
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 
7.7.0
   [junit4]   2> 484663 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port 
null
   [junit4]   2> 484664 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 484664 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-11-24T04:21:06.694Z
   [junit4]   2> 484667 INFO  (zkConnectionManagerCallback-2078-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 484667 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 484699 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2
   [junit4]   2> 485075 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62081/solr
   [junit4]   2> 485078 INFO  (zkConnectionManagerCallback-2082-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 485081 INFO  (zkConnectionManagerCallback-2084-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 485094 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 485101 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 485101 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37520_solr
   [junit4]   2> 485103 INFO  (zkCallback-2047-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 485118 INFO  (zkCallback-2055-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 485118 INFO  (zkCallback-2055-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 485118 INFO  (zkCallback-2040-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 485118 INFO  (zkCallback-2067-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 485119 INFO  (zkCallback-2074-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 485120 INFO  (zkCallback-2083-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 485122 INFO  (zkConnectionManagerCallback-2091-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 485124 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 485125 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62081/solr 
ready
   [junit4]   2> 485125 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics 
history in memory.
   [junit4]   2> 485147 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37520.solr.node' 
(registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 485878 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
   [junit4]   2> 485878 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 485878 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:37520_solr at time 
842218951067959
   [junit4]   2> 485878 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing 
registered processor for nodes: [127.0.0.1:37520_solr] added at times 
[842218951067959], now=842218951110909
   [junit4]   2> 485878 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3
   [junit4]   2> 485878 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2fdfe6166c937Tcsglumx64cd8fhgqs11dl0e5h",
   [junit4]   2>   "source":"node_added_trigger2",
   [junit4]   2>   "eventTime":842218951067959,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842218951067959],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 485884 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37520.solr.jvm' (registry 
'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 485884 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37520.solr.jetty' 
(registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@66d4e5c4
   [junit4]   2> 485886 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A0121F8A68651D2F-001/tempDir-001/node4/.
   [junit4]   2> 485887 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger2, .scheduled_maintenance, node_added_trigger1]
   [junit4]   2> 485888 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 485888 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 485888 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:37520_solr at time 
842218960866360
   [junit4]   2> 485888 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing 
registered processor for nodes: [127.0.0.1:37520_solr] added at times 
[842218960866360], now=842218960898904
   [junit4]   2> 485888 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2fdfe61fc4c38Tcsglumx64cd8fhgqs11dl0e5i",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":842218960866360,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842218960866360],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 485888 INFO  (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling 
logging.
   [junit4]   2> 485889 INFO  (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling 
logging.
   [junit4]   2> 485890 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 - removing 
marker path: /autoscaling/nodeAdded/127.0.0.1:37520_solr
   [junit4]   2> 485890 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2fdfe6166c937Tcsglumx64cd8fhgqs11dl0e5h",
   [junit4]   2>   "source":"node_added_trigger2",
   [junit4]   2>   "eventTime":842218951067959,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842218951067959],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":842218960529182,
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 485890 INFO  (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger2
   [junit4]   2> 485906 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 485906 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
   [junit4]   2> 485906 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 
5000ms
   [junit4]   2> 485906 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
   [junit4]   2> 485906 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 15 ms for event 
id=2fdfe6166c937Tcsglumx64cd8fhgqs11dl0e5h
   [junit4]   2> 490906 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3
   [junit4]   2> 490907 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
   [junit4]   2> 490908 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 490908 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing 
registered processor for nodes: [127.0.0.1:37520_solr] added at times 
[842218960866360], now=842223983101060
   [junit4]   2> 490907 DEBUG (ScheduledTrigger-2743-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
   [junit4]   2> 490908 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2fdfe61fc4c38Tcsglumx64cd8fhgqs11dl0e5l",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":842218960866360,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842218960866360],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 490908 DEBUG (ScheduledTrigger-2743-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 490908 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
node_added_trigger2, .scheduled_maintenance, node_added_trigger1]
   [junit4]   2> 490909 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 - removing 
marker path: /autoscaling/nodeAdded/127.0.0.1:37520_solr
   [junit4]   2> 490909 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2fdfe61fc4c38Tcsglumx64cd8fhgqs11dl0e5l",
   [junit4]   2>   "source":"node_added_trigger1",
   [junit4]   2>   "eventTime":842218960866360,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842218960866360],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":842223983345588,
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 490909 INFO  (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.TriggerIntegrationTest last action at 1543033267920000000 current 
time = 1543033272939000000
   [junit4]   2> real diff: 5019000000
   [junit4]   2>  min diff: 4998000000
   [junit4]   2> 490909 INFO  (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger1
   [junit4]   2> 490910 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 490910 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
   [junit4]   2> 490910 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 
5000ms
   [junit4]   2> 490910 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
   [junit4]   2> 490910 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event 
id=2fdfe61fc4c38Tcsglumx64cd8fhgqs11dl0e5l
   [junit4]   2> 490916 INFO  (qtp114027420-7538) [n:127.0.0.1:37520_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=2
   [junit4]   2> 490917 INFO  (qtp1736325798-7423) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 490920 INFO  (qtp1068046960-7508) [n:127.0.0.1:37940_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=1
   [junit4]   2> 490920 DEBUG (qtp114027420-7542) [n:127.0.0.1:37520_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 490921 INFO  (qtp114027420-7542) [n:127.0.0.1:37520_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=9
   [junit4]   2> 490921 DEBUG (zkCallback-2047-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
7
   [junit4]   2> 490922 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 7
   [junit4]   2> 490927 INFO  (qtp114027420-7541) [n:127.0.0.1:37520_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 490928 INFO  
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 490928 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger1 - Initial 
livenodes: [127.0.0.1:37855_solr, 127.0.0.1:37940_solr, 127.0.0.1:37520_solr]
   [junit4]   2> 490929 INFO  (qtp1736325798-7423) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 490929 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with 
currently live nodes: 3
   [junit4]   2> 490930 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, 
lastZnodeVersion 7
   [junit4]   2> 490931 INFO  (qtp1068046960-7510) [n:127.0.0.1:37940_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CONTAINER.fs.totalSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 490932 DEBUG (qtp1736325798-7418) [n:127.0.0.1:37855_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 490933 INFO  (qtp1736325798-7418) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=10
   [junit4]   2> 490933 DEBUG (zkCallback-2047-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
8
   [junit4]   2> 490934 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 8
   [junit4]   2> 490937 INFO  
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
   [junit4]   2> 490937 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger2 - Initial 
livenodes: [127.0.0.1:37855_solr, 127.0.0.1:37940_solr, 127.0.0.1:37520_solr]
   [junit4]   2> 490939 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.AbstractConnector Stopped 
ServerConnector@371ad43c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 490939 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with 
currently live nodes: 3
   [junit4]   2> 490941 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=284812152
   [junit4]   2> 490941 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, 
lastZnodeVersion 8
   [junit4]   2> 490941 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 490941 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@17c552d0: rootName = 
solr_37520, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@38ab9266
   [junit4]   2> 490946 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 490946 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4e774a38: rootName = 
solr_37520, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@c70e2fe
   [junit4]   2> 490949 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 490949 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@70cbed80: rootName = 
solr_37520, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@4173a1df
   [junit4]   2> 490952 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37520_solr
   [junit4]   2> 490954 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 490956 INFO  (zkCallback-2055-thread-2) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 490956 INFO  (zkCallback-2055-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 490956 INFO  (zkCallback-2047-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 490956 INFO  (zkCallback-2040-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 490957 INFO  (zkCallback-2074-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 490957 INFO  (zkCallback-2083-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 490957 INFO  (zkCallback-2067-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 491931 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with 
currently live nodes: 2
   [junit4]   2> 491931 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:37520_solr
   [junit4]   2> 491931 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost 
nodes: [127.0.0.1:37520_solr]
   [junit4]   2> 491931 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2fdffca58c8e4Tcsglumx64cd8fhgqs11dl0e5m",
   [junit4]   2>   "source":"node_lost_trigger1",
   [junit4]   2>   "eventTime":842225006725348,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842225006725348],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 491931 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger2, 
.auto_add_replicas, node_added_trigger2, .scheduled_maintenance, 
node_lost_trigger1, node_added_trigger1]
   [junit4]   2> 491932 INFO  (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling 
logging.
   [junit4]   2> 491932 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2fdffca58c8e4Tcsglumx64cd8fhgqs11dl0e5m",
   [junit4]   2>   "source":"node_lost_trigger1",
   [junit4]   2>   "eventTime":842225006725348,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842225006725348],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":842225007056190,
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 491932 INFO  (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.TriggerIntegrationTest action executed from node_lost_trigger1
   [junit4]   2> 491933 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger2 after 5000ms
   [junit4]   2> 491933 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 491933 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
   [junit4]   2> 491933 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 
5000ms
   [junit4]   2> 491933 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger1 after 5000ms
   [junit4]   2> 491933 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
   [junit4]   2> 491933 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 1 ms for event 
id=2fdffca58c8e4Tcsglumx64cd8fhgqs11dl0e5m
   [junit4]   2> 492456 WARN  (zkCallback-2090-thread-1) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 492458 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6140c7f{/solr,null,UNAVAILABLE}
   [junit4]   2> 492458 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 496936 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2
   [junit4]   2> 496937 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with 
currently live nodes: 2
   [junit4]   2> 496937 DEBUG (ScheduledTrigger-2743-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:37520_solr
   [junit4]   2> 496937 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:37520_solr
   [junit4]   2> 496937 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost 
nodes: [127.0.0.1:37520_solr]
   [junit4]   2> 496936 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
   [junit4]   2> 496937 DEBUG (ScheduledTrigger-2743-thread-2) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 496937 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"2fe00f4eb434bTcsglumx64cd8fhgqs11dl0e5o",
   [junit4]   2>   "source":"node_lost_trigger2",
   [junit4]   2>   "eventTime":842230015935307,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842230015935307],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 496938 DEBUG (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [node_lost_trigger2, 
.auto_add_replicas, node_added_trigger2, .scheduled_maintenance, 
node_lost_trigger1, node_added_trigger1]
   [junit4]   2> 496938 DEBUG (ScheduledTrigger-2743-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with 
currently live nodes: 2
   [junit4]   2> 496939 INFO  (ScheduledTrigger-2743-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling 
logging.
   [junit4]   2> 496939 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"2fe00f4eb434bTcsglumx64cd8fhgqs11dl0e5o",
   [junit4]   2>   "source":"node_lost_trigger2",
   [junit4]   2>   "eventTime":842230015935307,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[842230015935307],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":842230016587585,
   [junit4]   2>     "nodeNames":["127.0.0.1:37520_solr"]}}
   [junit4]   2> 496939 INFO  (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.TriggerIntegrationTest last action at 1543033273962000000 current 
time = 1543033278969000000
   [junit4]   2> real diff: 5007000000
   [junit4]   2>  min diff: 4998000000
   [junit4]   2> 496939 INFO  (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.TriggerIntegrationTest action executed from node_lost_trigger2
   [junit4]   2> 496940 INFO  
(TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[A0121F8A68651D2F]) [   
 ] o.a.s.SolrTestCaseJ4 ###Ending testTriggerThrottling
   [junit4]   2> 496953 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger2 after 5000ms
   [junit4]   2> 496954 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 5000ms
   [junit4]   2> 496954 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger2 after 5000ms
   [junit4]   2> 496954 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 
5000ms
   [junit4]   2> 496954 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger1 after 5000ms
   [junit4]   2> 496954 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_added_trigger1 after 5000ms
   [junit4]   2> 496954 DEBUG (AutoscalingActionExecutor-2744-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 15 ms for event 
id=2fe00f4eb434bTcsglumx64cd8fhgqs11dl0e5o
   [junit4]   2> 496966 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testContinueTriggersOnOverseerRestart
   [junit4]   2> 496969 INFO  (zkConnectionManagerCallback-2094-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 496973 INFO  (qtp1736325798-7423) [n:127.0.0.1:37855_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 496980 INFO  (qtp1736325798-7423) [n:127.0.0.1:37855_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=7
   [junit4]   2> 496981 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_lost_trigger2
   [junit4]   2> 496982 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .auto_add_replicas
   [junit4]   2> 496984 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_added_trigger2
   [junit4]   2> 496986 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: .scheduled_maintenance
   [junit4]   2> 496987 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_lost_trigger1
   [junit4]   2> 496988 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.a.ScheduledTriggers -- removing trigger: node_added_trigger1
   [junit4]   2> 496990 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode 
version 9
   [junit4]   2> 496990 DEBUG (zkCallback-2047-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
9
   [junit4]   2> 496990 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto 
znodeVersion 9
   [junit4]   2> 496991 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
   [junit4]   2> 496991 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 496991 DEBUG 
(OverseerAutoScalingTriggerThread-72112789135753223-127.0.0.1:37855_solr-n_0000000001)
 [    ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, 
lastZnodeVersion 9
   [junit4]   2> 496992 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 496995 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.e.j.s.AbstractConnector Stopped 
ServerConnector@12621b2e{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 496996 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1052937061
   [junit4]   2> 496996 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.node, tag=null
   [junit4]   2> 496996 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@5e483b01: rootName = 
solr_37855, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@553db5c8
   [junit4]   2> 497001 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jvm, tag=null
   [junit4]   2> 497001 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@6711766c: rootName = 
solr_37855, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@c70e2fe
   [junit4]   2> 497004 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty, tag=null
   [junit4]   2> 497004 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A0121F8A68651D2F])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporter

[...truncated too long message...]

rage
   [junit4] OK      0.02s J0 | 
TestManagedResourceStorage.testFileBasedJsonStorage
   [junit4] Completed [2/10] on J0 in 15.30s, 2 tests
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: 
org.apache.solr.rest.TestManagedResourceStorage. This may confuse tools that 
process XML reports. Set 'ignoreDuplicateSuites' to true to skip this message.
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] OK      20.7s J1 | TriggerIntegrationTest.testTriggerThrottling
   [junit4] OK      19.9s J1 | 
TriggerIntegrationTest.testContinueTriggersOnOverseerRestart
   [junit4] OK      16.2s J1 | TriggerIntegrationTest.testListeners
   [junit4] OK      14.7s J1 | TriggerIntegrationTest.testEventQueue
   [junit4] Completed [3/10] on J1 in 75.84s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] OK      20.1s J0 | TriggerIntegrationTest.testTriggerThrottling
   [junit4] OK      20.7s J0 | 
TriggerIntegrationTest.testContinueTriggersOnOverseerRestart
   [junit4] OK      17.4s J0 | TriggerIntegrationTest.testListeners
   [junit4] OK      14.9s J0 | TriggerIntegrationTest.testEventQueue
   [junit4] Completed [4/10] on J0 in 76.82s, 4 tests
   [junit4] 
   [junit4] Duplicate suite name used with XML reports: 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest. This may confuse 
tools that process XML reports. Set 'ignoreDuplicateSuites' to true to skip 
this message.
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] OK      19.2s J0 | TriggerIntegrationTest.testTriggerThrottling
   [junit4] OK      21.8s J0 | 
TriggerIntegrationTest.testContinueTriggersOnOverseerRestart
   [junit4] OK      15.6s J0 | TriggerIntegrationTest.testListeners
   [junit4] OK      13.9s J0 | TriggerIntegrationTest.testEventQueue
   [junit4] Completed [5/10] on J0 in 71.89s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] OK      18.4s J1 | TriggerIntegrationTest.testTriggerThrottling
   [junit4] OK      20.1s J1 | 
TriggerIntegrationTest.testContinueTriggersOnOverseerRestart
   [junit4] OK      16.1s J1 | TriggerIntegrationTest.testListeners
   [junit4] OK      16.6s J1 | TriggerIntegrationTest.testEventQueue
   [junit4] Completed [6/10] on J1 in 74.89s, 4 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.rest.TestManagedResourceStorage
   [junit4] OK      0.02s J1 | TestManagedResourceStorage.testZkBasedJsonStorage
   [junit4] OK      0.01s J1 | 
TestManagedResourceStorage.testFileBasedJsonStorage
   [junit4] Completed [7/10] on J1 in 4.74s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.rest.TestManagedResourceStorage
   [junit4] OK      0.02s J1 | TestManagedResourceStorage.testZkBasedJsonStorage
   [junit4] OK      0.01s J1 | 
TestManagedResourceStorage.testFileBasedJsonStorage
   [junit4] Completed [8/10] on J1 in 3.13s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.rest.TestManagedResourceStorage
   [junit4] OK      0.02s J1 | TestManagedResourceStorage.testZkBasedJsonStorage
   [junit4] OK      0.01s J1 | 
TestManagedResourceStorage.testFileBasedJsonStorage
   [junit4] Completed [9/10] on J1 in 2.64s, 2 tests
   [junit4] 
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4] OK      18.6s J0 | TriggerIntegrationTest.testTriggerThrottling
   [junit4] OK      21.3s J0 | 
TriggerIntegrationTest.testContinueTriggersOnOverseerRestart
   [junit4] OK      18.4s J0 | TriggerIntegrationTest.testListeners
   [junit4] OK      14.2s J0 | TriggerIntegrationTest.testEventQueue
   [junit4] Completed [10/10] on J0 in 74.86s, 4 tests
   [junit4] 
   [junit4] JVM J0:     0.78 ..   241.10 =   240.32s
   [junit4] JVM J1:     1.01 ..   177.92 =   176.90s
   [junit4] Execution time total: 4 minutes 1 second
   [junit4] Tests summary: 10 suites, 30 tests
   [junit4] Could not remove temporary path: 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1
 (java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J1/temp])
   [junit4] Could not remove temporary path: 
/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0
 (java.nio.file.DirectoryNotEmptyException: Remaining files: 
[/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris/solr/build/solr-core/test/J0/temp])
     [echo] 5 slowest tests:
[junit4:tophints] 332.31s | org.apache.solr.cloud.api.collections.ShardSplitTest
[junit4:tophints] 132.22s | org.apache.solr.cloud.cdcr.CdcrOpsAndBoundariesTest
[junit4:tophints] 128.76s | org.apache.solr.cloud.cdcr.CdcrWithNodesRestartsTest
[junit4:tophints] 121.74s | org.apache.solr.update.SoftAutoCommitTest
[junit4:tophints] 121.63s | org.apache.solr.cloud.DeleteReplicaTest

-check-totals:

test-nocompile:

BUILD SUCCESSFUL
Total time: 4 minutes 5 seconds
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[repro]   0/5 failed: org.apache.solr.rest.TestManagedResourceStorage
[repro] Exiting with code 0
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
java.lang.InterruptedException: no matches found within 10000
        at hudson.FilePath$ValidateAntFileMask.hasMatch(FilePath.java:2845)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2724)
        at hudson.FilePath$ValidateAntFileMask.invoke(FilePath.java:2705)
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3084)
Also:   hudson.remoting.Channel$CallSiteStackTrace: Remote call to Solaris VBOX
                at 
hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741)
                at 
hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357)
                at hudson.remoting.Channel.call(Channel.java:955)
                at hudson.FilePath.act(FilePath.java:1070)
                at hudson.FilePath.act(FilePath.java:1059)
                at hudson.FilePath.validateAntFileMask(FilePath.java:2703)
                at 
hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
                at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
                at 
hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
                at hudson.model.Build$BuildExecution.post2(Build.java:186)
                at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
                at hudson.model.Run.execute(Run.java:1835)
                at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
                at 
hudson.model.ResourceController.execute(ResourceController.java:97)
                at hudson.model.Executor.run(Executor.java:429)
Caused: hudson.FilePath$TunneledInterruptedException
        at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3086)
        at hudson.remoting.UserRequest.perform(UserRequest.java:212)
        at hudson.remoting.UserRequest.perform(UserRequest.java:54)
        at hudson.remoting.Request$2.run(Request.java:369)
        at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused: java.lang.InterruptedException: java.lang.InterruptedException: no 
matches found within 10000
        at hudson.FilePath.act(FilePath.java:1072)
        at hudson.FilePath.act(FilePath.java:1059)
        at hudson.FilePath.validateAntFileMask(FilePath.java:2703)
        at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:243)
        at 
hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
        at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
        at hudson.model.Build$BuildExecution.post2(Build.java:186)
        at 
hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
        at hudson.model.Run.execute(Run.java:1835)
        at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
        at hudson.model.ResourceController.execute(ResourceController.java:97)
        at hudson.model.Executor.run(Executor.java:429)
No artifacts found that match the file pattern 
"**/*.events,heapdumps/**,**/*_pid*.log". Configuration error?
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all 
warnings.
<Git Blamer> GIT_COMMIT=b0b3afca0aa64ad67d374651b1a9e81ea03af5fb, 
workspace=/export/home/jenkins/workspace/Lucene-Solr-7.x-Solaris
[WARNINGS] Computing warning deltas based on reference build #924
Recording test results
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to