Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21463/
Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger

Error Message:


Stack Trace:
java.lang.AssertionError
        at 
__randomizedtesting.SeedInfo.seed([A9EB3AE168C4453D:13E70D6E372C9372]:0)
        at org.junit.Assert.fail(Assert.java:92)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.junit.Assert.assertNull(Assert.java:562)
        at 
org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testMetricTrigger(TriggerIntegrationTest.java:1575)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12786 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
   [junit4]   2> Creating dataDir: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001/init-core-data-001
   [junit4]   2> 802798 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 802798 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 802799 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 802800 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001/tempDir-001
   [junit4]   2> 802800 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 802817 INFO  (Thread-1584) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 802817 INFO  (Thread-1584) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 802833 ERROR (Thread-1584) [    ] o.a.z.s.ZooKeeperServer 
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action 
on ERROR or SHUTDOWN server state changes
   [junit4]   2> 802917 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:42377
   [junit4]   2> 802919 INFO  (zkConnectionManagerCallback-6716-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 802922 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 802926 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 802926 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 802926 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 802926 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5df2163a{/solr,null,AVAILABLE}
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@58400f9{SSL,[ssl, 
http/1.1]}{127.0.0.1:34013}
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.e.j.s.Server Started @804532ms
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=34013}
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@7c103052{/solr,null,AVAILABLE}
   [junit4]   2> 802927 ERROR (jetty-launcher-6713-thread-1) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 802927 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-15T11:06:20.425057Z
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@7b63a0b2{SSL,[ssl, 
http/1.1]}{127.0.0.1:41113}
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.e.j.s.Server Started @804533ms
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=41113}
   [junit4]   2> 802928 ERROR (jetty-launcher-6713-thread-2) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.0.0
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 802928 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-15T11:06:20.425660Z
   [junit4]   2> 802937 INFO  (zkConnectionManagerCallback-6718-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 802937 INFO  (zkConnectionManagerCallback-6720-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 802937 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 802937 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 802940 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 
0x10056c7e4950002, likely client has closed socket
   [junit4]   2> 802946 INFO  (jetty-launcher-6713-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42377/solr
   [junit4]   2> 802946 INFO  (jetty-launcher-6713-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42377/solr
   [junit4]   2> 802961 INFO  (zkConnectionManagerCallback-6725-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 802965 INFO  (zkConnectionManagerCallback-6728-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 802973 INFO  
(zkConnectionManagerCallback-6730-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 802973 INFO  
(zkConnectionManagerCallback-6732-thread-1-processing-n:127.0.0.1:41113_solr) 
[n:127.0.0.1:41113_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 803020 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 803020 INFO  (jetty-launcher-6713-thread-2) 
[n:127.0.0.1:41113_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 803020 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:34013_solr
   [junit4]   2> 803021 INFO  (jetty-launcher-6713-thread-2) 
[n:127.0.0.1:41113_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41113_solr
   [junit4]   2> 803021 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.Overseer Overseer 
(id=72153010571378693-127.0.0.1:34013_solr-n_0000000000) starting
   [junit4]   2> 803030 INFO  
(zkCallback-6731-thread-1-processing-n:127.0.0.1:41113_solr) 
[n:127.0.0.1:41113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 803030 INFO  
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 803038 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 803039 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 1
   [junit4]   2> 803039 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:34013_solr
   [junit4]   2> 803039 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:41113_solr]
   [junit4]   2> 803046 INFO  
(zkCallback-6731-thread-1-processing-n:127.0.0.1:41113_solr) 
[n:127.0.0.1:41113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 803045 INFO  
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 803067 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion -1
   [junit4]   2> 803067 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 1
   [junit4]   2> 803069 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 803069 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 803070 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 2
   [junit4]   2> 803095 INFO  (jetty-launcher-6713-thread-2) 
[n:127.0.0.1:41113_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41113.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 803095 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_34013.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 803102 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_34013.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 803102 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_34013.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 803103 INFO  (jetty-launcher-6713-thread-2) 
[n:127.0.0.1:41113_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41113.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 803103 INFO  (jetty-launcher-6713-thread-2) 
[n:127.0.0.1:41113_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_41113.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 803103 INFO  (jetty-launcher-6713-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001/tempDir-001/node1/.
   [junit4]   2> 803104 INFO  (jetty-launcher-6713-thread-2) 
[n:127.0.0.1:41113_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001/tempDir-001/node2/.
   [junit4]   2> 803137 INFO  (zkConnectionManagerCallback-6738-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 803139 INFO  (zkConnectionManagerCallback-6742-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 803139 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 803139 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42377/solr ready
   [junit4]   2> 803147 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.SolrTestCaseJ4 ###Starting testNodeLostTrigger
   [junit4]   2> 803148 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
   [junit4]   2> 803148 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 2
   [junit4]   2> 803148 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 2
   [junit4]   2> 803148 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 803148 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 803149 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 803167 INFO  (qtp1881741465-15279) [n:127.0.0.1:34013_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 803172 INFO  (qtp1881741465-15279) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=5
   [junit4]   2> 803190 INFO  (qtp1881741465-15274) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 803217 INFO  (qtp1374920807-15288) [n:127.0.0.1:41113_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 803217 DEBUG (qtp1881741465-15277) [n:127.0.0.1:34013_solr    
] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 803218 INFO  (qtp1881741465-15277) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling 
params={wt=javabin&version=2} status=0 QTime=37
   [junit4]   2> 803218 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 3
   [junit4]   2> 803225 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:41113_solr, 127.0.0.1:34013_solr]
   [junit4]   2> 803225 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 3
   [junit4]   2> 803226 INFO  
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 803237 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 803237 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 803237 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.e.j.s.AbstractConnector Stopped ServerConnector@7b63a0b2{SSL,[ssl, 
http/1.1]}{127.0.0.1:0}
   [junit4]   2> 803238 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1462020950
   [junit4]   2> 803238 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, 
tag=null
   [junit4]   2> 803238 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@71d461bd: rootName = 
solr_41113, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@1da7b849
   [junit4]   2> 803245 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, 
tag=null
   [junit4]   2> 803245 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@76d0a7ff: rootName = 
solr_41113, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@1b51ad4d
   [junit4]   2> 803245 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_trigger with currently live nodes: 2
   [junit4]   2> 803250 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, 
tag=null
   [junit4]   2> 803250 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@40520222: rootName = 
solr_41113, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@3877d908
   [junit4]   2> 803255 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41113_solr
   [junit4]   2> 803256 INFO  
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 803256 INFO  
(zkCallback-6731-thread-1-processing-n:127.0.0.1:41113_solr) 
[n:127.0.0.1:41113_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (1)
   [junit4]   2> 803256 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, 
tag=null
   [junit4]   2> 803256 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 803262 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@7c103052{/solr,null,UNAVAILABLE}
   [junit4]   2> 803265 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.e.j.s.session Stopped scavenging
   [junit4]   2> 803265 INFO  (zkCallback-6741-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 804246 DEBUG (ScheduledTrigger-3603-thread-2) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_trigger with currently live nodes: 1
   [junit4]   2> 804246 DEBUG (ScheduledTrigger-3603-thread-2) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 
127.0.0.1:41113_solr
   [junit4]   2> 805177 INFO  
(OverseerCollectionConfigSetProcessor-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 805246 DEBUG (ScheduledTrigger-3603-thread-2) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
node_lost_trigger with currently live nodes: 1
   [junit4]   2> 805246 DEBUG (ScheduledTrigger-3603-thread-2) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing 
registered processor for lost nodes: [127.0.0.1:41113_solr]
   [junit4]   2> 805247 DEBUG (ScheduledTrigger-3603-thread-2) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"52c2bf482a90fT8dwkzyh91dh5gzztfa13vcaus",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":1455942180972815,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1455942180972815],
   [junit4]   2>     "nodeNames":["127.0.0.1:41113_solr"]}}
   [junit4]   2> 805247 DEBUG (ScheduledTrigger-3603-thread-2) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_lost_trigger]
   [junit4]   2> 805247 INFO  (ScheduledTrigger-3603-thread-2) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 805248 DEBUG 
(AutoscalingActionExecutor-3604-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"52c2bf482a90fT8dwkzyh91dh5gzztfa13vcaus",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":1455942180972815,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1455942180972815],
   [junit4]   2>     "_enqueue_time_":1455943181783301,
   [junit4]   2>     "nodeNames":["127.0.0.1:41113_solr"]}}
   [junit4]   2> 805249 DEBUG 
(AutoscalingActionExecutor-3604-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_lost_trigger after 5000ms
   [junit4]   2> 805249 DEBUG 
(AutoscalingActionExecutor-3604-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 1 
ms for event id=52c2bf482a90fT8dwkzyh91dh5gzztfa13vcaus
   [junit4]   2> 805250 INFO  (qtp1881741465-15278) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 805250 DEBUG (qtp1881741465-15279) [n:127.0.0.1:34013_solr    
] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 805251 INFO  (qtp1881741465-15279) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 805251 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 4
   [junit4]   2> 805251 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:34013_solr]
   [junit4]   2> 805251 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 4
   [junit4]   2> 805251 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 805252 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 807251 INFO  
(TEST-TriggerIntegrationTest.testNodeLostTrigger-seed#[A9EB3AE168C4453D]) [    
] o.a.s.SolrTestCaseJ4 ###Ending testNodeLostTrigger
   [junit4]   2> 807255 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
   [junit4]   2> 807255 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode 
version 5
   [junit4]   2> 807255 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 5
   [junit4]   2> 807255 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 5
   [junit4]   2> 807256 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 807256 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 807256 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 807256 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 807258 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 807258 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 807258 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 807261 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@68c42721{/solr,null,AVAILABLE}
   [junit4]   2> 807262 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.AbstractConnector Started ServerConnector@35e399fa{SSL,[ssl, 
http/1.1]}{127.0.0.1:35339}
   [junit4]   2> 807262 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.Server Started @808867ms
   [junit4]   2> 807262 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=35339}
   [junit4]   2> 807262 ERROR 
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 807262 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? 
version 8.0.0
   [junit4]   2> 807262 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 807262 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 807262 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-15T11:06:24.759959Z
   [junit4]   2> 807263 INFO  (zkConnectionManagerCallback-6744-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 807264 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 807267 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42377/solr
   [junit4]   2> 807268 INFO  (zkConnectionManagerCallback-6748-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 807269 INFO  
(zkConnectionManagerCallback-6750-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 807270 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:35339_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 807271 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:35339_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 807272 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:35339_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:35339_solr
   [junit4]   2> 807272 INFO  
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 807272 INFO  (zkCallback-6741-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 807273 INFO  
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 807308 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:35339_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35339.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 807318 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:35339_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35339.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 807318 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:35339_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_35339.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 807319 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:35339_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001/tempDir-001/node3/.
   [junit4]   2> 807347 INFO  (qtp1881741465-15274) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 807366 INFO  (qtp855854585-15347) [n:127.0.0.1:35339_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 807367 DEBUG (qtp1881741465-15277) [n:127.0.0.1:34013_solr    
] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 807367 INFO  (qtp1881741465-15277) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=21
   [junit4]   2> 807367 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 6
   [junit4]   2> 807369 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:35339_solr, 127.0.0.1:34013_solr]
   [junit4]   2> 807369 DEBUG 
(zkCallback-6729-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS instantiated with properties: {event=nodeAdded, 
waitFor=10, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 807369 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 6
   [junit4]   2> 807370 INFO  
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 807370 INFO  (qtp1881741465-15279) [n:127.0.0.1:34013_solr    
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 807370 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 807371 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 6, lastZnodeVersion 6
   [junit4]   2> 807371 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 807371 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 807373 INFO  (qtp1881741465-15279) [n:127.0.0.1:34013_solr    
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 807374 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 807378 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 807378 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 807378 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 807378 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@d7fdedd{/solr,null,AVAILABLE}
   [junit4]   2> 807378 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.AbstractConnector Started ServerConnector@54f11f6c{SSL,[ssl, 
http/1.1]}{127.0.0.1:36719}
   [junit4]   2> 807378 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.Server Started @808984ms
   [junit4]   2> 807379 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36719}
   [junit4]   2> 807379 ERROR 
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 807379 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? 
version 8.0.0
   [junit4]   2> 807379 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 807379 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 807379 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-15T11:06:24.876442Z
   [junit4]   2> 807380 INFO  (zkConnectionManagerCallback-6754-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 807380 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 807387 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42377/solr
   [junit4]   2> 807388 INFO  (zkConnectionManagerCallback-6758-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 807389 INFO  
(zkConnectionManagerCallback-6760-thread-1-processing-n:127.0.0.1:36719_solr) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 807392 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:36719_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 807393 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:36719_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 807394 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:36719_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36719_solr
   [junit4]   2> 807395 INFO  
(zkCallback-6729-thread-2-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 807395 INFO  (zkCallback-6741-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 807395 INFO  
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 807395 INFO  
(zkCallback-6759-thread-1-processing-n:127.0.0.1:36719_solr) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 807453 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:36719_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36719.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 807464 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:36719_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36719.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 807464 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:36719_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_36719.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 807466 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:36719_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001/tempDir-001/node4/.
   [junit4]   2> 808372 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 808372 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 808372 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:36719_solr at time 1455946306756997
   [junit4]   2> 809372 INFO  
(OverseerCollectionConfigSetProcessor-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: 
/overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may 
have disconnected from ZooKeeper
   [junit4]   2> 809372 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 809372 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 810372 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 810373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 811373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 811373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 812373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 812373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 813373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 813373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 814373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 814373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 815373 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 815374 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 816374 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 816374 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 817374 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 817374 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 818377 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 818377 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 818377 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS firing registered processor for nodes: 
[127.0.0.1:36719_solr] added at times [1455946306756997], now=1455956312223917
   [junit4]   2> 818378 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"52c2cea6d2185T8dwkzyh91dh5gzztfa13vcauu",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1455946306756997,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1455946306756997],
   [junit4]   2>     "nodeNames":["127.0.0.1:36719_solr"]}}
   [junit4]   2> 818378 DEBUG (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[node_added_triggerEFRS]
   [junit4]   2> 818378 INFO  (ScheduledTrigger-3603-thread-4) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 818379 DEBUG 
(AutoscalingActionExecutor-3604-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"52c2cea6d2185T8dwkzyh91dh5gzztfa13vcauu",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1455946306756997,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1455946306756997],
   [junit4]   2>     "_enqueue_time_":1455956312549164,
   [junit4]   2>     "nodeNames":["127.0.0.1:36719_solr"]}}
   [junit4]   2> 818380 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 
2017-11-22T08:27:37+11:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 818384 DEBUG 
(AutoscalingActionExecutor-3604-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_triggerEFRS after 5000ms
   [junit4]   2> 818384 DEBUG 
(AutoscalingActionExecutor-3604-thread-1-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 5 
ms for event id=52c2cea6d2185T8dwkzyh91dh5gzztfa13vcauu
   [junit4]   2> 818396 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 818396 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 818396 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 818396 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@18317022{/solr,null,AVAILABLE}
   [junit4]   2> 818397 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.AbstractConnector Started ServerConnector@726ea1b8{SSL,[ssl, 
http/1.1]}{127.0.0.1:38201}
   [junit4]   2> 818397 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.Server Started @820002ms
   [junit4]   2> 818397 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=38201}
   [junit4]   2> 818397 ERROR 
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 818397 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? 
version 8.0.0
   [junit4]   2> 818397 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 818397 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 818397 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2018-02-15T11:06:35.894557Z
   [junit4]   2> 818405 INFO  (zkConnectionManagerCallback-6764-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 818406 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 818421 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42377/solr
   [junit4]   2> 818453 INFO  (zkConnectionManagerCallback-6768-thread-1) [    
] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 818469 INFO  
(zkConnectionManagerCallback-6770-thread-1-processing-n:127.0.0.1:38201_solr) 
[n:127.0.0.1:38201_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 818476 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:38201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 818477 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:38201_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 818486 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:38201_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:38201_solr
   [junit4]   2> 818487 INFO  
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 818487 INFO  (zkCallback-6741-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 818487 INFO  
(zkCallback-6759-thread-1-processing-n:127.0.0.1:36719_solr) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 818488 INFO  
(zkCallback-6729-thread-2-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 818510 INFO  
(zkCallback-6769-thread-1-processing-n:127.0.0.1:38201_solr) 
[n:127.0.0.1:38201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 818525 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:38201_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38201.solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 818535 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:38201_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38201.solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 818536 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:38201_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr_38201.solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@2c674d97
   [junit4]   2> 818537 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [n:127.0.0.1:38201_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001/tempDir-001/node5/.
   [junit4]   2> 823384 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 823385 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 823385 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 
127.0.0.1:38201_solr at time 1455961319512741
   [junit4]   2> 824385 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 824385 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 825385 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 825385 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 826386 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 826386 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 827386 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 827386 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 828386 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 828386 DEBUG (ScheduledTrigger-3603-thread-1) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 4
   [junit4]   2> 828640 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@58400f9{SSL,[ssl, 
http/1.1]}{127.0.0.1:0}
   [junit4]   2> 828640 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=236052155
   [junit4]   2> 828640 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.node, tag=null
   [junit4]   2> 828641 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@f3009a1: rootName = 
solr_34013, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@650df9c6
   [junit4]   2> 828647 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jvm, tag=null
   [junit4]   2> 828647 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@36bcfa53: rootName = 
solr_34013, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@1b51ad4d
   [junit4]   2> 828660 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty, tag=null
   [junit4]   2> 828660 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@5b532fd9: rootName = 
solr_34013, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@3877d908
   [junit4]   2> 828661 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:34013_solr
   [junit4]   2> 828663 INFO  (zkCallback-6741-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 828663 INFO  
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 828663 INFO  
(zkCallback-6769-thread-1-processing-n:127.0.0.1:38201_solr) 
[n:127.0.0.1:38201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 828663 INFO  
(zkCallback-6759-thread-1-processing-n:127.0.0.1:36719_solr) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 828664 INFO  
(zkCallback-6729-thread-2-processing-n:127.0.0.1:34013_solr) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (3)
   [junit4]   2> 828664 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 828664 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 828665 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.Overseer Overseer 
(id=72153010571378693-127.0.0.1:34013_solr-n_0000000000) closing
   [junit4]   2> 828665 INFO  
(OverseerStateUpdate-72153010571378693-127.0.0.1:34013_solr-n_0000000000) 
[n:127.0.0.1:34013_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:34013_solr
   [junit4]   2> 828674 WARN  
(OverseerAutoScalingTriggerThread-72153010571378693-127.0.0.1:34013_solr-n_0000000000)
 [n:127.0.0.1:34013_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 828674 DEBUG 
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 828675 INFO  
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:35339_solr
   [junit4]   2> 828676 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@5df2163a{/solr,null,UNAVAILABLE}
   [junit4]   2> 828676 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 828676 INFO  
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.Overseer Overseer 
(id=72153010571378699-127.0.0.1:35339_solr-n_0000000002) starting
   [junit4]   2> 828704 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 828705 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 7
   [junit4]   2> 828705 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:35339_solr, 127.0.0.1:38201_solr, 127.0.0.1:36719_solr]
   [junit4]   2> 828705 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS instantiated with properties: {event=nodeAdded, 
waitFor=10, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 828705 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:35339_solr, 127.0.0.1:38201_solr, 127.0.0.1:36719_solr]
   [junit4]   2> 828705 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 7, lastZnodeVersion -1
   [junit4]   2> 828705 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 7
   [junit4]   2> 828706 INFO  
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 828706 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Adding node from 
marker path: 127.0.0.1:38201_solr
   [junit4]   2> 828710 DEBUG (ScheduledTrigger-3631-thread-1) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 828710 DEBUG (ScheduledTrigger-3631-thread-1) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 828713 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 7, lastZnodeVersion 7
   [junit4]   2> 828714 DEBUG (ScheduledTrigger-3631-thread-2) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 829710 DEBUG (ScheduledTrigger-3631-thread-1) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 829710 DEBUG (ScheduledTrigger-3631-thread-1) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 829714 DEBUG (ScheduledTrigger-3631-thread-1) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 830711 DEBUG (ScheduledTrigger-3631-thread-2) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 830711 DEBUG (ScheduledTrigger-3631-thread-2) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 830721 DEBUG (ScheduledTrigger-3631-thread-4) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 831711 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 831711 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 831721 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 832711 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 832711 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 832721 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 3
   [junit4]   2> 833711 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerEFRS
   [junit4]   2> 833712 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 833712 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerEFRS firing registered processor for nodes: 
[127.0.0.1:38201_solr] added at times [1455961319512741], now=1455971646514536
   [junit4]   2> 833712 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown 
inactive - processing event: {
   [junit4]   2>   "id":"52c3069419aa5T8dwkzyh91dh5gzztfa13vcauw",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1455961319512741,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1455961319512741],
   [junit4]   2>     "nodeNames":["127.0.0.1:38201_solr"]}}
   [junit4]   2> 833712 DEBUG (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: 
[.auto_add_replicas, node_added_triggerEFRS]
   [junit4]   2> 833712 INFO  (ScheduledTrigger-3631-thread-3) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.SystemLogListener Collection .system 
does not exist, disabling logging.
   [junit4]   2> 833713 DEBUG 
(AutoscalingActionExecutor-3632-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.ScheduledTriggers -- processing actions 
for {
   [junit4]   2>   "id":"52c3069419aa5T8dwkzyh91dh5gzztfa13vcauw",
   [junit4]   2>   "source":"node_added_triggerEFRS",
   [junit4]   2>   "eventTime":1455961319512741,
   [junit4]   2>   "eventType":"NODEADDED",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1455961319512741],
   [junit4]   2>     "_enqueue_time_":1455971646877972,
   [junit4]   2>     "nodeNames":["127.0.0.1:38201_solr"]}}
   [junit4]   2> 833713 INFO  
(TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testEventFromRestoredState
   [junit4]   2> 833716 DEBUG 
(AutoscalingActionExecutor-3632-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
.auto_add_replicas after 5000ms
   [junit4]   2> 833716 DEBUG 
(AutoscalingActionExecutor-3632-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.ScheduledTriggers Resuming trigger: 
node_added_triggerEFRS after 5000ms
   [junit4]   2> 833716 DEBUG 
(AutoscalingActionExecutor-3632-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.ScheduledTriggers -- processing took 3 
ms for event id=52c3069419aa5T8dwkzyh91dh5gzztfa13vcauw
   [junit4]   2> 833722 INFO  
(TEST-TriggerIntegrationTest.testSetProperties-seed#[A9EB3AE168C4453D]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testSetProperties
   [junit4]   2> 833722 INFO  
(TEST-TriggerIntegrationTest.testSetProperties-seed#[A9EB3AE168C4453D]) [    ] 
o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 8
   [junit4]   2> 833722 DEBUG 
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 8
   [junit4]   2> 833723 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 8
   [junit4]   2> 833724 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 833725 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 833726 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 8, lastZnodeVersion 8
   [junit4]   2> 834727 DEBUG 
(TEST-TriggerIntegrationTest.testSetProperties-seed#[A9EB3AE168C4453D]) [    ] 
o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: 
triggerScheduleDelaySeconds from: 1 to: 4
   [junit4]   2> 842738 DEBUG 
(TEST-TriggerIntegrationTest.testSetProperties-seed#[A9EB3AE168C4453D]) [    ] 
o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: 
triggerScheduleDelaySeconds from: 4 to: 1
   [junit4]   2> 852742 DEBUG 
(TEST-TriggerIntegrationTest.testSetProperties-seed#[A9EB3AE168C4453D]) [    ] 
o.a.s.c.a.ScheduledTriggers Changing value of autoscaling property: 
triggerCorePoolSize from: 4 to: 6
   [junit4]   2> 862746 INFO  
(TEST-TriggerIntegrationTest.testSetProperties-seed#[A9EB3AE168C4453D]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testSetProperties
   [junit4]   2> 862753 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testContinueTriggersOnOverseerRestart
   [junit4]   2> 862754 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode 
version 9
   [junit4]   2> 862754 DEBUG 
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 9
   [junit4]   2> 862754 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 9
   [junit4]   2> 862754 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 862754 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeAdded markers
   [junit4]   2> 862754 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 9, lastZnodeVersion 9
   [junit4]   2> 862757 INFO  (qtp855854585-15348) [n:127.0.0.1:35339_solr    ] 
o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with 
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 862765 INFO  (qtp855854585-15348) [n:127.0.0.1:35339_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections 
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=8
   [junit4]   2> 862768 INFO  (qtp855854585-15345) [n:127.0.0.1:35339_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 862785 INFO  (qtp356462246-15376) [n:127.0.0.1:36719_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 862797 INFO  (qtp42933379-15400) [n:127.0.0.1:38201_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics 
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
 status=0 QTime=0
   [junit4]   2> 862801 DEBUG (qtp855854585-15347) [n:127.0.0.1:35339_solr    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 862802 DEBUG 
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 10
   [junit4]   2> 862802 INFO  (qtp855854585-15347) [n:127.0.0.1:35339_solr    ] 
o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling 
params={wt=javabin&version=2} status=0 QTime=35
   [junit4]   2> 862804 DEBUG 
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:35339_solr, 127.0.0.1:38201_solr, 127.0.0.1:36719_solr]
   [junit4]   2> 862804 DEBUG 
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerCTOOR instantiated with properties: {event=nodeAdded, 
waitFor=3, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 862804 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 10
   [junit4]   2> 862805 INFO  
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 862805 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread -- clean old 
nodeLost markers
   [junit4]   2> 862805 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 10, lastZnodeVersion 10
   [junit4]   2> 862805 DEBUG (ScheduledTrigger-3631-thread-1) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerCTOOR
   [junit4]   2> 862805 DEBUG (ScheduledTrigger-3631-thread-1) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 3
   [junit4]   2> 862809 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@35e399fa{SSL,[ssl, 
http/1.1]}{127.0.0.1:0}
   [junit4]   2> 862809 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=710694926
   [junit4]   2> 862810 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.node, tag=null
   [junit4]   2> 862810 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1d0152cb: rootName = 
solr_35339, domain = solr.node, service url = null, agent id = null] for 
registry solr.node / com.codahale.metrics.MetricRegistry@1a3a78d2
   [junit4]   2> 862818 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jvm, tag=null
   [junit4]   2> 862818 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@648b96c1: rootName = 
solr_35339, domain = solr.jvm, service url = null, agent id = null] for 
registry solr.jvm / com.codahale.metrics.MetricRegistry@1b51ad4d
   [junit4]   2> 862824 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.jetty, tag=null
   [junit4]   2> 862824 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@4011c037: rootName = 
solr_35339, domain = solr.jetty, service url = null, agent id = null] for 
registry solr.jetty / com.codahale.metrics.MetricRegistry@3877d908
   [junit4]   2> 862824 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.ZkController Remove node as live in 
ZooKeeper:/live_nodes/127.0.0.1:35339_solr
   [junit4]   2> 862825 INFO  
(zkCallback-6759-thread-1-processing-n:127.0.0.1:36719_solr) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (2)
   [junit4]   2> 862825 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.m.SolrMetricManager Closing metric reporters for 
registry=solr.cluster, tag=null
   [junit4]   2> 862825 INFO  
(zkCallback-6769-thread-1-processing-n:127.0.0.1:38201_solr) 
[n:127.0.0.1:38201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (2)
   [junit4]   2> 862825 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 
2147483647 transient cores
   [junit4]   2> 862825 INFO  (zkCallback-6741-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
   [junit4]   2> 862825 INFO  
(zkCallback-6749-thread-1-processing-n:127.0.0.1:35339_solr) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (2)
   [junit4]   2> 862825 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.Overseer Overseer 
(id=72153010571378699-127.0.0.1:35339_solr-n_0000000002) closing
   [junit4]   2> 862825 INFO  
(OverseerStateUpdate-72153010571378699-127.0.0.1:35339_solr-n_0000000002) 
[n:127.0.0.1:35339_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:35339_solr
   [junit4]   2> 862829 WARN  
(OverseerAutoScalingTriggerThread-72153010571378699-127.0.0.1:35339_solr-n_0000000002)
 [n:127.0.0.1:35339_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 862829 DEBUG 
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 862831 INFO  
(zkCallback-6759-thread-1-processing-n:127.0.0.1:36719_solr) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:36719_solr
   [junit4]   2> 862831 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@68c42721{/solr,null,UNAVAILABLE}
   [junit4]   2> 862831 INFO  
(TEST-TriggerIntegrationTest.testContinueTriggersOnOverseerRestart-seed#[A9EB3AE168C4453D])
 [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 862831 INFO  
(zkCallback-6759-thread-1-processing-n:127.0.0.1:36719_solr) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.Overseer Overseer 
(id=72153010571378702-127.0.0.1:36719_solr-n_0000000003) starting
   [junit4]   2> 862834 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.OverseerTriggerThread Adding 
.autoAddReplicas trigger
   [junit4]   2> 862834 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.OverseerTriggerThread Refreshing 
/autoscaling.json with znode version 11
   [junit4]   2> 862835 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: 
[127.0.0.1:38201_solr, 127.0.0.1:36719_solr]
   [junit4]   2> 862835 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger 
node_added_triggerCTOOR instantiated with properties: {event=nodeAdded, 
waitFor=3, actions=[{name=test, 
class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}],
 enabled=true}
   [junit4]   2> 862835 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeLostTrigger Initial livenodes: 
[127.0.0.1:38201_solr, 127.0.0.1:36719_solr]
   [junit4]   2> 862835 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 11, lastZnodeVersion -1
   [junit4]   2> 862835 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.OverseerTriggerThread Processed trigger 
updates upto znodeVersion 11
   [junit4]   2> 862835 INFO  
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.TriggerIntegrationTest 
TestTriggerAction init
   [junit4]   2> 862836 DEBUG (ScheduledTrigger-3638-thread-1) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerCTOOR
   [junit4]   2> 862836 DEBUG (ScheduledTrigger-3638-thread-1) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 862836 DEBUG 
(OverseerAutoScalingTriggerThread-72153010571378702-127.0.0.1:36719_solr-n_0000000003)
 [n:127.0.0.1:36719_solr    ] o.a.s.c.a.OverseerTriggerThread Current 
znodeVersion 11, lastZnodeVersion 11
   [junit4]   2> 862836 DEBUG (ScheduledTrigger-3638-thread-2) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: 
.auto_add_replicas with currently live nodes: 2
   [junit4]   2> 863836 DEBUG (ScheduledTrigger-3638-thread-1) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeAddedTrigger Running 
NodeAddedTrigger node_added_triggerCTOOR
   [junit4]   2> 863836 DEBUG (ScheduledTrigger-3638-thread-1) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 2
   [junit4]   2> 863837 DEBUG (ScheduledTrigger-3638-thread-3) 
[n:127.0.0.1:36719_solr    ] o.a.s.c.a.NodeLostTrigger Running No

[...truncated too long message...]

4]   2> 997057 INFO  
(zkCallback-6829-thread-2-processing-n:127.0.0.1:36753_solr) 
[n:127.0.0.1:36753_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/collections/testMetricTrigger/state.json] for collection 
[testMetricTrigger] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 997069 INFO  (coreCloseExecutor-3801-thread-1) 
[n:127.0.0.1:37901_solr c:collection1 s:shard1 r:core_node10 
x:collection1_shard1_replica_n9] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=339742430
   [junit4]   2> 997074 INFO  (jetty-closer-6714-thread-13) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@14e3d195{/solr,null,UNAVAILABLE}
   [junit4]   2> 997075 INFO  (jetty-closer-6714-thread-13) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 997079 INFO  (coreCloseExecutor-3804-thread-1) 
[n:127.0.0.1:37617_solr c:testMetricTrigger s:shard2 r:core_node4 
x:testMetricTrigger_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.testMetricTrigger.shard2.leader, 
tag=847372855
   [junit4]   2> 997084 INFO  (jetty-closer-6714-thread-11) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@52beeb95{/solr,null,UNAVAILABLE}
   [junit4]   2> 997084 INFO  (jetty-closer-6714-thread-11) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 997095 INFO  (coreCloseExecutor-3809-thread-2) 
[n:127.0.0.1:43023_solr c:collection1 s:shard1 r:core_node8 
x:collection1_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.core.collection1.shard1.replica_n7, tag=1180392828
   [junit4]   2> 997095 INFO  (coreCloseExecutor-3805-thread-1) 
[n:127.0.0.1:37689_solr c:collection1 s:shard1 r:core_node4 
x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1260595768
   [junit4]   2> 997095 INFO  (coreCloseExecutor-3806-thread-1) 
[n:127.0.0.1:36753_solr c:testMetricTrigger s:shard1 r:core_node3 
x:testMetricTrigger_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.testMetricTrigger.shard1.leader, 
tag=1389844347
   [junit4]   2> 997099 INFO  (coreCloseExecutor-3809-thread-2) 
[n:127.0.0.1:43023_solr c:collection1 s:shard1 r:core_node8 
x:collection1_shard1_replica_n7] o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@1707f372: rootName = 
solr_43023, domain = solr.core.collection1.shard1.replica_n7, service url = 
null, agent id = null] for registry solr.core.collection1.shard1.replica_n7 / 
com.codahale.metrics.MetricRegistry@831e58f
   [junit4]   2> 997109 INFO  (coreCloseExecutor-3809-thread-2) 
[n:127.0.0.1:43023_solr c:collection1 s:shard1 r:core_node8 
x:collection1_shard1_replica_n7] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=1180392828
   [junit4]   2> 997114 INFO  (coreCloseExecutor-3809-thread-1) 
[n:127.0.0.1:43023_solr c:collection1 s:shard1 r:core_node6 
x:collection1_shard1_replica_n5] o.a.s.m.SolrMetricManager Closing metric 
reporters for registry=solr.collection.collection1.shard1.leader, tag=638551310
   [junit4]   2> 997125 INFO  (jetty-closer-6714-thread-5) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@75d89ba5{/solr,null,UNAVAILABLE}
   [junit4]   2> 997126 INFO  (jetty-closer-6714-thread-5) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 997147 INFO  (jetty-closer-6714-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72153010571378711-127.0.0.1:37689_solr-n_0000000006) closing
   [junit4]   2> 997147 INFO  
(OverseerStateUpdate-72153010571378711-127.0.0.1:37689_solr-n_0000000006) 
[n:127.0.0.1:37689_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:37689_solr
   [junit4]   2> 997155 WARN  
(OverseerAutoScalingTriggerThread-72153010571378711-127.0.0.1:37689_solr-n_0000000006)
 [n:127.0.0.1:37689_solr    ] o.a.s.c.a.OverseerTriggerThread 
OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 997156 DEBUG (jetty-closer-6714-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 997159 INFO  (jetty-closer-6714-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@756e0b8{/solr,null,UNAVAILABLE}
   [junit4]   2> 997159 INFO  (jetty-closer-6714-thread-1) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 998646 INFO  (jetty-closer-6714-thread-10) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@6490d3fd{/solr,null,UNAVAILABLE}
   [junit4]   2> 998646 INFO  (jetty-closer-6714-thread-10) [    ] 
o.e.j.s.session Stopped scavenging
   [junit4]   2> 998648 ERROR 
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 998648 INFO  
(SUITE-TriggerIntegrationTest-seed#[A9EB3AE168C4453D]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:42377 42377
   [junit4]   2> 1008608 INFO  (Thread-1584) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:42377 42377
   [junit4]   2> 1008608 WARN  (Thread-1584) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        23      /solr/aliases.json
   [junit4]   2>        22      /solr/security.json
   [junit4]   2>        17      /solr/collections/collection1/terms/shard1
   [junit4]   2>        6       /solr/configs/conf
   [junit4]   2>        2       /solr/collections/testMetricTrigger/terms/shard1
   [junit4]   2>        2       /solr/collections/testMetricTrigger/terms/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        51      /solr/collections/collection1/state.json
   [junit4]   2>        23      /solr/clusterprops.json
   [junit4]   2>        23      /solr/clusterstate.json
   [junit4]   2>        13      /solr/collections/testMetricTrigger/state.json
   [junit4]   2>        6       /solr/autoscaling.json
   [junit4]   2>        4       
/solr/overseer_elect/election/72153010571378723-127.0.0.1:36753_solr-n_0000000010
   [junit4]   2>        3       
/solr/overseer_elect/election/72153010571378711-127.0.0.1:37689_solr-n_0000000006
   [junit4]   2>        2       
/solr/overseer_elect/election/72153010571378741-127.0.0.1:37617_solr-n_0000000016
   [junit4]   2>        2       
/solr/collections/collection1/leader_elect/shard1/election/72153010571378711-core_node4-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/72153010571378714-127.0.0.1:33949_solr-n_0000000007
   [junit4]   2>        2       
/solr/overseer_elect/election/72153010571378732-127.0.0.1:39829_solr-n_0000000013
   [junit4]   2>        2       
/solr/overseer_elect/election/72153010571378750-127.0.0.1:41097_solr-n_0000000019
   [junit4]   2>        2       
/solr/overseer_elect/election/72153010571378693-127.0.0.1:34013_solr-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        23      /solr/live_nodes
   [junit4]   2>        23      /solr/collections
   [junit4]   2>        6       /solr/overseer/queue-work
   [junit4]   2>        6       /solr/autoscaling/events/.auto_add_replicas
   [junit4]   2>        6       /solr/overseer/queue
   [junit4]   2>        6       /solr/overseer/collection-queue-work
   [junit4]   2>        2       /solr/autoscaling/events/node_lost_triggerMR
   [junit4]   2>        2       /solr/autoscaling/events/node_added_triggerCTOOR
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_A9EB3AE168C4453D-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): 
{_version_=PostingsFormat(name=LuceneVarGapFixedInterval), id=FSTOrd50, 
x_s=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, 
maxPointsInLeafNode=334, maxMBSortInHeap=7.9551900302203595, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@579fe8db),
 locale=en-AG, timezone=EST
   [junit4]   2> NOTE: Linux 4.13.0-32-generic amd64/Oracle Corporation 9.0.4 
(64-bit)/cpus=8,threads=1,free=318710920,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestUtils, UtilsToolTest, 
MetricTriggerTest, TestExclusionRuleCollectionAccess, ForceLeaderTest, 
TestPolicyCloud, TestManagedSchema, RankQueryTest, TestUniqueKeyFieldResource, 
ShowFileRequestHandlerTest, DisMaxRequestHandlerTest, 
TestOnReconnectListenerSupport, TestStressLiveNodes, 
CollectionTooManyReplicasTest, TestZkAclsWithHadoopAuth, 
SolrCmdDistributorTest, TestScoreJoinQPScore, BasicAuthStandaloneTest, 
SparseHLLTest, TestAtomicUpdateErrorCases, TestPullReplicaErrorHandling, 
TestDelegationWithHadoopAuth, TestCorePropertiesReload, SuggestComponentTest, 
UnloadDistributedZkTest, IndexSchemaRuntimeFieldTest, TestCoreDiscovery, 
URLClassifyProcessorTest, CoreAdminRequestStatusTest, 
DistributedFacetExistsSmallTest, TestFaceting, BaseCdcrDistributedZkTest, 
ConcurrentDeleteAndCreateCollectionTest, TestDefaultStatsCache, TestSQLHandler, 
TestImplicitCoreProperties, TestJsonFacets, TestStreamBody, SearchHandlerTest, 
SpatialRPTFieldTypeTest, TestCloudPivotFacet, CopyFieldTest, 
TestGraphTermsQParserPlugin, TestAnalyzedSuggestions, DeleteReplicaTest, 
ExecutePlanActionTest, TestSegmentSorting, TestLegacyNumericRangeQueryBuilder, 
DistributedSpellCheckComponentTest, TestConfigSetsAPIExclusivity, 
TestSolrQueryResponse, CoreAdminHandlerTest, TestCopyFieldCollectionResource, 
JSONWriterTest, QueryResultKeyTest, SpellCheckComponentTest, 
TestCloudSchemaless, ConjunctionSolrSpellCheckerTest, 
TestBlendedInfixSuggestions, TestRebalanceLeaders, TestPKIAuthenticationPlugin, 
TriggerIntegrationTest]
   [junit4] Completed [217/776 (1!)] on J2 in 205.83s, 14 tests, 1 failure <<< 
FAILURES!

[...truncated 43032 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to