Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/3594/
Java: 64bit/jdk-14.0.1 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard

Error Message:
java.util.concurrent.TimeoutException: OverseerTriggerThread never caught up to 
the latest znodeVersion

Stack Trace:
java.lang.AssertionError: java.util.concurrent.TimeoutException: 
OverseerTriggerThread never caught up to the latest znodeVersion
        at 
__randomizedtesting.SeedInfo.seed([B9EA7EA44AE8061D:62E0D3C8541D3AA2]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimScenario.testSplitShard(TestSimScenario.java:163)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:564)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.base/java.lang.Thread.run(Thread.java:832)




Build Log:
[...truncated 14465 lines...]
   [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
   [junit4]   2> 400194 INFO  
(SUITE-TestSimScenario-seed#[B9EA7EA44AE8061D]-worker) [     ] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/server/solr/configsets/_default/conf'
   [junit4]   2> 400194 INFO  
(SUITE-TestSimScenario-seed#[B9EA7EA44AE8061D]-worker) [     ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 400195 INFO  
(SUITE-TestSimScenario-seed#[B9EA7EA44AE8061D]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.sim.TestSimScenario_B9EA7EA44AE8061D-001/data-dir-20-001
   [junit4]   2> 400195 INFO  
(SUITE-TestSimScenario-seed#[B9EA7EA44AE8061D]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 400195 INFO  
(SUITE-TestSimScenario-seed#[B9EA7EA44AE8061D]-worker) [     ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0)
   [junit4]   2> 400196 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.SolrTestCaseJ4 ###Starting testSuggestions
   [junit4]   2> 400200 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 1. CreateCluster   numNodes=2
   [junit4]   2> 400201 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            CreateCluster   numNodes=2
   [junit4]   2> 400202 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.SolrPaths solr home defaulted to 'solr/' (could not find system 
property or JNDI)
   [junit4]   2> 400209 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10000_solr
   [junit4]   2> 400209 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 400209 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 400210 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 400210 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 400210 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 400210 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 400210 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 400210 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 2. LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 400210 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 400211 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr]
   [junit4]   2> 400211 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 400211 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 400211 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 400211 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 400211 DEBUG (ScheduledTrigger-6301-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400211 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 400211 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 400211 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 3. RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 400211 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 400212 DEBUG (simCloudManagerPool-6300-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection, 
currentVersion=1
   [junit4]   2> 400212 DEBUG (simCloudManagerPool-6300-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 400212 DEBUG (simCloudManagerPool-6300-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 400223 DEBUG (simCloudManagerPool-6300-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 400224 DEBUG (simCloudManagerPool-6300-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 400231 DEBUG (ScheduledTrigger-6301-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400238 DEBUG (simCloudManagerPool-6300-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 400238 DEBUG (simCloudManagerPool-6300-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 400238 DEBUG (simCloudManagerPool-6300-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 400239 DEBUG (simCloudManagerPool-6300-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=4): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 400249 DEBUG (simCloudManagerPool-6300-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 400250 DEBUG (simCloudManagerPool-6300-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 400251 DEBUG (ScheduledTrigger-6301-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400260 DEBUG (simCloudManagerPool-6300-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 400260 DEBUG (simCloudManagerPool-6300-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 400260 DEBUG (simCloudManagerPool-6300-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 400260 DEBUG (simCloudManagerPool-6300-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=6): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10001_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 400260 DEBUG (simCloudManagerPool-6300-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection 
testCollection, currentVersion=6
   [junit4]   2> 400260 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 4. WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 400260 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 400270 DEBUG (simCloudManagerPool-6300-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=6
   [junit4]   2> 400271 DEBUG (simCloudManagerPool-6300-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 400271 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=7
   [junit4]   2> 400271 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 400271 DEBUG (ScheduledTrigger-6301-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400271 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 5. CtxSet  key=myNode&value=${_random_node_}
   [junit4]   2> 400272 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            CtxSet  key=myNode&value=127.0.0.1:10000_solr
   [junit4]   2> 400272 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 6. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 400272 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10000_solr
   [junit4]   2> 400272 INFO  (simCloudManagerPool-6300-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10000_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400272 INFO  (simCloudManagerPool-6300-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400282 DEBUG (simCloudManagerPool-6300-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=8
   [junit4]   2> 400282 DEBUG (simCloudManagerPool-6300-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 400282 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 7. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 400283 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10000_solr
   [junit4]   2> 400283 DEBUG (simCloudManagerPool-6300-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=9
   [junit4]   2> 400283 DEBUG (simCloudManagerPool-6300-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 400283 INFO  (simCloudManagerPool-6300-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10000_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400283 INFO  (simCloudManagerPool-6300-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400291 DEBUG (ScheduledTrigger-6301-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400293 DEBUG (simCloudManagerPool-6300-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=10
   [junit4]   2> 400293 DEBUG (simCloudManagerPool-6300-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 400293 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 8. LoopOp  iterations=${iterative}
   [junit4]   2> 400293 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            LoopOp  iterations=0
   [junit4]   2> 400293 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 9. LoopOp  iterations=${justCalc}
   [junit4]   2> 400294 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            LoopOp  iterations=1
   [junit4]   2> 400294 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 1 :
   [junit4]   2> 400294 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 400294 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=11
   [junit4]   2> 400294 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 400299 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 400299 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - SaveSnapshot        
path=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.sim.TestSimScenario_B9EA7EA44AE8061D-001/tempDir-001/snapshot/0)
   [junit4]   2> 400301 WARN  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimUtils V2 action SET_CLUSTER_PROPERTY_OBJ has no equivalent V1 
action
   [junit4]   2> 400301 WARN  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimUtils V2 action GET_NODES has no equivalent V1 action
   [junit4]   2> 400303 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from 
SimDistribStateManager
   [junit4]   2> 400311 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 10.        Dump    redact=true
   [junit4]   2> 400311 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            Dump    redact=true
   [junit4]   2> 400311 DEBUG (ScheduledTrigger-6301-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400311 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 22 resources from 
SimDistribStateManager
   [junit4]   2> 400315 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 400315 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 400315 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 400315 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 400315 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 400315 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 400315 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 400315 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 1. CreateCluster   numNodes=2
   [junit4]   2> 400315 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            CreateCluster   numNodes=2
   [junit4]   2> 400317 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10002_solr
   [junit4]   2> 400317 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 400317 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 400317 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 400317 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 400317 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 400317 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 2. LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 400318 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            LoadAutoscaling json={'cluster-policy':[]}
   [junit4]   2> 400318 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 400318 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 400318 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 400320 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10002_solr, 127.0.0.1:10003_solr]
   [junit4]   2> 400321 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 400321 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 1
   [junit4]   2> 400321 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 400321 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400321 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread -- deactivating old nodeLost / nodeAdded 
markers
   [junit4]   2> 400322 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 400323 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 3. RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 400323 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=CREATE&autoAddReplicas=true&name=testCollection&numShards=2&replicationFactor=2&maxShardsPerNode=2
   [junit4]   2> 400324 DEBUG (simCloudManagerPool-6306-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testCollection, 
currentVersion=1
   [junit4]   2> 400324 DEBUG (simCloudManagerPool-6306-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 400324 DEBUG (simCloudManagerPool-6306-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 400334 DEBUG (simCloudManagerPool-6306-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 400334 DEBUG (simCloudManagerPool-6306-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 400342 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400345 DEBUG (simCloudManagerPool-6306-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 400345 DEBUG (simCloudManagerPool-6306-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 400345 DEBUG (simCloudManagerPool-6306-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard1)
   [junit4]   2> 400345 DEBUG (simCloudManagerPool-6306-thread-2) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard1 (currentVersion=4): {"core_node1":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 400356 DEBUG (simCloudManagerPool-6306-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 400356 DEBUG (simCloudManagerPool-6306-thread-3) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 400362 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400366 DEBUG (simCloudManagerPool-6306-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 400366 DEBUG (simCloudManagerPool-6306-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 400366 DEBUG (simCloudManagerPool-6306-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider Running leader election (testCollection / 
shard2)
   [junit4]   2> 400366 DEBUG (simCloudManagerPool-6306-thread-4) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testCollection / 
shard2 (currentVersion=6): {"core_node3":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n3",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10002_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 400367 DEBUG (simCloudManagerPool-6306-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection 
testCollection, currentVersion=6
   [junit4]   2> 400367 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 4. WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 400367 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 400377 DEBUG (simCloudManagerPool-6306-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=6
   [junit4]   2> 400377 DEBUG (simCloudManagerPool-6306-thread-5) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 400377 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=7
   [junit4]   2> 400377 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 400377 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 5. CtxSet  key=myNode&value=${_random_node_}
   [junit4]   2> 400377 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            CtxSet  key=myNode&value=127.0.0.1:10002_solr
   [junit4]   2> 400377 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 6. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 400377 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr
   [junit4]   2> 400378 INFO  (simCloudManagerPool-6306-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400378 INFO  (simCloudManagerPool-6306-thread-6) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400382 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400388 DEBUG (simCloudManagerPool-6306-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=8
   [junit4]   2> 400388 DEBUG (simCloudManagerPool-6306-thread-6) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 400389 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 7. RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=${myNode}
   [junit4]   2> 400389 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            RunSolrRequest  
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr
   [junit4]   2> 400389 DEBUG (simCloudManagerPool-6306-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=9
   [junit4]   2> 400389 DEBUG (simCloudManagerPool-6306-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 400389 INFO  (simCloudManagerPool-6306-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400389 INFO  (simCloudManagerPool-6306-thread-7) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400400 DEBUG (simCloudManagerPool-6306-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=10
   [junit4]   2> 400400 DEBUG (simCloudManagerPool-6306-thread-7) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 400400 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 8. LoopOp  iterations=${iterative}
   [junit4]   2> 400400 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario            LoopOp  iterations=10
   [junit4]   2> 400400 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 1 :
   [junit4]   2> 400400 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 400400 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=11
   [junit4]   2> 400400 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 400401 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 400401 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 400402 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400422 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400442 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400463 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400483 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400503 DEBUG (simCloudManagerPool-6306-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node10":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n9",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 400503 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400523 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400543 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400563 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400584 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400604 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400614 DEBUG (simCloudManagerPool-6306-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=12
   [junit4]   2> 400614 DEBUG (simCloudManagerPool-6306-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 400614 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 400614 DEBUG (simCloudManagerPool-6306-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=13
   [junit4]   2> 400614 DEBUG (simCloudManagerPool-6306-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 400615 INFO  (simCloudManagerPool-6306-thread-9) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400615 INFO  (simCloudManagerPool-6306-thread-9) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400624 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400625 DEBUG (simCloudManagerPool-6306-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=14
   [junit4]   2> 400625 DEBUG (simCloudManagerPool-6306-thread-9) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 400625 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 400625 DEBUG (simCloudManagerPool-6306-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=15
   [junit4]   2> 400626 DEBUG (simCloudManagerPool-6306-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 15
   [junit4]   2> 400626 INFO  (simCloudManagerPool-6306-thread-10) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400626 INFO  (simCloudManagerPool-6306-thread-10) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400636 DEBUG (simCloudManagerPool-6306-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=16
   [junit4]   2> 400636 DEBUG (simCloudManagerPool-6306-thread-10) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 16
   [junit4]   2> 400636 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 2 :
   [junit4]   2> 400636 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 400636 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=17
   [junit4]   2> 400637 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 17
   [junit4]   2> 400637 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 400637 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 400644 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400664 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400684 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400705 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400725 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400738 DEBUG (simCloudManagerPool-6306-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node16":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n15",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 400745 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400765 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400785 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400806 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400826 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400846 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400848 DEBUG (simCloudManagerPool-6306-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=18
   [junit4]   2> 400849 DEBUG (simCloudManagerPool-6306-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 18
   [junit4]   2> 400849 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 400849 DEBUG (simCloudManagerPool-6306-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=19
   [junit4]   2> 400849 DEBUG (simCloudManagerPool-6306-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 19
   [junit4]   2> 400850 INFO  (simCloudManagerPool-6306-thread-12) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400850 INFO  (simCloudManagerPool-6306-thread-12) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400860 DEBUG (simCloudManagerPool-6306-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=20
   [junit4]   2> 400860 DEBUG (simCloudManagerPool-6306-thread-12) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 20
   [junit4]   2> 400860 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 400861 DEBUG (simCloudManagerPool-6306-thread-13) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=21
   [junit4]   2> 400861 DEBUG (simCloudManagerPool-6306-thread-13) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 21
   [junit4]   2> 400861 INFO  (simCloudManagerPool-6306-thread-13) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 400861 INFO  (simCloudManagerPool-6306-thread-13) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 400866 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400872 DEBUG (simCloudManagerPool-6306-thread-13) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=22
   [junit4]   2> 400872 DEBUG (simCloudManagerPool-6306-thread-13) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 22
   [junit4]   2> 400872 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 3 :
   [junit4]   2> 400872 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 400872 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=23
   [junit4]   2> 400873 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 23
   [junit4]   2> 400873 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 400874 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 400886 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400906 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400927 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400947 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400967 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 400974 DEBUG (simCloudManagerPool-6306-thread-14) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node22":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n21",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10002_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10002_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 400987 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401007 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401027 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401048 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401068 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401085 DEBUG (simCloudManagerPool-6306-thread-14) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=24
   [junit4]   2> 401085 DEBUG (simCloudManagerPool-6306-thread-14) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 24
   [junit4]   2> 401085 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401086 DEBUG (simCloudManagerPool-6306-thread-15) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=25
   [junit4]   2> 401086 DEBUG (simCloudManagerPool-6306-thread-15) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 25
   [junit4]   2> 401086 INFO  (simCloudManagerPool-6306-thread-15) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401086 INFO  (simCloudManagerPool-6306-thread-15) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401088 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401097 DEBUG (simCloudManagerPool-6306-thread-15) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=26
   [junit4]   2> 401097 DEBUG (simCloudManagerPool-6306-thread-15) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 26
   [junit4]   2> 401097 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401097 DEBUG (simCloudManagerPool-6306-thread-16) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=27
   [junit4]   2> 401098 DEBUG (simCloudManagerPool-6306-thread-16) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 27
   [junit4]   2> 401098 INFO  (simCloudManagerPool-6306-thread-16) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401098 INFO  (simCloudManagerPool-6306-thread-16) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401108 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401109 DEBUG (simCloudManagerPool-6306-thread-16) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=28
   [junit4]   2> 401109 DEBUG (simCloudManagerPool-6306-thread-16) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 28
   [junit4]   2> 401109 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 4 :
   [junit4]   2> 401109 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 401109 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=29
   [junit4]   2> 401110 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 29
   [junit4]   2> 401110 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 401110 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 401128 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401149 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401169 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401189 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401209 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401211 DEBUG (simCloudManagerPool-6306-thread-17) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node28":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n27",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10002_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10002_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 401229 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401249 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401270 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401290 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401310 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401321 DEBUG (simCloudManagerPool-6306-thread-17) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=30
   [junit4]   2> 401322 DEBUG (simCloudManagerPool-6306-thread-17) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 30
   [junit4]   2> 401322 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401322 DEBUG (simCloudManagerPool-6306-thread-18) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=31
   [junit4]   2> 401324 DEBUG (simCloudManagerPool-6306-thread-18) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 31
   [junit4]   2> 401325 INFO  (simCloudManagerPool-6306-thread-18) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401325 INFO  (simCloudManagerPool-6306-thread-18) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401330 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401335 DEBUG (simCloudManagerPool-6306-thread-18) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=32
   [junit4]   2> 401336 DEBUG (simCloudManagerPool-6306-thread-18) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 32
   [junit4]   2> 401336 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401336 DEBUG (simCloudManagerPool-6306-thread-19) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=33
   [junit4]   2> 401336 DEBUG (simCloudManagerPool-6306-thread-19) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 33
   [junit4]   2> 401337 INFO  (simCloudManagerPool-6306-thread-19) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401337 INFO  (simCloudManagerPool-6306-thread-19) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401347 DEBUG (simCloudManagerPool-6306-thread-19) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=34
   [junit4]   2> 401347 DEBUG (simCloudManagerPool-6306-thread-19) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 34
   [junit4]   2> 401347 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 5 :
   [junit4]   2> 401348 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 401348 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=35
   [junit4]   2> 401348 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 35
   [junit4]   2> 401349 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 401349 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 401350 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401371 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401391 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401411 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401431 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401449 DEBUG (simCloudManagerPool-6306-thread-20) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node34":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n33",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10002_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10002_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 401451 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401471 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401492 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401512 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401532 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401552 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401560 DEBUG (simCloudManagerPool-6306-thread-20) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=36
   [junit4]   2> 401560 DEBUG (simCloudManagerPool-6306-thread-20) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 36
   [junit4]   2> 401560 DEBUG (MetricsHistoryHandler-6310-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=37
   [junit4]   2> 401560 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401560 DEBUG (MetricsHistoryHandler-6310-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 37
   [junit4]   2> 401561 INFO  (simCloudManagerPool-6306-thread-21) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401561 INFO  (simCloudManagerPool-6306-thread-21) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401571 DEBUG (simCloudManagerPool-6306-thread-21) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=38
   [junit4]   2> 401571 DEBUG (simCloudManagerPool-6306-thread-21) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 38
   [junit4]   2> 401571 DEBUG (MetricsHistoryHandler-6310-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=39
   [junit4]   2> 401571 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401572 DEBUG (MetricsHistoryHandler-6310-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 39
   [junit4]   2> 401572 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401573 INFO  (simCloudManagerPool-6306-thread-22) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401573 INFO  (simCloudManagerPool-6306-thread-22) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401583 DEBUG (simCloudManagerPool-6306-thread-22) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=40
   [junit4]   2> 401583 DEBUG (simCloudManagerPool-6306-thread-22) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 40
   [junit4]   2> 401584 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 6 :
   [junit4]   2> 401584 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 401584 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=41
   [junit4]   2> 401584 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 41
   [junit4]   2> 401584 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 401585 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 401593 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401613 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401633 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401653 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401673 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401689 DEBUG (simCloudManagerPool-6306-thread-23) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node40":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n39",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10002_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10002_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 401693 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401714 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401734 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401754 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401775 DEBUG (ScheduledTrigger-6307-thread-2) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401795 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401800 DEBUG (simCloudManagerPool-6306-thread-23) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=42
   [junit4]   2> 401800 DEBUG (simCloudManagerPool-6306-thread-23) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 42
   [junit4]   2> 401800 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401806 DEBUG (simCloudManagerPool-6306-thread-24) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=43
   [junit4]   2> 401806 DEBUG (simCloudManagerPool-6306-thread-24) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 43
   [junit4]   2> 401806 INFO  (simCloudManagerPool-6306-thread-24) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401806 INFO  (simCloudManagerPool-6306-thread-24) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401815 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401817 DEBUG (simCloudManagerPool-6306-thread-24) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=44
   [junit4]   2> 401817 DEBUG (simCloudManagerPool-6306-thread-24) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 44
   [junit4]   2> 401817 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 401821 DEBUG (simCloudManagerPool-6306-thread-25) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=45
   [junit4]   2> 401822 DEBUG (simCloudManagerPool-6306-thread-25) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 45
   [junit4]   2> 401822 INFO  (simCloudManagerPool-6306-thread-25) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 401822 INFO  (simCloudManagerPool-6306-thread-25) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 401832 DEBUG (simCloudManagerPool-6306-thread-25) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=46
   [junit4]   2> 401833 DEBUG (simCloudManagerPool-6306-thread-25) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 46
   [junit4]   2> 401835 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401841 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 7 :
   [junit4]   2> 401841 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 401841 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=47
   [junit4]   2> 401846 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 47
   [junit4]   2> 401846 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 401847 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 401855 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401876 DEBUG (ScheduledTrigger-6307-thread-1) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401896 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401916 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401936 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401947 DEBUG (simCloudManagerPool-6306-thread-26) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node46":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n45",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10002_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10002_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 401957 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401977 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 401997 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402017 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402037 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402057 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402058 DEBUG (simCloudManagerPool-6306-thread-26) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=48
   [junit4]   2> 402058 DEBUG (simCloudManagerPool-6306-thread-26) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 48
   [junit4]   2> 402058 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 402059 DEBUG (simCloudManagerPool-6306-thread-27) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=49
   [junit4]   2> 402059 DEBUG (simCloudManagerPool-6306-thread-27) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 49
   [junit4]   2> 402059 INFO  (simCloudManagerPool-6306-thread-27) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 402059 INFO  (simCloudManagerPool-6306-thread-27) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 402069 DEBUG (simCloudManagerPool-6306-thread-27) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=50
   [junit4]   2> 402070 DEBUG (simCloudManagerPool-6306-thread-27) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 50
   [junit4]   2> 402070 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 402070 DEBUG (simCloudManagerPool-6306-thread-28) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=51
   [junit4]   2> 402070 DEBUG (simCloudManagerPool-6306-thread-28) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 51
   [junit4]   2> 402070 INFO  (simCloudManagerPool-6306-thread-28) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 402070 INFO  (simCloudManagerPool-6306-thread-28) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 402078 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402081 DEBUG (simCloudManagerPool-6306-thread-28) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=52
   [junit4]   2> 402081 DEBUG (simCloudManagerPool-6306-thread-28) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 52
   [junit4]   2> 402081 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 8 :
   [junit4]   2> 402081 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 402081 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=53
   [junit4]   2> 402081 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 53
   [junit4]   2> 402082 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario         - 1 suggestions
   [junit4]   2> 402082 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - ApplySuggestions    )
   [junit4]   2> 402098 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402118 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402138 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402158 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402178 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402183 DEBUG (simCloudManagerPool-6306-thread-29) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node52":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n51",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10003_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "path":"/admin/collections",
   [junit4]   2>     "node":"127.0.0.1:10002_solr",
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "action":"ADDREPLICA",
   [junit4]   2>     "createNodeSet":"127.0.0.1:10002_solr",
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6}}
   [junit4]   2> 402199 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402219 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402239 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402259 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402279 DEBUG (ScheduledTrigger-6307-thread-3) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402293 DEBUG (simCloudManagerPool-6306-thread-29) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=54
   [junit4]   2> 402294 DEBUG (simCloudManagerPool-6306-thread-29) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 54
   [junit4]   2> 402294 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 402294 DEBUG (simCloudManagerPool-6306-thread-30) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=55
   [junit4]   2> 402295 DEBUG (simCloudManagerPool-6306-thread-30) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 55
   [junit4]   2> 402295 INFO  (simCloudManagerPool-6306-thread-30) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 402295 INFO  (simCloudManagerPool-6306-thread-30) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 402300 DEBUG (ScheduledTrigger-6307-thread-4) [     ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 2 and last live nodes: 2
   [junit4]   2> 402305 DEBUG (simCloudManagerPool-6306-thread-30) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=56
   [junit4]   2> 402306 DEBUG (simCloudManagerPool-6306-thread-30) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 56
   [junit4]   2> 402306 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - RunSolrRequest      
path=/admin/collections&action=ADDREPLICA&collection=testCollection&shard=shard1&node=127.0.0.1:10002_solr)
   [junit4]   2> 402306 DEBUG (simCloudManagerPool-6306-thread-31) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=57
   [junit4]   2> 402306 DEBUG (simCloudManagerPool-6306-thread-31) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 57
   [junit4]   2> 402306 INFO  (simCloudManagerPool-6306-thread-31) [     ] 
o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:10002_solr for creating new 
replica of shard shard1 for collection testCollection
   [junit4]   2> 402306 INFO  (simCloudManagerPool-6306-thread-31) [     ] 
o.a.s.c.a.c.AddReplicaCmd Returning CreateReplica command.
   [junit4]   2> 402317 DEBUG (simCloudManagerPool-6306-thread-31) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=58
   [junit4]   2> 402317 DEBUG (simCloudManagerPool-6306-thread-31) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 58
   [junit4]   2> 402317 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario    * iter 9 :
   [junit4]   2> 402317 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario      - CalculateSuggestions        )
   [junit4]   2> 402317 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=59
   [junit4]   2> 402317 DEBUG 
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 59
   [junit4]   2> 402318 INFO  
(TEST-TestSimScenario.testSuggestions-seed#[B9EA7EA44AE80

[...truncated too long message...]

[auto_add_replicas_plan], BEFORE_ACTION=[auto_add_replicas_plan, execute_plan]}
   [junit4]   2> 404989 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction Executing operation: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10107_solr&inPlaceMove=true&replica=core_node2
   [junit4]   2> 405090 DEBUG (simCloudManagerPool-6324-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node6":{
   [junit4]   2>     "core":"testCollection_shard1_replica_n5",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10107_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"down",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 405200 DEBUG (simCloudManagerPool-6324-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=11
   [junit4]   2> 405200 DEBUG (simCloudManagerPool-6324-thread-8) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 11
   [junit4]   2> 405201 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.ExecutePlanAction Executing operation: 
action=MOVEREPLICA&collection=testCollection&targetNode=127.0.0.1:10107_solr&inPlaceMove=true&replica=core_node3
   [junit4]   2> 405201 DEBUG (simCloudManagerPool-6324-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=12
   [junit4]   2> 405201 DEBUG (simCloudManagerPool-6324-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 12
   [junit4]   2> 405301 DEBUG (simCloudManagerPool-6324-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node8":{
   [junit4]   2>     "core":"testCollection_shard2_replica_n7",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testCollection",
   [junit4]   2>     "node_name":"127.0.0.1:10107_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"down",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 405412 DEBUG (simCloudManagerPool-6324-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=13
   [junit4]   2> 405412 DEBUG (simCloudManagerPool-6324-thread-11) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 13
   [junit4]   2> 405413 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=14
   [junit4]   2> 405413 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 14
   [junit4]   2> 405413 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"64358fc2ff525T12a94dvcxslefuw6cdvyklmvc",
   [junit4]   2>   "source":".auto_add_replicas",
   [junit4]   2>   "eventTime":1762899327448357,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[1762899327448357],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":1762909419028757,
   [junit4]   2>     "nodeNames":["127.0.0.1:10106_solr"]}}
   [junit4]   2> 405413 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
   [junit4]   2> 405413 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 405413 DEBUG (AutoscalingActionExecutor-6326-thread-1) [     ] 
o.a.s.c.a.ScheduledTriggers -- processing took 21256 ms for event 
id=64358fc2ff525T12a94dvcxslefuw6cdvyklmvc
   [junit4]   2> 405413 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 8.     WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 405413 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario                WaitCollection  
collection=testCollection&shards=2&replicas=2
   [junit4]   2> 405413 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario 9.     SaveSnapshot    path=${snapshotPath}
   [junit4]   2> 405413 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SimScenario                SaveSnapshot    
path=/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.sim.TestSimScenario_B9EA7EA44AE8061D-001/tempDir-002/snapshot
   [junit4]   2> 405413 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - copying 23 resources from 
SimDistribStateManager
   [junit4]   2> 405416 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 405416 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 405416 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 405416 WARN  (Simulated OverseerAutoScalingTriggerThread) [    
 ] o.a.s.c.a.OverseerTriggerThread Interrupted
   [junit4]   2>           => java.lang.InterruptedException
   [junit4]   2>        at 
java.base/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1627)
   [junit4]   2> java.lang.InterruptedException: null
   [junit4]   2>        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1627)
 ~[?:?]
   [junit4]   2>        at 
org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:209)
 [java/:?]
   [junit4]   2>        at java.lang.Thread.run(Thread.java:832) [?:?]
   [junit4]   2> 405416 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 405416 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 405416 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 405418 DEBUG 
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.c.a.s.SnapshotDistribStateManager - loaded snapshot of 23 resources
   [junit4]   2> 405419 INFO  
(TEST-TestSimScenario.testAutoAddReplicas-seed#[B9EA7EA44AE8061D]) [     ] 
o.a.s.SolrTestCaseJ4 ###Ending testAutoAddReplicas
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-8.x-Linux/solr/build/solr-core/test/J3/temp/solr.cloud.autoscaling.sim.TestSimScenario_B9EA7EA44AE8061D-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene86), 
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=fr-WF, 
timezone=Asia/Hovd
   [junit4]   2> NOTE: Linux 5.3.0-59-generic amd64/AdoptOpenJDK 14.0.1 
(64-bit)/cpus=16,threads=1,free=171727400,total=482344960
   [junit4]   2> NOTE: All tests run in this JVM: 
[DistributedDebugComponentTest, UUIDFieldTest, TestBulkSchemaConcurrent, 
TestSolrIndexConfig, TestStandardQParsers, ChaosMonkeySafeLeaderTest, 
RestartWhileUpdatingTest, TestSearchPerf, TestTrie, 
BigEndianAscendingWordSerializerTest, IgnoreLargeDocumentProcessorFactoryTest, 
VMParamsZkACLAndCredentialsProvidersTest, TestConfigReload, 
TestExactStatsCache, LeaderElectionTest, TestAddFieldRealTimeGet, 
ZkSolrClientTest, CursorPagingTest, HDFSCollectionsAPITest, TestPackages, 
FullSolrCloudDistribCmdsTest, BlobRepositoryCloudTest, TestStressLiveNodes, 
TestSimScenario]
   [junit4] Completed [316/914 (1!)] on J3 in 5.25s, 4 tests, 1 failure <<< 
FAILURES!

[...truncated 46938 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Linux/3594/consoleText

[repro] Revision: e927cb75f04a1ac1d182e6ea9a88bb122bb8d21a

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line:  ant test  -Dtestcase=TestSimScenario 
-Dtests.method=testSplitShard -Dtests.seed=B9EA7EA44AE8061D 
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr-WF 
-Dtests.timezone=Asia/Hovd -Dtests.asserts=true -Dtests.file.encoding=UTF-8

[repro] JUnit rest result XML files will be moved to: ./repro-reports
[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr/core
[repro]       TestSimScenario
[repro] ant compile-test

[...truncated 3450 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 
-Dtests.class="*.TestSimScenario" -Dtests.showOutput=onerror 
"-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC" 
-Dtests.seed=B9EA7EA44AE8061D -Dtests.multiplier=3 -Dtests.slow=true 
-Dtests.locale=fr-WF -Dtests.timezone=Asia/Hovd -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8

[...truncated 96 lines...]
[repro] Failures w/original seeds:
[repro]   0/5 failed: org.apache.solr.cloud.autoscaling.sim.TestSimScenario
[repro] Exiting with code 0

[...truncated 61 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to