Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/911/
Java: 32bit/jdk1.8.0_172 -server -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.cloud.ActionThrottleTest.testAZeroNanoTimeReturnInWait

Error Message:
994ms

Stack Trace:
java.lang.AssertionError: 994ms
        at 
__randomizedtesting.SeedInfo.seed([313FF45F4100D784:F2540F6DF5412A67]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.ActionThrottleTest.testAZeroNanoTimeReturnInWait(ActionThrottleTest.java:113)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction.testNodeWithMultipleReplicasLost

Error Message:
Timed out waiting for replicas of new collection to be active Live Nodes: 
[127.0.0.1:10001_solr, 127.0.0.1:10000_solr, 127.0.0.1:10002_solr, 
127.0.0.1:10003_solr] Last available state: 
DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/4)={   
"replicationFactor":"1",   "pullReplicas":"0",   
"router":{"name":"compositeId"},   "maxShardsPerNode":"2",   
"autoAddReplicas":"false",   "nrtReplicas":"3",   "tlogReplicas":"0",   
"autoCreated":"true",   "shards":{     "shard2":{       "replicas":{},       
"range":"0-7fffffff",       "state":"active"},     "shard1":{       
"replicas":{"core_node1":{           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",           
"SEARCHER.searcher.maxDoc":0,           "SEARCHER.searcher.deletedDocs":0,      
     "INDEX.sizeInBytes":10240,           "node_name":"127.0.0.1:10003_solr",   
        "state":"active",           "type":"NRT",           
"INDEX.sizeInGB":9.5367431640625E-6,           "SEARCHER.searcher.numDocs":0}}, 
      "range":"80000000-ffffffff",       "state":"active"}}}

Stack Trace:
java.lang.AssertionError: Timed out waiting for replicas of new collection to 
be active
Live Nodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr, 127.0.0.1:10002_solr, 
127.0.0.1:10003_solr]
Last available state: 
DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/4)={
  "replicationFactor":"1",
  "pullReplicas":"0",
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"3",
  "tlogReplicas":"0",
  "autoCreated":"true",
  "shards":{
    "shard2":{
      "replicas":{},
      "range":"0-7fffffff",
      "state":"active"},
    "shard1":{
      "replicas":{"core_node1":{
          "core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "node_name":"127.0.0.1:10003_solr",
          "state":"active",
          "type":"NRT",
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      "range":"80000000-ffffffff",
      "state":"active"}}}
        at 
__randomizedtesting.SeedInfo.seed([313FF45F4100D784:1FF15DDC97236D8]:0)
        at 
org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:70)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction.testNodeWithMultipleReplicasLost(TestSimComputePlanAction.java:209)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.TimeoutException: last ClusterState: 
znodeVersion: 5
live nodes:[127.0.0.1:10001_solr, 127.0.0.1:10000_solr, 127.0.0.1:10002_solr, 
127.0.0.1:10003_solr]
collections:{testNodeWithMultipleReplicasLost=DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/4)={
  "replicationFactor":"1",
  "pullReplicas":"0",
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"3",
  "tlogReplicas":"0",
  "autoCreated":"true",
  "shards":{
    "shard2":{
      "replicas":{},
      "range":"0-7fffffff",
      "state":"active"},
    "shard1":{
      "replicas":{"core_node1":{
          "core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "node_name":"127.0.0.1:10003_solr",
          "state":"active",
          "type":"NRT",
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      "range":"80000000-ffffffff",
      "state":"active"}}}}, last coll state: 
DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/4)={
  "replicationFactor":"1",
  "pullReplicas":"0",
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"2",
  "autoAddReplicas":"false",
  "nrtReplicas":"3",
  "tlogReplicas":"0",
  "autoCreated":"true",
  "shards":{
    "shard2":{
      "replicas":{},
      "range":"0-7fffffff",
      "state":"active"},
    "shard1":{
      "replicas":{"core_node1":{
          "core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
          "SEARCHER.searcher.maxDoc":0,
          "SEARCHER.searcher.deletedDocs":0,
          "INDEX.sizeInBytes":10240,
          "node_name":"127.0.0.1:10003_solr",
          "state":"active",
          "type":"NRT",
          "INDEX.sizeInGB":9.5367431640625E-6,
          "SEARCHER.searcher.numDocs":0}},
      "range":"80000000-ffffffff",
      "state":"active"}}}
        at 
org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:112)
        at 
org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:64)
        ... 40 more




Build Log:
[...truncated 12911 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction
   [junit4]   2> Creating dataDir: 
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.autoscaling.sim.TestSimComputePlanAction_313FF45F4100D784-001\init-core-data-001
   [junit4]   2> 562929 WARN  
(SUITE-TestSimComputePlanAction-seed#[313FF45F4100D784]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 562935 INFO  
(SUITE-TestSimComputePlanAction-seed#[313FF45F4100D784]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 562945 INFO  
(SUITE-TestSimComputePlanAction-seed#[313FF45F4100D784]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 562946 INFO  
(SUITE-TestSimComputePlanAction-seed#[313FF45F4100D784]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 562949 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeWithMultipleReplicasLost
   [junit4]   2> 562990 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10000_solr
   [junit4]   2> 562990 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 562991 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 562991 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics 
history in memory.
   [junit4]   2> 563183 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 563188 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 0
   [junit4]   2> 563189 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1
   [junit4]   2> 563189 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0
   [junit4]   2> 563411 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10000_solr]
   [junit4]   2> 563411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 563411 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0
   [junit4]   2> 563411 DEBUG (simCloudManagerPool-2864-thread-1) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 563411 DEBUG (simCloudManagerPool-2864-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
1
   [junit4]   2> 564026 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 564028 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 564028 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 564028 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 564203 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 564226 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 564249 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 565861 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 565931 DEBUG (simCloudManagerPool-2864-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 565931 DEBUG (simCloudManagerPool-2864-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 565933 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 565933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 565933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 565933 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 566083 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 566257 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 1
   [junit4]   2> 566356 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 566377 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 566538 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 566558 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 566720 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 566827 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567017 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567038 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567062 DEBUG (simCloudManagerPool-2864-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 567063 DEBUG (simCloudManagerPool-2864-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 567063 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 567064 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger - Initial 
livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr, 127.0.0.1:10002_solr, 
127.0.0.1:10003_solr]
   [junit4]   2> 567064 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
   [junit4]   2> 567064 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 567092 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567092 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567093 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection 
testNodeWithMultipleReplicasLost, currentVersion=1
   [junit4]   2> 567248 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567249 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 567249 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 567249 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: 
testNodeWithMultipleReplicasLost
   [junit4]   2> 567250 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567261 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 567262 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 567262 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 567263 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 567280 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 140435897 
sessionWrapper.createTime 140435022349550, this.sessionWrapper.createTime 
140435022349550 
   [junit4]   2> 567280 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 567281 DEBUG (simCloudManagerPool-2864-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection 
testNodeWithMultipleReplicasLost, currentVersion=3
   [junit4]   2> 567287 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 567287 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 567287 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567290 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567293 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567296 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567299 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567301 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567303 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567306 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567309 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567312 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567315 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567317 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567320 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567322 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567325 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567327 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567330 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567332 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567335 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567337 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567340 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567342 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567345 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567347 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567350 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567353 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567356 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567359 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567361 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567364 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567366 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567369 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567375 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567378 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567380 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567382 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567384 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567387 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567389 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567389 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567389 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567392 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567395 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567397 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567399 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567402 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567405 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567407 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567409 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567411 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567411 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567412 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567414 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567416 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567418 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567421 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567423 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567426 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567428 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567431 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567431 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567431 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567433 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567435 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567438 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567440 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567442 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567445 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567447 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567450 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567452 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567452 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567452 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567454 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567457 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567459 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567461 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567464 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567466 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567469 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567471 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567472 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567472 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567473 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567476 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567478 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567480 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567483 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567485 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567488 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567490 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567492 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567495 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567498 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567499 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567502 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567504 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567507 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567509 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567511 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567514 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567516 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567518 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567521 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567523 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567526 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567528 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567531 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567533 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567535 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567538 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567540 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567542 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567545 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567547 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567549 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567551 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567554 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567556 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567559 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567561 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567564 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567566 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567568 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567572 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567574 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567576 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567579 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567582 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567585 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567587 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567590 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567592 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567594 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567597 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567600 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567602 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567604 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567606 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567610 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567612 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567615 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567617 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567620 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567622 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567624 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567626 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567629 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567631 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567634 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567636 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567638 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567641 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567643 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567645 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567648 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567650 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567652 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567655 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567655 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567655 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567658 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567661 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567664 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567666 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567669 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567672 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567675 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567678 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567680 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567682 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567685 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567688 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567690 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567692 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567694 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567697 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567700 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567702 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567705 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567707 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567710 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567712 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567714 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567717 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567719 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567722 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567724 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567729 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567731 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567733 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567735 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567737 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567740 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567742 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567744 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567747 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567750 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567752 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567755 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567757 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567760 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567762 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567765 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567768 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567770 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567773 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567775 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567777 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567781 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567783 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567786 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567789 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567791 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567793 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567796 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567798 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567800 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567803 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567805 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567808 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567810 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567813 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567816 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567818 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567821 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567823 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567826 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567829 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567831 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567833 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567836 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567838 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567839 DEBUG (ScheduledTrigger-2865-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567839 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567841 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567843 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567843 DEBUG (simCloudManagerPool-2864-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 567843 DEBUG (simCloudManagerPool-2864-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 567846 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567849 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567851 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567855 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567857 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567860 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567860 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567860 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567863 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567865 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567867 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567871 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567873 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567875 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567878 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567880 DEBUG (ScheduledTrigger-2865-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567880 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567880 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 567883 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567885 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567888 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567890 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567892 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567894 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567897 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567899 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567902 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567904 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567906 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567911 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567914 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567916 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567919 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567922 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567924 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567927 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567929 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567931 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567933 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567936 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567938 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567941 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567943 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567945 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567947 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567950 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567952 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567955 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567957 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567960 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567962 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567965 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567967 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567969 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567971 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567974 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567976 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567979 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567981 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567984 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567986 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567988 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567990 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567993 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567995 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 567998 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568000 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568002 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568005 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568007 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568009 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568014 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568016 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568018 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568020 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568023 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568025 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568027 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568030 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568030 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 568030 DEBUG (ScheduledTrigger-2865-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 568033 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.CloudTestUtils -- shards without leaders: [shard2, shard1]
   [junit4]   2> 568033 DEBUG (simCloudManagerPool-2864-thread-6) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 569019 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 569019 DEBUG (simCloudManagerPool-2864-thread-6) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 569019 DEBUG (ScheduledTrigger-2865-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 569020 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction -------------_ FINAL STATE 
--------------
   [junit4]   2> 569020 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[313FF45F4100D784])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction * Node values: {
   [junit4]   2>   "127.0.0.1:10001_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":0,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1024,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10001_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10001,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0,
   [junit4]   2>     "totaldisk":10240},
   [junit4]   2>   "127.0.0.1:10000_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":0,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1024,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10000_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10000,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0,
   [junit4]   2>     "totaldisk":10240},
   [junit4]   2>   "127.0.0.1:10002_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":1,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1023,
   [junit4]   2>     "sysprop.java.version":"1.8.0_172",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":

[...truncated too long message...]

it4]    >   "autoAddReplicas":"false",
   [junit4]    >   "nrtReplicas":"3",
   [junit4]    >   "tlogReplicas":"0",
   [junit4]    >   "autoCreated":"true",
   [junit4]    >   "shards":{
   [junit4]    >     "shard2":{
   [junit4]    >       "replicas":{},
   [junit4]    >       "range":"0-7fffffff",
   [junit4]    >       "state":"active"},
   [junit4]    >     "shard1":{
   [junit4]    >       "replicas":{"core_node1":{
   [junit4]    >           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]    >           "SEARCHER.searcher.maxDoc":0,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":10240,
   [junit4]    >           "node_name":"127.0.0.1:10003_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]    >           "SEARCHER.searcher.numDocs":0}},
   [junit4]    >       "range":"80000000-ffffffff",
   [junit4]    >       "state":"active"}}}}, last coll state: 
DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/4)={
   [junit4]    >   "replicationFactor":"1",
   [junit4]    >   "pullReplicas":"0",
   [junit4]    >   "router":{"name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"2",
   [junit4]    >   "autoAddReplicas":"false",
   [junit4]    >   "nrtReplicas":"3",
   [junit4]    >   "tlogReplicas":"0",
   [junit4]    >   "autoCreated":"true",
   [junit4]    >   "shards":{
   [junit4]    >     "shard2":{
   [junit4]    >       "replicas":{},
   [junit4]    >       "range":"0-7fffffff",
   [junit4]    >       "state":"active"},
   [junit4]    >     "shard1":{
   [junit4]    >       "replicas":{"core_node1":{
   [junit4]    >           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]    >           "SEARCHER.searcher.maxDoc":0,
   [junit4]    >           "SEARCHER.searcher.deletedDocs":0,
   [junit4]    >           "INDEX.sizeInBytes":10240,
   [junit4]    >           "node_name":"127.0.0.1:10003_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]    >           "SEARCHER.searcher.numDocs":0}},
   [junit4]    >       "range":"80000000-ffffffff",
   [junit4]    >       "state":"active"}}}
   [junit4]    >        at 
org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:112)
   [junit4]    >        at 
org.apache.solr.cloud.CloudTestUtils.waitForState(CloudTestUtils.java:64)
   [junit4]    >        ... 40 more
   [junit4] IGNOR/A 0.00s J0 | TestSimComputePlanAction.testNodeAdded
   [junit4]    > Assumption #1: 'badapple' test group is disabled 
(@BadApple(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
   [junit4] IGNOR/A 0.00s J0 | TestSimComputePlanAction.testNodeLost
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled 
(@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
   [junit4]   2> NOTE: leaving temporary files on disk at: 
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.autoscaling.sim.TestSimComputePlanAction_313FF45F4100D784-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, 
sim=RandomSimilarity(queryNorm=false): {}, locale=es-NI, 
timezone=Europe/Mariehamn
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_172 
(32-bit)/cpus=3,threads=1,free=84096976,total=367788032
   [junit4]   2> NOTE: All tests run in this JVM: 
[HdfsChaosMonkeyNothingIsSafeTest, PingRequestHandlerTest, DocValuesTest, 
SolrGraphiteReporterTest, SpatialHeatmapFacetsTest, TestCloudSearcherWarming, 
TestFoldingMultitermQuery, CollectionTooManyReplicasTest, TestSolrCoreParser, 
ConnectionManagerTest, ShardRoutingTest, MigrateRouteKeyTest, 
DirectSolrSpellCheckerTest, UpdateParamsTest, TestWithCollection, 
CollectionsAPIDistributedZkTest, CdcrRequestHandlerTest, CreateRoutedAliasTest, 
TestDistributedMap, TestMultiValuedNumericRangeQuery, TestCollectionAPIs, 
ShowFileRequestHandlerTest, SolrJmxReporterTest, 
SignificantTermsQParserPluginTest, TestPivotHelperCode, 
DistributedFacetPivotWhiteBoxTest, TestJsonFacetsWithNestedObjects, 
TestSimComputePlanAction]
   [junit4] Completed [91/836 (1!)] on J0 in 7.86s, 3 tests, 1 failure, 2 
skipped <<< FAILURES!

[...truncated 442 lines...]
   [junit4] Suite: org.apache.solr.cloud.ActionThrottleTest
   [junit4]   2> Creating dataDir: 
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ActionThrottleTest_313FF45F4100D784-001\init-core-data-001
   [junit4]   2> 1049812 INFO  
(TEST-ActionThrottleTest.testAZeroNanoTimeReturnInWait-seed#[313FF45F4100D784]) 
[    ] o.a.s.c.ActionThrottle Throttling test attempts - waiting for 1000ms
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ActionThrottleTest 
-Dtests.method=testAZeroNanoTimeReturnInWait -Dtests.seed=313FF45F4100D784 
-Dtests.slow=true -Dtests.locale=es-AR 
-Dtests.timezone=America/Indiana/Vincennes -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.87s J0 | ActionThrottleTest.testAZeroNanoTimeReturnInWait 
<<<
   [junit4]    > Throwable #1: java.lang.AssertionError: 994ms
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([313FF45F4100D784:F2540F6DF5412A67]:0)
   [junit4]    >        at 
org.apache.solr.cloud.ActionThrottleTest.testAZeroNanoTimeReturnInWait(ActionThrottleTest.java:113)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1050680 INFO  
(TEST-ActionThrottleTest.testBasics-seed#[313FF45F4100D784]) [    ] 
o.a.s.c.ActionThrottle Throttling test attempts - waiting for 1000ms
   [junit4]   2> 1051686 INFO  
(TEST-ActionThrottleTest.testBasics-seed#[313FF45F4100D784]) [    ] 
o.a.s.c.ActionThrottle Throttling test attempts - waiting for 1000ms
   [junit4]   2> NOTE: leaving temporary files on disk at: 
C:\Users\jenkins\workspace\Lucene-Solr-7.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ActionThrottleTest_313FF45F4100D784-001
   [junit4]   2> NOTE: test params are: 
codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY,
 chunkSize=8, maxDocsPerChunk=294, blockSize=981), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, 
chunkSize=8, blockSize=981)), sim=RandomSimilarity(queryNorm=false): {}, 
locale=es-AR, timezone=America/Indiana/Vincennes
   [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_172 
(32-bit)/cpus=3,threads=1,free=264862440,total=434896896
   [junit4]   2> NOTE: All tests run in this JVM: 
[HdfsChaosMonkeyNothingIsSafeTest, PingRequestHandlerTest, DocValuesTest, 
SolrGraphiteReporterTest, SpatialHeatmapFacetsTest, TestCloudSearcherWarming, 
TestFoldingMultitermQuery, CollectionTooManyReplicasTest, TestSolrCoreParser, 
ConnectionManagerTest, ShardRoutingTest, MigrateRouteKeyTest, 
DirectSolrSpellCheckerTest, UpdateParamsTest, TestWithCollection, 
CollectionsAPIDistributedZkTest, CdcrRequestHandlerTest, CreateRoutedAliasTest, 
TestDistributedMap, TestMultiValuedNumericRangeQuery, TestCollectionAPIs, 
ShowFileRequestHandlerTest, SolrJmxReporterTest, 
SignificantTermsQParserPluginTest, TestPivotHelperCode, 
DistributedFacetPivotWhiteBoxTest, TestJsonFacetsWithNestedObjects, 
TestSimComputePlanAction, SolrIndexConfigTest, NoCacheHeaderTest, 
TestRTimerTree, PeerSyncReplicationTest, TestCloudManagedSchema, 
MoveReplicaHDFSFailoverTest, DistributedQueueTest, TermsComponentTest, 
TestCollapseQParserPlugin, JsonLoaderTest, TestFacetMethods, 
PeerSyncWithLeaderAndIndexFingerprintCachingTest, SolrMetricManagerTest, 
TestFastLRUCache, TestShardHandlerFactory, TestFieldCacheSort, 
MultiThreadedOCPTest, TestGeoJSONResponseWriter, EmbeddedSolrNoSerializeTest, 
AsyncCallRequestStatusResponseTest, ConcurrentCreateRoutedAliasTest, 
ReplicationFactorTest, TestDocBasedVersionConstraints, 
FastVectorHighlighterTest, TestUniqueKeyFieldResource, DebugComponentTest, 
LoggingHandlerTest, TestSolrCloudSnapshots, TestCustomStream, 
TestCrossCoreJoin, LegacyCloudClusterPropTest, 
DistributedQueryElevationComponentTest, ConvertedLegacyTest, 
ChaosMonkeyNothingIsSafeTest, TestFieldCache, TestReRankQParserPlugin, 
PrimUtilsTest, TestCopyFieldCollectionResource, SoftAutoCommitTest, 
TestHdfsUpdateLog, AdminHandlersProxyTest, TestLeaderElectionWithEmptyReplica, 
TestInPlaceUpdatesStandalone, TestMacros, MaxSizeAutoCommitTest, 
TransactionLogTest, ChaosMonkeySafeLeaderTest, TestSolr4Spatial, 
SpatialRPTFieldTypeTest, TestRestManager, LargeFieldTest, PreAnalyzedFieldTest, 
TestCustomSort, ProtectedTermFilterFactoryTest, TestCloudJSONFacetSKG, 
TestConfigSets, TestSchemaVersionResource, TestNestedUpdateProcessor, 
ActionThrottleTest]
   [junit4] Completed [203/836 (2!)] on J0 in 3.21s, 3 tests, 1 failure <<< 
FAILURES!

[...truncated 47466 lines...]
[repro] Jenkins log URL: 
https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Windows/911/consoleText

[repro] Revision: 5b7e6febe5b8f573c22377293aac25889f09781a

[repro] Ant options: "-Dargs=-server -XX:+UseParallelGC"

[repro] ant clean

[...truncated 6 lines...]
[repro] Test suites by module:
[repro]    solr\core
[repro]       TestSimComputePlanAction
[repro]       ActionThrottleTest
[repro] ant compile-test

[...truncated 3627 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=10 
-Dtests.class="*.TestSimComputePlanAction|*.ActionThrottleTest" 
-Dtests.showOutput=onerror "-Dargs=-server -XX:+UseParallelGC" 
-Dtests.seed=313FF45F4100D784 -Dtests.slow=true -Dtests.locale=es-NI 
-Dtests.timezone=Europe/Mariehamn -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII

[...truncated 113 lines...]
[repro] Failures:
[repro]   0/5 failed: org.apache.solr.cloud.ActionThrottleTest
[repro]   0/5 failed: 
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction
[repro] Exiting with code 0

[...truncated 75 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to