Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/23183/
Java: 32bit/jdk1.8.0_172 -server -XX:+UseParallelGC

10 tests failed.
FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:42871_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/22)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           
"core":"hdfsbackuprestore_restored_shard2_replica_n61",           
"base_url":"http://127.0.0.1:42871/solr";,           
"node_name":"127.0.0.1:42871_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"hdfsbackuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:42871/solr";,           
"node_name":"127.0.0.1:42871_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840592643793906"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_n63",           
"base_url":"http://127.0.0.1:42871/solr";,           
"node_name":"127.0.0.1:42871_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:40103/solr";,           
"node_name":"127.0.0.1:40103_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840592643822380"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_n65",           
"base_url":"http://127.0.0.1:40103/solr";,           
"node_name":"127.0.0.1:40103_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:42871/solr";,           
"node_name":"127.0.0.1:42871_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840592643845545"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:42871_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/22)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"hdfsbackuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:42871/solr";,
          "node_name":"127.0.0.1:42871_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"hdfsbackuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:42871/solr";,
          "node_name":"127.0.0.1:42871_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840592643793906"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:42871/solr";,
          "node_name":"127.0.0.1:42871_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:40103/solr";,
          "node_name":"127.0.0.1:40103_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840592643822380"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:40103/solr";,
          "node_name":"127.0.0.1:40103_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:42871/solr";,
          "node_name":"127.0.0.1:42871_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840592643845545"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:213)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:43705_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/22)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           
"core":"hdfsbackuprestore_restored_shard2_replica_n61",           
"base_url":"http://127.0.0.1:43705/solr";,           
"node_name":"127.0.0.1:43705_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"hdfsbackuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:43705/solr";,           
"node_name":"127.0.0.1:43705_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840607374139576"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_n63",           
"base_url":"http://127.0.0.1:43705/solr";,           
"node_name":"127.0.0.1:43705_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:44483/solr";,           
"node_name":"127.0.0.1:44483_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840607374178193"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_n65",           
"base_url":"http://127.0.0.1:44483/solr";,           
"node_name":"127.0.0.1:44483_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:43705/solr";,           
"node_name":"127.0.0.1:43705_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840607374213766"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:43705_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/22)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"hdfsbackuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:43705/solr";,
          "node_name":"127.0.0.1:43705_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"hdfsbackuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:43705/solr";,
          "node_name":"127.0.0.1:43705_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840607374139576"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:43705/solr";,
          "node_name":"127.0.0.1:43705_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:44483/solr";,
          "node_name":"127.0.0.1:44483_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840607374178193"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:44483/solr";,
          "node_name":"127.0.0.1:44483_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:43705/solr";,
          "node_name":"127.0.0.1:43705_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840607374213766"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:213)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:33221_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/21)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           
"core":"hdfsbackuprestore_restored_shard2_replica_n61",           
"base_url":"http://127.0.0.1:33221/solr";,           
"node_name":"127.0.0.1:33221_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"hdfsbackuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:33221/solr";,           
"node_name":"127.0.0.1:33221_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840621949686232"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_n63",           
"base_url":"http://127.0.0.1:33221/solr";,           
"node_name":"127.0.0.1:33221_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:35031/solr";,           
"node_name":"127.0.0.1:35031_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840621949716765"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_n65",           
"base_url":"http://127.0.0.1:35031/solr";,           
"node_name":"127.0.0.1:35031_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:33221/solr";,           
"node_name":"127.0.0.1:33221_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840621949741102"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:33221_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/21)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"hdfsbackuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:33221/solr";,
          "node_name":"127.0.0.1:33221_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"hdfsbackuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:33221/solr";,
          "node_name":"127.0.0.1:33221_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840621949686232"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:33221/solr";,
          "node_name":"127.0.0.1:33221_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:35031/solr";,
          "node_name":"127.0.0.1:35031_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840621949716765"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:35031/solr";,
          "node_name":"127.0.0.1:35031_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:33221/solr";,
          "node_name":"127.0.0.1:33221_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840621949741102"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:213)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:39777_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/20)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           
"core":"hdfsbackuprestore_restored_shard2_replica_n61",           
"base_url":"http://127.0.0.1:39777/solr";,           
"node_name":"127.0.0.1:39777_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"hdfsbackuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:39777/solr";,           
"node_name":"127.0.0.1:39777_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840624620339544"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_n63",           
"base_url":"http://127.0.0.1:39777/solr";,           
"node_name":"127.0.0.1:39777_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:40077/solr";,           
"node_name":"127.0.0.1:40077_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840624620360786"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_n65",           
"base_url":"http://127.0.0.1:40077/solr";,           
"node_name":"127.0.0.1:40077_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:39777/solr";,           
"node_name":"127.0.0.1:39777_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840624620379020"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:39777_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/20)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"hdfsbackuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:39777/solr";,
          "node_name":"127.0.0.1:39777_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"hdfsbackuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:39777/solr";,
          "node_name":"127.0.0.1:39777_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840624620339544"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:39777/solr";,
          "node_name":"127.0.0.1:39777_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:40077/solr";,
          "node_name":"127.0.0.1:40077_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840624620360786"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:40077/solr";,
          "node_name":"127.0.0.1:40077_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:39777/solr";,
          "node_name":"127.0.0.1:39777_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840624620379020"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:213)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:39785_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/20)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           
"core":"hdfsbackuprestore_restored_shard2_replica_n61",           
"base_url":"http://127.0.0.1:39785/solr";,           
"node_name":"127.0.0.1:39785_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"hdfsbackuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:39785/solr";,           
"node_name":"127.0.0.1:39785_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840588594115985"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_n63",           
"base_url":"http://127.0.0.1:39785/solr";,           
"node_name":"127.0.0.1:39785_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:34065/solr";,           
"node_name":"127.0.0.1:34065_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840588594151240"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_n65",           
"base_url":"http://127.0.0.1:34065/solr";,           
"node_name":"127.0.0.1:34065_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:39785/solr";,           
"node_name":"127.0.0.1:39785_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840588594175385"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:39785_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/20)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"hdfsbackuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:39785/solr";,
          "node_name":"127.0.0.1:39785_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"hdfsbackuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:39785/solr";,
          "node_name":"127.0.0.1:39785_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840588594115985"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:39785/solr";,
          "node_name":"127.0.0.1:39785_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:34065/solr";,
          "node_name":"127.0.0.1:34065_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840588594151240"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:34065/solr";,
          "node_name":"127.0.0.1:34065_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:39785/solr";,
          "node_name":"127.0.0.1:39785_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840588594175385"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:213)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:45859_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/18)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           
"core":"hdfsbackuprestore_restored_shard2_replica_n61",           
"base_url":"http://127.0.0.1:45859/solr";,           
"node_name":"127.0.0.1:45859_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"hdfsbackuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:45859/solr";,           
"node_name":"127.0.0.1:45859_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541837676789133251"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_n63",           
"base_url":"http://127.0.0.1:45859/solr";,           
"node_name":"127.0.0.1:45859_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"hdfsbackuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:34977/solr";,           
"node_name":"127.0.0.1:34977_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541837676789158482"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_n65",           
"base_url":"http://127.0.0.1:34977/solr";,           
"node_name":"127.0.0.1:34977_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"hdfsbackuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:45859/solr";,           
"node_name":"127.0.0.1:45859_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541837676789181502"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:45859_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_restored//collections/hdfsbackuprestore_restored/state.json/18)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"hdfsbackuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:45859/solr";,
          "node_name":"127.0.0.1:45859_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"hdfsbackuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:45859/solr";,
          "node_name":"127.0.0.1:45859_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541837676789133251"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:45859/solr";,
          "node_name":"127.0.0.1:45859_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"hdfsbackuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:34977/solr";,
          "node_name":"127.0.0.1:34977_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541837676789158482"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:34977/solr";,
          "node_name":"127.0.0.1:34977_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"hdfsbackuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:45859/solr";,
          "node_name":"127.0.0.1:45859_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541837676789181502"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:213)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:38949_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/18)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",   
        "base_url":"http://127.0.0.1:38949/solr";,           
"node_name":"127.0.0.1:38949_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"backuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:38949/solr";,           
"node_name":"127.0.0.1:38949_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840560224256019"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63", 
          "base_url":"http://127.0.0.1:38949/solr";,           
"node_name":"127.0.0.1:38949_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"backuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:44415/solr";,           
"node_name":"127.0.0.1:44415_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840560224291436"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           "core":"backuprestore_restored_shard1_0_replica_n65", 
          "base_url":"http://127.0.0.1:44415/solr";,           
"node_name":"127.0.0.1:44415_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"backuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:38949/solr";,           
"node_name":"127.0.0.1:38949_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840560224318560"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:38949_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/18)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"backuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:38949/solr";,
          "node_name":"127.0.0.1:38949_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"backuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:38949/solr";,
          "node_name":"127.0.0.1:38949_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840560224256019"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"backuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:38949/solr";,
          "node_name":"127.0.0.1:38949_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"backuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:44415/solr";,
          "node_name":"127.0.0.1:44415_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840560224291436"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"backuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:44415/solr";,
          "node_name":"127.0.0.1:44415_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"backuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:38949/solr";,
          "node_name":"127.0.0.1:38949_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840560224318560"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:41755_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/16)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",   
        "base_url":"http://127.0.0.1:41755/solr";,           
"node_name":"127.0.0.1:41755_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"backuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:41755/solr";,           
"node_name":"127.0.0.1:41755_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840579962441997"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63", 
          "base_url":"http://127.0.0.1:41755/solr";,           
"node_name":"127.0.0.1:41755_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"backuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:33341/solr";,           
"node_name":"127.0.0.1:33341_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840579962472726"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           "core":"backuprestore_restored_shard1_0_replica_n65", 
          "base_url":"http://127.0.0.1:33341/solr";,           
"node_name":"127.0.0.1:33341_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"backuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:41755/solr";,           
"node_name":"127.0.0.1:41755_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840579962507862"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:41755_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/16)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"backuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:41755/solr";,
          "node_name":"127.0.0.1:41755_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"backuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:41755/solr";,
          "node_name":"127.0.0.1:41755_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840579962441997"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"backuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:41755/solr";,
          "node_name":"127.0.0.1:41755_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"backuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:33341/solr";,
          "node_name":"127.0.0.1:33341_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840579962472726"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"backuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:33341/solr";,
          "node_name":"127.0.0.1:33341_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"backuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:41755/solr";,
          "node_name":"127.0.0.1:41755_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840579962507862"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:36381_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/15)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",   
        "base_url":"http://127.0.0.1:36381/solr";,           
"node_name":"127.0.0.1:36381_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"backuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:36381/solr";,           
"node_name":"127.0.0.1:36381_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840635741436876"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63", 
          "base_url":"http://127.0.0.1:36381/solr";,           
"node_name":"127.0.0.1:36381_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"backuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:44673/solr";,           
"node_name":"127.0.0.1:44673_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840635741468755"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{           "core":"backuprestore_restored_shard1_0_replica_n65", 
          "base_url":"http://127.0.0.1:44673/solr";,           
"node_name":"127.0.0.1:44673_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node72":{           
"core":"backuprestore_restored_shard1_0_replica_p71",           
"base_url":"http://127.0.0.1:36381/solr";,           
"node_name":"127.0.0.1:36381_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541840635741493044"}},   "router":{     
"name":"compositeId",     "field":"shard_s"},   "maxShardsPerNode":"-1",   
"autoAddReplicas":"true",   "nrtReplicas":1,   "tlogReplicas":0}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:36381_solr has 4 replicas. Expected 
num replicas : 3. state: 
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/15)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":"0-7fffffff",
      "state":"active",
      "replicas":{
        "core_node62":{
          "core":"backuprestore_restored_shard2_replica_n61",
          "base_url":"http://127.0.0.1:36381/solr";,
          "node_name":"127.0.0.1:36381_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node68":{
          "core":"backuprestore_restored_shard2_replica_p67",
          "base_url":"http://127.0.0.1:36381/solr";,
          "node_name":"127.0.0.1:36381_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840635741436876"},
    "shard1_1":{
      "range":"c0000000-ffffffff",
      "state":"active",
      "replicas":{
        "core_node64":{
          "core":"backuprestore_restored_shard1_1_replica_n63",
          "base_url":"http://127.0.0.1:36381/solr";,
          "node_name":"127.0.0.1:36381_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node70":{
          "core":"backuprestore_restored_shard1_1_replica_p69",
          "base_url":"http://127.0.0.1:44673/solr";,
          "node_name":"127.0.0.1:44673_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840635741468755"},
    "shard1_0":{
      "range":"80000000-bfffffff",
      "state":"active",
      "replicas":{
        "core_node66":{
          "core":"backuprestore_restored_shard1_0_replica_n65",
          "base_url":"http://127.0.0.1:44673/solr";,
          "node_name":"127.0.0.1:44673_solr",
          "state":"active",
          "type":"NRT",
          "force_set_state":"false",
          "leader":"true"},
        "core_node72":{
          "core":"backuprestore_restored_shard1_0_replica_p71",
          "base_url":"http://127.0.0.1:36381/solr";,
          "node_name":"127.0.0.1:36381_solr",
          "state":"active",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1541840635741493044"}},
  "router":{
    "name":"compositeId",
    "field":"shard_s"},
  "maxShardsPerNode":"-1",
  "autoAddReplicas":"true",
  "nrtReplicas":1,
  "tlogReplicas":0}
        at 
__randomizedtesting.SeedInfo.seed([FE030FB1038ED5AA:7657306BAD72B852]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:339)
        at java.util.HashMap.forEach(HashMap.java:1289)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:338)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:144)
        at 
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:64)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1742)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:935)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:971)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:985)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:944)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:830)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:891)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)


FAILED:  
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:39903_solr has 4 replicas. Expected num replicas : 3. state:  
DocCollection(backuprestore_restored//collections/backuprestore_restored/state.json/15)={
   "pullReplicas":1,   "replicationFactor":1,   "shards":{     "shard2":{       
"range":"0-7fffffff",       "state":"active",       "replicas":{         
"core_node62":{           "core":"backuprestore_restored_shard2_replica_n61",   
        "base_url":"http://127.0.0.1:39903/solr";,           
"node_name":"127.0.0.1:39903_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node68":{           
"core":"backuprestore_restored_shard2_replica_p67",           
"base_url":"http://127.0.0.1:39903/solr";,           
"node_name":"127.0.0.1:39903_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541837396691067938"},     "shard1_1":{       
"range":"c0000000-ffffffff",       "state":"active",       "replicas":{         
"core_node64":{           "core":"backuprestore_restored_shard1_1_replica_n63", 
          "base_url":"http://127.0.0.1:39903/solr";,           
"node_name":"127.0.0.1:39903_solr",           "state":"active",           
"type":"NRT",           "force_set_state":"false",           "leader":"true"},  
       "core_node70":{           
"core":"backuprestore_restored_shard1_1_replica_p69",           
"base_url":"http://127.0.0.1:45019/solr";,           
"node_name":"127.0.0.1:45019_solr",           "state":"active",           
"type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1541837396691094945"},     "shard1_0":{       
"range":"80000000-bfffffff",       "state":"active",       "replicas":{         
"core_node66":{    

[...truncated too long message...]

kuprestore.shard1_1.leader, tag=eca20f
   [junit4]   2> 103793 INFO  (coreCloseExecutor-357-thread-4) 
[n:127.0.0.1:44673_solr c:backuprestore_restored s:shard1_0 r:core_node66 
x:backuprestore_restored_shard1_0_replica_n65] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.core.backuprestore_restored.shard1_0.replica_n65, tag=81a4a5
   [junit4]   2> 103793 INFO  (coreCloseExecutor-357-thread-4) 
[n:127.0.0.1:44673_solr c:backuprestore_restored s:shard1_0 r:core_node66 
x:backuprestore_restored_shard1_0_replica_n65] o.a.s.m.r.SolrJmxReporter 
Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6873f1: 
rootName = solr_44673, domain = 
solr.core.backuprestore_restored.shard1_0.replica_n65, service url = null, 
agent id = null] for registry 
solr.core.backuprestore_restored.shard1_0.replica_n65 / 
com.codahale.metrics.MetricRegistry@d99120
   [junit4]   2> 103799 INFO  (coreCloseExecutor-356-thread-4) 
[n:127.0.0.1:36381_solr c:backuprestore_restored s:shard2 r:core_node68 
x:backuprestore_restored_shard2_replica_p67] o.a.s.m.SolrMetricManager Closing 
metric reporters for 
registry=solr.collection.backuprestore_restored.shard2.leader, tag=1873668
   [junit4]   2> 103799 INFO  (coreCloseExecutor-356-thread-5) 
[n:127.0.0.1:36381_solr c:backuprestore_restored s:shard1_0 r:core_node72 
x:backuprestore_restored_shard1_0_replica_p71] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.core.backuprestore_restored.shard1_0.replica_p71, tag=6ffd31
   [junit4]   2> 103799 INFO  (coreCloseExecutor-356-thread-5) 
[n:127.0.0.1:36381_solr c:backuprestore_restored s:shard1_0 r:core_node72 
x:backuprestore_restored_shard1_0_replica_p71] o.a.s.m.r.SolrJmxReporter 
Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@9ad347: 
rootName = solr_36381, domain = 
solr.core.backuprestore_restored.shard1_0.replica_p71, service url = null, 
agent id = null] for registry 
solr.core.backuprestore_restored.shard1_0.replica_p71 / 
com.codahale.metrics.MetricRegistry@1fc3575
   [junit4]   2> 103807 INFO  (coreCloseExecutor-357-thread-4) 
[n:127.0.0.1:44673_solr c:backuprestore_restored s:shard1_0 r:core_node66 
x:backuprestore_restored_shard1_0_replica_n65] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.collection.backuprestore_restored.shard1_0.leader, tag=81a4a5
   [junit4]   2> 103807 INFO  (coreCloseExecutor-357-thread-5) 
[n:127.0.0.1:44673_solr c:backuprestore_restored s:shard1_1 r:core_node70 
x:backuprestore_restored_shard1_1_replica_p69] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.core.backuprestore_restored.shard1_1.replica_p69, tag=b91eb5
   [junit4]   2> 103807 INFO  (coreCloseExecutor-357-thread-5) 
[n:127.0.0.1:44673_solr c:backuprestore_restored s:shard1_1 r:core_node70 
x:backuprestore_restored_shard1_1_replica_p69] o.a.s.m.r.SolrJmxReporter 
Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ba1e3c: 
rootName = solr_44673, domain = 
solr.core.backuprestore_restored.shard1_1.replica_p69, service url = null, 
agent id = null] for registry 
solr.core.backuprestore_restored.shard1_1.replica_p69 / 
com.codahale.metrics.MetricRegistry@6620c6
   [junit4]   2> 103813 INFO  (coreCloseExecutor-356-thread-5) 
[n:127.0.0.1:36381_solr c:backuprestore_restored s:shard1_0 r:core_node72 
x:backuprestore_restored_shard1_0_replica_p71] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.collection.backuprestore_restored.shard1_0.leader, tag=6ffd31
   [junit4]   2> 103822 INFO  (coreCloseExecutor-357-thread-5) 
[n:127.0.0.1:44673_solr c:backuprestore_restored s:shard1_1 r:core_node70 
x:backuprestore_restored_shard1_1_replica_p69] o.a.s.m.SolrMetricManager 
Closing metric reporters for 
registry=solr.collection.backuprestore_restored.shard1_1.leader, tag=b91eb5
   [junit4]   2> 103824 INFO  (jetty-closer-131-thread-2) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@8e390b{/solr,null,UNAVAILABLE}
   [junit4]   2> 103824 INFO  (jetty-closer-131-thread-2) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 103825 INFO  (jetty-closer-131-thread-1) [    ] 
o.a.s.c.Overseer Overseer 
(id=72137212089860100-127.0.0.1:44673_solr-n_0000000000) closing
   [junit4]   2> 103825 INFO  
(OverseerStateUpdate-72137212089860100-127.0.0.1:44673_solr-n_0000000000) 
[n:127.0.0.1:44673_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:44673_solr
   [junit4]   2> 103826 WARN  
(OverseerAutoScalingTriggerThread-72137212089860100-127.0.0.1:44673_solr-n_0000000000)
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we 
are closed, exiting.
   [junit4]   2> 103828 INFO  (jetty-closer-131-thread-1) [    ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@1ec85c3{/solr,null,UNAVAILABLE}
   [junit4]   2> 103828 INFO  (jetty-closer-131-thread-1) [    ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 103829 ERROR 
(SUITE-TestLocalFSCloudBackupRestore-seed#[FE030FB1038ED5AA]-worker) [    ] 
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper 
server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 103829 INFO  
(SUITE-TestLocalFSCloudBackupRestore-seed#[FE030FB1038ED5AA]-worker) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:37141 37141
   [junit4]   2> 103929 INFO  (Thread-331) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:37141 37141
   [junit4]   2> 103930 WARN  (Thread-331) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/clusterprops.json
   [junit4]   2>        5       /solr/aliases.json
   [junit4]   2>        4       
/solr/collections/backuprestore_restored/terms/shard1_0
   [junit4]   2>        4       
/solr/collections/backuprestore_restored/terms/shard1_1
   [junit4]   2>        3       /solr/collections/backuprestore/terms/shard1_0
   [junit4]   2>        3       /solr/collections/backuprestore/terms/shard1_1
   [junit4]   2>        3       /solr/collections/backuprestore/terms/shard2
   [junit4]   2>        3       
/solr/collections/backuprestore_restored/terms/shard2
   [junit4]   2>        2       /solr/security.json
   [junit4]   2>        2       /solr/configs/customConfigName
   [junit4]   2>        2       /solr/configs/conf1
   [junit4]   2>        2       /solr/collections/backuprestore/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/clusterstate.json
   [junit4]   2>        4       
/solr/collections/backuprestore_restored/state.json
   [junit4]   2>        2       /solr/collections/backuprestore/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        5       /solr/live_nodes
   [junit4]   2>        5       /solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.api.collections.TestLocalFSCloudBackupRestore_FE030FB1038ED5AA-003
   [junit4]   2> Nov 10, 2018 9:04:00 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): 
{shard_s=BlockTreeOrds(blocksize=128), id=PostingsFormat(name=Asserting)}, 
docValues:{}, maxPointsInLeafNode=1356, maxMBSortInHeap=7.682803782054153, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@eb274d),
 locale=ca-ES, timezone=SystemV/CST6CDT
   [junit4]   2> NOTE: Linux 4.15.0-38-generic i386/Oracle Corporation 
1.8.0_172 (32-bit)/cpus=8,threads=1,free=119034352,total=255852544
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestLocalFSCloudBackupRestore, TestLocalFSCloudBackupRestore, 
TestHdfsCloudBackupRestore, TestLocalFSCloudBackupRestore]
   [junit4] Completed [10/10 (10!)] on J2 in 18.18s, 1 test, 1 failure <<< 
FAILURES!

[...truncated 20 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1567: 
The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1092: 
There were test failures: 10 suites, 10 tests, 10 failures [seed: 
FE030FB1038ED5AA]

Total time: 1 minute 47 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   5/5 failed: 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore
[repro]   5/5 failed: 
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all 
warnings.
<Git Blamer> GIT_COMMIT=397b88aefa39d66d1310dfdea6b6d344ce1c9ce5, 
workspace=/var/lib/jenkins/workspace/Lucene-Solr-master-Linux
[WARNINGS] Computing warning deltas based on reference build #23182
Recording test results
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/var/lib/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to