Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/27710/
Java: 64bit/jdk-12.0.2 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

12 tests failed.
FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:34879_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_testok_restored/20)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:34879/solr";,           
"node_name":"127.0.0.1:34879_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node6":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:34879/solr";,           
"node_name":"127.0.0.1:34879_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node8":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:34879/solr";,           
"node_name":"127.0.0.1:34879_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792301293599832"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:34879/solr";,           
"node_name":"127.0.0.1:34879_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node10":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:34879/solr";,           
"node_name":"127.0.0.1:34879_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:34879/solr";,           
"node_name":"127.0.0.1:34879_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792301293638727"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:34879_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_testok_restored/20)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:34879/solr";,
          "node_name":"127.0.0.1:34879_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:34879/solr";,
          "node_name":"127.0.0.1:34879_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:34879/solr";,
          "node_name":"127.0.0.1:34879_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792301293599832"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:34879/solr";,
          "node_name":"127.0.0.1:34879_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:34879/solr";,
          "node_name":"127.0.0.1:34879_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:34879/solr";,
          "node_name":"127.0.0.1:34879_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792301293638727"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:225)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:34819_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_testok_restored/22)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:34819/solr";,           
"node_name":"127.0.0.1:34819_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node6":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:34819/solr";,           
"node_name":"127.0.0.1:34819_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node8":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:34819/solr";,           
"node_name":"127.0.0.1:34819_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792302596936740"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:34819/solr";,           
"node_name":"127.0.0.1:34819_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node10":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:34819/solr";,           
"node_name":"127.0.0.1:34819_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:34819/solr";,           
"node_name":"127.0.0.1:34819_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792302596970475"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:34819_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_testok_restored/22)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:34819/solr";,
          "node_name":"127.0.0.1:34819_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:34819/solr";,
          "node_name":"127.0.0.1:34819_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:34819/solr";,
          "node_name":"127.0.0.1:34819_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792302596936740"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:34819/solr";,
          "node_name":"127.0.0.1:34819_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:34819/solr";,
          "node_name":"127.0.0.1:34819_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:34819/solr";,
          "node_name":"127.0.0.1:34819_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792302596970475"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:225)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:36133_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_testok_restored/18)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:36133/solr";,           
"node_name":"127.0.0.1:36133_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node6":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:36133/solr";,           
"node_name":"127.0.0.1:36133_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node8":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:36133/solr";,           
"node_name":"127.0.0.1:36133_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792318105100677"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:36133/solr";,           
"node_name":"127.0.0.1:36133_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node10":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:36133/solr";,           
"node_name":"127.0.0.1:36133_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:36133/solr";,           
"node_name":"127.0.0.1:36133_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792318105142918"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:36133_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_testok_restored/18)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:36133/solr";,
          "node_name":"127.0.0.1:36133_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:36133/solr";,
          "node_name":"127.0.0.1:36133_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:36133/solr";,
          "node_name":"127.0.0.1:36133_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792318105100677"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:36133/solr";,
          "node_name":"127.0.0.1:36133_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:36133/solr";,
          "node_name":"127.0.0.1:36133_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:36133/solr";,
          "node_name":"127.0.0.1:36133_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792318105142918"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:225)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:33419_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_testok_restored/17)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:33419/solr";,           
"node_name":"127.0.0.1:33419_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node6":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:33419/solr";,           
"node_name":"127.0.0.1:33419_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node8":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:33419/solr";,           
"node_name":"127.0.0.1:33419_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792319226200247"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:33419/solr";,           
"node_name":"127.0.0.1:33419_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node10":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:33419/solr";,           
"node_name":"127.0.0.1:33419_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:33419/solr";,           
"node_name":"127.0.0.1:33419_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792319226221488"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:33419_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_testok_restored/17)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:33419/solr";,
          "node_name":"127.0.0.1:33419_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:33419/solr";,
          "node_name":"127.0.0.1:33419_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:33419/solr";,
          "node_name":"127.0.0.1:33419_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792319226200247"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:33419/solr";,
          "node_name":"127.0.0.1:33419_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:33419/solr";,
          "node_name":"127.0.0.1:33419_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:33419/solr";,
          "node_name":"127.0.0.1:33419_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792319226221488"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:225)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:39731_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_testok_restored/20)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:39731/solr";,           
"node_name":"127.0.0.1:39731_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node6":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:39731/solr";,           
"node_name":"127.0.0.1:39731_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node8":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:39731/solr";,           
"node_name":"127.0.0.1:39731_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792298415613909"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:39731/solr";,           
"node_name":"127.0.0.1:39731_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node10":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:39731/solr";,           
"node_name":"127.0.0.1:39731_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:39731/solr";,           
"node_name":"127.0.0.1:39731_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792298415651260"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:39731_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_testok_restored/20)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:39731/solr";,
          "node_name":"127.0.0.1:39731_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:39731/solr";,
          "node_name":"127.0.0.1:39731_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:39731/solr";,
          "node_name":"127.0.0.1:39731_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792298415613909"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:39731/solr";,
          "node_name":"127.0.0.1:39731_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:39731/solr";,
          "node_name":"127.0.0.1:39731_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:39731/solr";,
          "node_name":"127.0.0.1:39731_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792298415651260"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:225)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test

Error Message:
Node 127.0.0.1:33099_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(hdfsbackuprestore_testok_restored/16)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:33099/solr";,           
"node_name":"127.0.0.1:33099_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node6":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:33099/solr";,           
"node_name":"127.0.0.1:33099_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node8":{           
"core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:33099/solr";,           
"node_name":"127.0.0.1:33099_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard2",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597791245186791543"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:33099/solr";,           
"node_name":"127.0.0.1:33099_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"NRT",           "force_set_state":"false"},         
"core_node10":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:33099/solr";,           
"node_name":"127.0.0.1:33099_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:33099/solr";,           
"node_name":"127.0.0.1:33099_solr",           "state":"active",           
"collection":"hdfsbackuprestore_testok_restored",           "shard":"shard1",   
        "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597791245186813545"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:33099_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(hdfsbackuprestore_testok_restored/16)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:33099/solr";,
          "node_name":"127.0.0.1:33099_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:33099/solr";,
          "node_name":"127.0.0.1:33099_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"hdfsbackuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:33099/solr";,
          "node_name":"127.0.0.1:33099_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597791245186791543"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:33099/solr";,
          "node_name":"127.0.0.1:33099_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:33099/solr";,
          "node_name":"127.0.0.1:33099_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"hdfsbackuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:33099/solr";,
          "node_name":"127.0.0.1:33099_solr",
          "state":"active",
          "collection":"hdfsbackuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597791245186813545"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore.test(TestHdfsCloudBackupRestore.java:225)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:39535_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(backuprestore_testok_restored/19)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"backuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:39535/solr";,           
"node_name":"127.0.0.1:39535_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"NRT",           "force_set_state":"false"},         "core_node6":{  
         "core":"backuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:39535/solr";,           
"node_name":"127.0.0.1:39535_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"TLOG",           "force_set_state":"false"},         "core_node8":{ 
          "core":"backuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:39535/solr";,           
"node_name":"127.0.0.1:39535_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792288119907492"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"backuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:39535/solr";,           
"node_name":"127.0.0.1:39535_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"NRT",           "force_set_state":"false"},         "core_node10":{ 
          "core":"backuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:39535/solr";,           
"node_name":"127.0.0.1:39535_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"backuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:39535/solr";,           
"node_name":"127.0.0.1:39535_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792288119941517"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:39535_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(backuprestore_testok_restored/19)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"backuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:39535/solr";,
          "node_name":"127.0.0.1:39535_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"backuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:39535/solr";,
          "node_name":"127.0.0.1:39535_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"backuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:39535/solr";,
          "node_name":"127.0.0.1:39535_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792288119907492"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"backuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:39535/solr";,
          "node_name":"127.0.0.1:39535_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"backuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:39535/solr";,
          "node_name":"127.0.0.1:39535_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"backuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:39535/solr";,
          "node_name":"127.0.0.1:39535_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792288119941517"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:93)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:38709_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(backuprestore_testok_restored/22)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"backuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:38709/solr";,           
"node_name":"127.0.0.1:38709_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"NRT",           "force_set_state":"false"},         "core_node6":{  
         "core":"backuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:38709/solr";,           
"node_name":"127.0.0.1:38709_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"TLOG",           "force_set_state":"false"},         "core_node8":{ 
          "core":"backuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:38709/solr";,           
"node_name":"127.0.0.1:38709_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792287629837199"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"backuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:38709/solr";,           
"node_name":"127.0.0.1:38709_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"NRT",           "force_set_state":"false"},         "core_node10":{ 
          "core":"backuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:38709/solr";,           
"node_name":"127.0.0.1:38709_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"backuprestore_testok_restored_shard1_replica_p11",           
"core_node_name":"core_node12",           
"base_url":"https://127.0.0.1:38709/solr";,           
"node_name":"127.0.0.1:38709_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792287629887997"}},   "router":{     "name":"implicit",   
  "field":"shard_s"},   "nrtReplicas":1,   "tlogReplicas":1}

Stack Trace:
java.lang.AssertionError: Node 127.0.0.1:38709_solr has 6 replicas. Expected 
num replicas : 3. state: 
DocCollection(backuprestore_testok_restored/22)={
  "pullReplicas":1,
  "replicationFactor":1,
  "shards":{
    "shard2":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node2":{
          "core":"backuprestore_testok_restored_shard2_replica_n1",
          "leader":"true",
          "core_node_name":"core_node2",
          "base_url":"https://127.0.0.1:38709/solr";,
          "node_name":"127.0.0.1:38709_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard2",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node6":{
          "core":"backuprestore_testok_restored_shard2_replica_t5",
          "core_node_name":"core_node6",
          "base_url":"https://127.0.0.1:38709/solr";,
          "node_name":"127.0.0.1:38709_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard2",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node8":{
          "core":"backuprestore_testok_restored_shard2_replica_p7",
          "core_node_name":"core_node8",
          "base_url":"https://127.0.0.1:38709/solr";,
          "node_name":"127.0.0.1:38709_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard2",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792287629837199"},
    "shard1":{
      "range":null,
      "state":"active",
      "replicas":{
        "core_node4":{
          "core":"backuprestore_testok_restored_shard1_replica_n3",
          "leader":"true",
          "core_node_name":"core_node4",
          "base_url":"https://127.0.0.1:38709/solr";,
          "node_name":"127.0.0.1:38709_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard1",
          "type":"NRT",
          "force_set_state":"false"},
        "core_node10":{
          "core":"backuprestore_testok_restored_shard1_replica_t9",
          "core_node_name":"core_node10",
          "base_url":"https://127.0.0.1:38709/solr";,
          "node_name":"127.0.0.1:38709_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard1",
          "type":"TLOG",
          "force_set_state":"false"},
        "core_node12":{
          "core":"backuprestore_testok_restored_shard1_replica_p11",
          "core_node_name":"core_node12",
          "base_url":"https://127.0.0.1:38709/solr";,
          "node_name":"127.0.0.1:38709_solr",
          "state":"active",
          "collection":"backuprestore_testok_restored",
          "shard":"shard1",
          "type":"PULL",
          "force_set_state":"false"}},
      "stateTimestamp":"1597792287629887997"}},
  "router":{
    "name":"implicit",
    "field":"shard_s"},
  "nrtReplicas":1,
  "tlogReplicas":1}
        at 
__randomizedtesting.SeedInfo.seed([114E6C42C0E6B61D:991A53986E1ADBE5]:0)
        at org.junit.Assert.fail(Assert.java:88)
        at org.junit.Assert.assertTrue(Assert.java:41)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.lambda$testBackupAndRestore$1(AbstractCloudBackupRestoreTestCase.java:374)
        at java.base/java.util.HashMap.forEach(HashMap.java:1333)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:373)
        at 
org.apache.solr.cloud.api.collections.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:155)
        at 
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test(TestLocalFSCloudBackupRestore.java:93)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:567)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1754)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:942)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:978)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826)
        at java.base/java.lang.Thread.run(Thread.java:835)


FAILED:  
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore.test

Error Message:
Node 127.0.0.1:44051_solr has 6 replicas. Expected num replicas : 3. state:  
DocCollection(backuprestore_testok_restored/19)={   "pullReplicas":1,   
"replicationFactor":1,   "shards":{     "shard2":{       "range":null,       
"state":"active",       "replicas":{         "core_node2":{           
"core":"backuprestore_testok_restored_shard2_replica_n1",           
"leader":"true",           "core_node_name":"core_node2",           
"base_url":"https://127.0.0.1:44051/solr";,           
"node_name":"127.0.0.1:44051_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"NRT",           "force_set_state":"false"},         "core_node6":{  
         "core":"backuprestore_testok_restored_shard2_replica_t5",           
"core_node_name":"core_node6",           
"base_url":"https://127.0.0.1:44051/solr";,           
"node_name":"127.0.0.1:44051_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"TLOG",           "force_set_state":"false"},         "core_node8":{ 
          "core":"backuprestore_testok_restored_shard2_replica_p7",           
"core_node_name":"core_node8",           
"base_url":"https://127.0.0.1:44051/solr";,           
"node_name":"127.0.0.1:44051_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard2",       
    "type":"PULL",           "force_set_state":"false"}},       
"stateTimestamp":"1597792306800716572"},     "shard1":{       "range":null,     
  "state":"active",       "replicas":{         "core_node4":{           
"core":"backuprestore_testok_restored_shard1_replica_n3",           
"leader":"true",           "core_node_name":"core_node4",           
"base_url":"https://127.0.0.1:44051/solr";,           
"node_name":"127.0.0.1:44051_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"NRT",           "force_set_state":"false"},         "core_node10":{ 
          "core":"backuprestore_testok_restored_shard1_replica_t9",           
"core_node_name":"core_node10",           
"base_url":"https://127.0.0.1:44051/solr";,           
"node_name":"127.0.0.1:44051_solr",           "state":"active",           
"collection":"backuprestore_testok_restored",           "shard":"shard1",       
    "type":"TLOG",           "force_set_state":"false"},         
"core_node12":{           
"core":"backuprestore_testok_restored_shard1_replica_p11",           "cor

[...truncated too long message...]

xecutor-395-thread-12) [n:127.0.0.1:33419_solr     ] 
o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close()  ... SKIPPED 
(unnecessary).
   [junit4]   2> 69768 INFO  (coreCloseExecutor-395-thread-9) 
[n:127.0.0.1:33419_solr     ] o.a.s.u.DirectUpdateHandler2 Committing on 
IndexWriter.close()  ... SKIPPED (unnecessary).
   [junit4]   2> 69770 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node 
tag=null
   [junit4]   2> 69770 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@60cd7dc4: rootName = null, 
domain = solr.node, service url = null, agent id = null] for registry 
solr.node/com.codahale.metrics.MetricRegistry@71a9eb5c
   [junit4]   2> 69771 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm 
tag=null
   [junit4]   2> 69771 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@19aa8a6e: rootName = null, 
domain = solr.jvm, service url = null, agent id = null] for registry 
solr.jvm/com.codahale.metrics.MetricRegistry@78eeb2c6
   [junit4]   2> 69771 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty 
tag=null
   [junit4]   2> 69771 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.m.r.SolrJmxReporter Closing reporter 
[org.apache.solr.metrics.reporters.SolrJmxReporter@72e9dc1c: rootName = null, 
domain = solr.jetty, service url = null, agent id = null] for registry 
solr.jetty/com.codahale.metrics.MetricRegistry@37019d73
   [junit4]   2> 69771 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster 
tag=null
   [junit4]   2> 69774 INFO  (closeThreadPool-399-thread-2) [     ] 
o.a.s.c.Overseer Overseer 
(id=72223363857514502-127.0.0.1:33419_solr-n_0000000000) closing
   [junit4]   2> 69775 INFO  
(OverseerStateUpdate-72223363857514502-127.0.0.1:33419_solr-n_0000000000) 
[n:127.0.0.1:33419_solr     ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:33419_solr
   [junit4]   2> 69775 INFO  (closeThreadPool-399-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72223363857514502-127.0.0.1:33419_solr-n_0000000000) closing
   [junit4]   2> 69822 INFO  (jetty-closer-387-thread-2) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@6dba260c{ssl, (ssl, alpn, 
http/1.1, h2)}{127.0.0.1:0}
   [junit4]   2> 69823 INFO  (jetty-closer-387-thread-2) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@2cb61566{/solr,null,UNAVAILABLE}
   [junit4]   2> 69823 INFO  (jetty-closer-387-thread-2) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 69922 INFO  (jetty-closer-387-thread-1) [     ] 
o.a.s.c.Overseer Overseer 
(id=72223363857514502-127.0.0.1:33419_solr-n_0000000000) closing
   [junit4]   2> 69923 INFO  (jetty-closer-387-thread-1) [     ] 
o.e.j.s.AbstractConnector Stopped ServerConnector@4aa211da{ssl, (ssl, alpn, 
http/1.1, h2)}{127.0.0.1:0}
   [junit4]   2> 69923 INFO  (jetty-closer-387-thread-1) [     ] 
o.e.j.s.h.ContextHandler Stopped 
o.e.j.s.ServletContextHandler@551da8d1{/solr,null,UNAVAILABLE}
   [junit4]   2> 69923 INFO  (jetty-closer-387-thread-1) [     ] 
o.e.j.s.session node0 Stopped scavenging
   [junit4]   2> 69923 INFO  
(SUITE-TestHdfsCloudBackupRestore-seed#[114E6C42C0E6B61D]-worker) [     ] 
o.a.s.c.ZkTestServer Shutting down ZkTestServer.
   [junit4]   2> 70125 WARN  (ZkTestServer Run Thread) [     ] 
o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        8       
/solr/collections/hdfsbackuprestore_testfailure/terms/shard1
   [junit4]   2>        8       
/solr/collections/hdfsbackuprestore_testfailure/terms/shard2
   [junit4]   2>        7       
/solr/collections/hdfsbackuprestore_testok/terms/shard2
   [junit4]   2>        7       
/solr/collections/hdfsbackuprestore_testok/terms/shard1
   [junit4]   2>        6       
/solr/collections/hdfsbackuprestore_testok_restored/terms/shard2
   [junit4]   2>        6       
/solr/collections/hdfsbackuprestore_testok_restored/terms/shard1
   [junit4]   2>        3       /solr/aliases.json
   [junit4]   2>        2       
/solr/collections/hdfsbackuprestore_testok/collectionprops.json
   [junit4]   2>        2       /solr/packages.json
   [junit4]   2>        2       /solr/security.json
   [junit4]   2>        2       /solr/configs/conf1
   [junit4]   2>        2       
/solr/collections/hdfsbackuprestore_testfailure/collectionprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        72      
/solr/collections/hdfsbackuprestore_testok_restored/state.json
   [junit4]   2>        43      
/solr/collections/hdfsbackuprestore_testok/state.json
   [junit4]   2>        41      
/solr/collections/hdfsbackuprestore_testfailure/state.json
   [junit4]   2>        3       /solr/clusterprops.json
   [junit4]   2>        3       
/solr/collections/hdfsbackuprestore_testfailure_restored/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        117     /solr/overseer/queue
   [junit4]   2>        18      /solr/collections
   [junit4]   2>        17      /solr/overseer/collection-queue-work
   [junit4]   2>        10      /solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 70128 INFO  
(SUITE-TestHdfsCloudBackupRestore-seed#[114E6C42C0E6B61D]-worker) [     ] 
o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:38039
   [junit4]   2> 70129 INFO  
(SUITE-TestHdfsCloudBackupRestore-seed#[114E6C42C0E6B61D]-worker) [     ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:38039
   [junit4]   2> 70129 INFO  
(SUITE-TestHdfsCloudBackupRestore-seed#[114E6C42C0E6B61D]-worker) [     ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 38039
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.api.collections.TestHdfsCloudBackupRestore_114E6C42C0E6B61D-001
   [junit4]   2> Aug 18, 2020 11:12:19 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 65 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: 
codec=FastDecompressionCompressingStoredFieldsData(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=32651, maxDocsPerChunk=741, blockShift=15), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION,
 chunkSize=32651, blockSize=15)), 
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=en-BE, 
timezone=Asia/Calcutta
   [junit4]   2> NOTE: Linux 5.4.0-40-generic amd64/AdoptOpenJDK 12.0.2 
(64-bit)/cpus=16,threads=13,free=177948624,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: 
[TestLocalFSCloudBackupRestore, TestHdfsCloudBackupRestore]
   [junit4] Completed [10/10 (10!)] on J0 in 39.78s, 2 tests, 1 failure <<< 
FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J0: stderr was not empty, see: 
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20200818_231108_66518446172056506889919.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was 
deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 22 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1521: 
The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1048: 
There were test failures: 10 suites, 20 tests, 10 failures [seed: 
114E6C42C0E6B61D]

Total time: 1 minute 13 seconds

[repro] Setting last failure code to 256

[repro] Failures w/original seeds:
[repro]   5/5 failed: 
org.apache.solr.cloud.api.collections.TestHdfsCloudBackupRestore
[repro]   5/5 failed: 
org.apache.solr.cloud.api.collections.TestLocalFSCloudBackupRestore
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Archiving artifacts
[Java] Sleeping for 5 seconds due to JENKINS-32191...
[Java] Parsing console log (workspace: 
'/home/jenkins/workspace/Lucene-Solr-master-Linux')
[Java] Successfully parsed console log
[Java] -> found 0 issues (skipped 0 duplicates)
[Java] Skipping post processing
[Java] No filter has been set, publishing all 0 issues
[Java] Using reference build 'Lucene-Solr-master-Linux #27709' to compute new, 
fixed, and outstanding issues
[Java] Issues delta (vs. reference build): outstanding: 0, new: 0, fixed: 0
[Java] No quality gates have been set - skipping
[Java] Health report is disabled - skipping
[Java] Created analysis result for 0 issues (found 0 new issues, fixed 0 issues)
[Java] Attaching ResultAction with ID 'java' to run 'Lucene-Solr-master-Linux 
#27710'.
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Recording test results
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to