Build: https://jenkins.thetaphi.de/job/Lucene-Solr-8.x-Solaris/62/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Could not load collection from ZK: multiunload2

Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: 
multiunload2
        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1366)
        at 
org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:748)
        at 
org.apache.solr.common.cloud.ClusterState$CollectionRef.get(ClusterState.java:386)
        at 
org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:400)
        at 
org.apache.solr.cloud.BasicDistributedZkTest.testStopAndStartCoresInOneInstance(BasicDistributedZkTest.java:625)
        at 
org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:428)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1082)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1054)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /collections/multiunload2/state.json
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:130)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
        at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1221)
        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:358)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:358)
        at 
org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1378)
        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1364)
        ... 46 more


FAILED:  
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction.testNodeAdded

Error Message:
OverseerTriggerThread never caught up to the latest znodeVersion

Stack Trace:
java.util.concurrent.TimeoutException: OverseerTriggerThread never caught up to 
the latest znodeVersion
        at 
__randomizedtesting.SeedInfo.seed([9DEAD04B921F287:6C1DFB731B825A84]:0)
        at org.apache.solr.util.TimeOut.waitFor(TimeOut.java:66)
        at 
org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.assertAutoscalingUpdateComplete(SimSolrCloudTestCase.java:71)
        at 
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction.testNodeAdded(TestSimComputePlanAction.java:314)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
        at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 13210 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction
   [junit4]   2> Creating dataDir: 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimComputePlanAction_9DEAD04B921F287-001/init-core-data-001
   [junit4]   2> 839649 INFO  
(SUITE-TestSimComputePlanAction-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 839650 INFO  
(SUITE-TestSimComputePlanAction-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 839650 INFO  
(SUITE-TestSimComputePlanAction-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 839653 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testNodeWithMultipleReplicasLost
   [junit4]   2> 839657 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10024_solr
   [junit4]   2> 839658 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 839658 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 839658 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 839658 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 839658 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics 
history in memory.
   [junit4]   2> 839658 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 839659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 839659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10024_solr]
   [junit4]   2> 839659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 839659 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 839660 DEBUG (ScheduledTrigger-5679-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839675 DEBUG (simCloudManagerPool-5678-thread-1) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 839678 DEBUG (simCloudManagerPool-5678-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 839679 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 839680 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 839680 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 839680 DEBUG (ScheduledTrigger-5679-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839681 DEBUG (simCloudManagerPool-5678-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 839682 DEBUG (simCloudManagerPool-5678-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 839682 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 839682 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 839682 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 839701 DEBUG (ScheduledTrigger-5679-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839721 DEBUG (ScheduledTrigger-5679-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839741 DEBUG (ScheduledTrigger-5679-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839761 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839782 DEBUG (ScheduledTrigger-5679-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839788 DEBUG (simCloudManagerPool-5678-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 839788 DEBUG (simCloudManagerPool-5678-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
4
   [junit4]   2> 839788 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 839789 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger node_lost_trigger - Initial 
livenodes: [127.0.0.1:10025_solr, 127.0.0.1:10026_solr, 127.0.0.1:10024_solr, 
127.0.0.1:10027_solr]
   [junit4]   2> 839789 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 839789 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 839789 DEBUG (ScheduledTrigger-5679-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839795 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection 
testNodeWithMultipleReplicasLost, currentVersion=1
   [junit4]   2> 839796 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 839796 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 839796 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: 
testNodeWithMultipleReplicasLost
   [junit4]   2> 839803 DEBUG (ScheduledTrigger-5679-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 1
   [junit4]   2> 839808 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 839810 DEBUG (ScheduledTrigger-5679-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839812 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 839812 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 839812 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 839823 DEBUG (ScheduledTrigger-5679-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839824 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2299399784 
sessionWrapper.createTime 2299399182223003, this.sessionWrapper.createTime 
2299399182223003 
   [junit4]   2> 839825 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 839830 DEBUG (ScheduledTrigger-5679-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839843 DEBUG (ScheduledTrigger-5679-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839844 DEBUG (simCloudManagerPool-5678-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 839845 DEBUG (simCloudManagerPool-5678-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 839850 DEBUG (ScheduledTrigger-5679-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839858 DEBUG (simCloudManagerPool-5678-thread-6) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=4
   [junit4]   2> 839859 DEBUG (simCloudManagerPool-5678-thread-6) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 4
   [junit4]   2> 839860 DEBUG (simCloudManagerPool-5678-thread-4) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection 
testNodeWithMultipleReplicasLost, currentVersion=5
   [junit4]   2> 839863 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839873 DEBUG (ScheduledTrigger-5679-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839873 DEBUG (simCloudManagerPool-5678-thread-8) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=5
   [junit4]   2> 839873 DEBUG (simCloudManagerPool-5678-thread-8) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 5
   [junit4]   2> 839883 DEBUG (ScheduledTrigger-5679-thread-3) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839884 DEBUG (simCloudManagerPool-5678-thread-7) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=6
   [junit4]   2> 839885 DEBUG (simCloudManagerPool-5678-thread-7) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 6
   [junit4]   2> 839887 DEBUG (simCloudManagerPool-5678-thread-15) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for 
testNodeWithMultipleReplicasLost / shard2 (currentVersion=7): {"core_node4":{
   [junit4]   2>     
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
   [junit4]   2>     "shard":"shard2",
   [junit4]   2>     "collection":"testNodeWithMultipleReplicasLost",
   [junit4]   2>     "node_name":"127.0.0.1:10025_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 839890 DEBUG (simCloudManagerPool-5678-thread-16) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for 
testNodeWithMultipleReplicasLost / shard1 (currentVersion=7): {"core_node1":{
   [junit4]   2>     
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]   2>     "shard":"shard1",
   [junit4]   2>     "collection":"testNodeWithMultipleReplicasLost",
   [junit4]   2>     "node_name":"127.0.0.1:10027_solr",
   [junit4]   2>     "type":"NRT",
   [junit4]   2>     "leader":"true",
   [junit4]   2>     "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>     "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>     "INDEX.sizeInBytes":10240,
   [junit4]   2>     "state":"active",
   [junit4]   2>     "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>     "SEARCHER.searcher.numDocs":0}}
   [junit4]   2> 839893 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839900 DEBUG (simCloudManagerPool-5678-thread-10) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=7
   [junit4]   2> 839900 DEBUG (simCloudManagerPool-5678-thread-10) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 7
   [junit4]   2> 839905 DEBUG (ScheduledTrigger-5679-thread-1) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 4 and last live nodes: 4
   [junit4]   2> 839912 DEBUG (simCloudManagerPool-5678-thread-9) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=8
   [junit4]   2> 839912 DEBUG (simCloudManagerPool-5678-thread-9) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 8
   [junit4]   2> 839913 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=9
   [junit4]   2> 839913 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 9
   [junit4]   2> 839913 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction -- cluster state: znodeVersion: 10
   [junit4]   2> live nodes:[127.0.0.1:10026_solr, 127.0.0.1:10024_solr, 
127.0.0.1:10025_solr, 127.0.0.1:10027_solr]
   [junit4]   2> 
collections:{testNodeWithMultipleReplicasLost=DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/9)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"2",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node6":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n6",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10024_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10025_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n5",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10026_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10027_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10024_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node3":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n3",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10026_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active"}}}}
   [junit4]   2> 839914 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider  -- created marker: 
/autoscaling/nodeLost/127.0.0.1:10026_solr
   [junit4]   2> 839914 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=10
   [junit4]   2> 839914 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 10
   [junit4]   2> 839914 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 3 and last live nodes: 4
   [junit4]   2> 839914 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10026_solr
   [junit4]   2> 839925 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 3 and last live nodes: 4
   [junit4]   2> 839925 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:10026_solr
   [junit4]   2> 839935 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with 
currently live nodes: 3 and last live nodes: 3
   [junit4]   2> 839935 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost 
nodes: [127.0.0.1:10026_solr]
   [junit4]   2> 839935 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
   [junit4]   2>   "id":"82b4bc75b0a43T9do0n67b2298jo009pmyl79n5",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":2299404280859203,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2299404280859203],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "nodeNames":["127.0.0.1:10026_solr"]}}
   [junit4]   2> 839936 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.ScheduledTriggers Pausing all triggers: [.auto_add_replicas, 
.scheduled_maintenance, node_lost_trigger]
   [junit4]   2> 839936 DEBUG (ScheduledTrigger-5679-thread-4) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"82b4bc75b0a43T9do0n67b2298jo009pmyl79n5",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":2299404280859203,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2299404280859203],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":2299405354875303,
   [junit4]   2>     "nodeNames":["127.0.0.1:10026_solr"]}}
   [junit4]   2> 839937 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing actions for {
   [junit4]   2>   "id":"82b4bc75b0a43T9do0n67b2298jo009pmyl79n5",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":2299404280859203,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2299404280859203],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":2299405354875303,
   [junit4]   2>     "nodeNames":["127.0.0.1:10026_solr"]}}
   [junit4]   2> 839937 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction -- processing event: {
   [junit4]   2>   "id":"82b4bc75b0a43T9do0n67b2298jo009pmyl79n5",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":2299404280859203,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2299404280859203],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":2299405354875303,
   [junit4]   2>     "nodeNames":["127.0.0.1:10026_solr"]}} with context 
properties: {BEFORE_ACTION=[compute_plan]}
   [junit4]   2> 839937 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 839938 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 839941 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10027_solr&inPlaceMove=true&replica=core_node5
   [junit4]   2> 839941 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ComputePlanAction Computed Plan: 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10025_solr&inPlaceMove=true&replica=core_node3
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2299405641 
sessionWrapper.createTime 2299405475188853, this.sessionWrapper.createTime 
2299405475188853 
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"82b4bc75b0a43T9do0n67b2298jo009pmyl79n5",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":2299404280859203,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2299404280859203],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":2299405354875303,
   [junit4]   2>     "nodeNames":["127.0.0.1:10026_solr"]}}
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"82b4bc75b0a43T9do0n67b2298jo009pmyl79n5",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":2299404280859203,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2299404280859203],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":2299405354875303,
   [junit4]   2>     "nodeNames":["127.0.0.1:10026_solr"]}}
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.SystemLogListener Collection .system missing, skip sending event {
   [junit4]   2>   "id":"82b4bc75b0a43T9do0n67b2298jo009pmyl79n5",
   [junit4]   2>   "source":"node_lost_trigger",
   [junit4]   2>   "eventTime":2299404280859203,
   [junit4]   2>   "eventType":"NODELOST",
   [junit4]   2>   "properties":{
   [junit4]   2>     "eventTimes":[2299404280859203],
   [junit4]   2>     "preferredOperation":"movereplica",
   [junit4]   2>     "_enqueue_time_":2299405354875303,
   [junit4]   2>     "nodeNames":["127.0.0.1:10026_solr"]}}
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .scheduled_maintenance after 100ms
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 100ms
   [junit4]   2> 839942 DEBUG (AutoscalingActionExecutor-5680-thread-1) [    ] 
o.a.s.c.a.ScheduledTriggers -- processing took 263 ms for event 
id=82b4bc75b0a43T9do0n67b2298jo009pmyl79n5
   [junit4]   2> 839943 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10027_solr&inPlaceMove=true&replica=core_node5
   [junit4]   2> 839943 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction 
action=MOVEREPLICA&collection=testNodeWithMultipleReplicasLost&targetNode=127.0.0.1:10025_solr&inPlaceMove=true&replica=core_node3
   [junit4]   2> 839943 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction -------------_ FINAL STATE 
--------------
   [junit4]   2> 839943 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction * Node values: {
   [junit4]   2>   "127.0.0.1:10025_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":1,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1023,
   [junit4]   2>     "sysprop.java.version":"1.8.0_191",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10025_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10025,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0,
   [junit4]   2>     "totaldisk":10240},
   [junit4]   2>   "127.0.0.1:10026_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":2,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1022,
   [junit4]   2>     "sysprop.java.version":"1.8.0_191",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10026_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10026,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0,
   [junit4]   2>     "totaldisk":10240},
   [junit4]   2>   "127.0.0.1:10024_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":2,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1022,
   [junit4]   2>     "sysprop.java.version":"1.8.0_191",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10024_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10024,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0,
   [junit4]   2>     "totaldisk":10240},
   [junit4]   2>   "127.0.0.1:10027_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":1,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1023,
   [junit4]   2>     "sysprop.java.version":"1.8.0_191",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10027_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10027,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0,
   [junit4]   2>     "totaldisk":10240}}
   [junit4]   2> 839943 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction * Live nodes: 
[127.0.0.1:10025_solr, 127.0.0.1:10024_solr, 127.0.0.1:10027_solr]
   [junit4]   2> 839944 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.s.TestSimComputePlanAction * Collection 
testNodeWithMultipleReplicasLost state: 
DocCollection(testNodeWithMultipleReplicasLost//clusterstate.json/10)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"2",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"3",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{
   [junit4]   2>     "shard2":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node6":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n6",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10024_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node4":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n4",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10025_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node5":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard2_replica_n5",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10026_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"0-7fffffff",
   [junit4]   2>       "state":"active"},
   [junit4]   2>     "shard1":{
   [junit4]   2>       "replicas":{
   [junit4]   2>         "core_node1":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n1",
   [junit4]   2>           "leader":"true",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10027_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node2":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n2",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10024_solr",
   [junit4]   2>           "state":"active",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0},
   [junit4]   2>         "core_node3":{
   [junit4]   2>           
"core":"testNodeWithMultipleReplicasLost_shard1_replica_n3",
   [junit4]   2>           "SEARCHER.searcher.maxDoc":0,
   [junit4]   2>           "SEARCHER.searcher.deletedDocs":0,
   [junit4]   2>           "INDEX.sizeInBytes":10240,
   [junit4]   2>           "node_name":"127.0.0.1:10026_solr",
   [junit4]   2>           "state":"down",
   [junit4]   2>           "type":"NRT",
   [junit4]   2>           "INDEX.sizeInGB":9.5367431640625E-6,
   [junit4]   2>           "SEARCHER.searcher.numDocs":0}},
   [junit4]   2>       "range":"80000000-ffffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 839944 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool 
executor now
   [junit4]   2> 839944 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 839944 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 839944 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread 
pool executor
   [junit4] IGNOR/A 0.00s J0 | TestSimComputePlanAction.testNodeLost
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled 
(@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/SOLR-12028))
   [junit4]   2> 839951 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 839956 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 839956 DEBUG 
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed 
explicitly
   [junit4]   2> 839957 INFO  
(TEST-TestSimComputePlanAction.testNodeWithMultipleReplicasLost-seed#[9DEAD04B921F287])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testNodeWithMultipleReplicasLost
   [junit4]   2> 839963 INFO  
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testNodeAdded
   [junit4]   2> 839965 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider --- new Overseer leader: 
127.0.0.1:10028_solr
   [junit4]   2> 839966 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and 
.scheduled_maintenance triggers
   [junit4]   2> 839966 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=0
   [junit4]   2> 839966 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 0
   [junit4]   2> 839966 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode 
version 1
   [junit4]   2> 839966 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 0
   [junit4]   2> 839966 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
   [junit4]   2> 839966 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial 
livenodes: [127.0.0.1:10028_solr]
   [junit4]   2> 839966 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 839967 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
   [junit4]   2> 839967 DEBUG (ScheduledTrigger-5685-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 839976 INFO  
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history 
in memory.
   [junit4]   2> 839977 DEBUG (simCloudManagerPool-5684-thread-1) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 839977 DEBUG (simCloudManagerPool-5684-thread-1) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
2
   [junit4]   2> 839977 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
   [junit4]   2> 839978 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 839978 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
   [junit4]   2> 839982 DEBUG (simCloudManagerPool-5684-thread-2) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 839982 DEBUG (simCloudManagerPool-5684-thread-2) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
3
   [junit4]   2> 839982 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
   [junit4]   2> 839982 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 839982 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
   [junit4]   2> 839987 DEBUG (ScheduledTrigger-5685-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840007 DEBUG (ScheduledTrigger-5685-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840030 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840050 DEBUG (ScheduledTrigger-5685-thread-2) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840071 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840089 DEBUG (simCloudManagerPool-5684-thread-3) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 840089 DEBUG (simCloudManagerPool-5684-thread-3) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
4
   [junit4]   2> 840090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
   [junit4]   2> 840090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger - Initial 
livenodes: [127.0.0.1:10028_solr]
   [junit4]   2> 840090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated 
with properties: {event=nodeAdded, waitFor=1, actions=[{name=compute_plan, 
class=solr.ComputePlanAction}, {name=test, 
class=org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction$AssertingTriggerAction}],
 enabled=true}
   [junit4]   2> 840090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 840090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
   [junit4]   2> 840091 DEBUG (simCloudManagerPool-5684-thread-4) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 840091 DEBUG (simCloudManagerPool-5684-thread-4) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
5
   [junit4]   2> 840091 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
   [junit4]   2> 840091 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread -- cleaning old nodeLost / nodeAdded markers
   [junit4]   2> 840091 DEBUG (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
   [junit4]   2> 840095 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 840095 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 840095 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840096 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- simCreateCollection testNodeAdded, 
currentVersion=1
   [junit4]   2> 840097 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=1
   [junit4]   2> 840097 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 1
   [junit4]   2> 840097 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.o.ClusterStateMutator building a new cName: testNodeAdded
   [junit4]   2> 840107 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=2
   [junit4]   2> 840107 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 2
   [junit4]   2> 840107 WARN  (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.a.c.CreateCollectionCmd Specified number of replicas of 4 on collection 
testNodeAdded is higher than the number of Solr instances currently live or 
live and part of your createNodeSet(1). It's unusual to run two replica of the 
same slice on the same Solr-instance.
   [junit4]   2> 840108 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper Creating a new session
   [junit4]   2> 840108 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper New session created 
   [junit4]   2> 840109 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2299414001 
sessionWrapper.createTime 2299413961692153, this.sessionWrapper.createTime 
2299413961692153 
   [junit4]   2> 840109 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.s.c.a.PolicyHelper session set to NULL
   [junit4]   2> 840109 DEBUG (simCloudManagerPool-5684-thread-5) [    ] 
o.a.s.c.a.s.SimClusterStateProvider -- finished createCollection testNodeAdded, 
currentVersion=3
   [junit4]   2> 840113 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** creating new collection states, 
currentVersion=3
   [junit4]   2> 840113 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.SimClusterStateProvider ** saved cluster state version 3
   [junit4]   2> 840115 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 840115 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 840115 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840116 DEBUG (simCloudManagerPool-5684-thread-10) [    ] 
o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
   [junit4]   2> 840116 DEBUG (simCloudManagerPool-5684-thread-10) [    ] 
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 
6
   [junit4]   2> 840844 INFO  
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.TestSimComputePlanAction -------------_ FINAL STATE --------------
   [junit4]   2> 840844 INFO  
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.TestSimComputePlanAction * Node values: {"127.0.0.1:10028_solr":{
   [junit4]   2>     "sysprop.java.vendor":"Oracle Corporation",
   [junit4]   2>     "cores":0,
   [junit4]   2>     "host":"127.0.0.1",
   [junit4]   2>     "freedisk":1024,
   [junit4]   2>     "sysprop.java.version":"1.8.0_191",
   [junit4]   2>     "ip_1":"127",
   [junit4]   2>     "ip_3":"0",
   [junit4]   2>     "ip_2":"0",
   [junit4]   2>     "ip_4":"1",
   [junit4]   2>     "node":"127.0.0.1:10028_solr",
   [junit4]   2>     "metrics:solr.jvm:buffers.direct.Count":0,
   [junit4]   2>     "port":10028,
   [junit4]   2>     "heapUsage":123450000,
   [junit4]   2>     "sysLoadAvg":1.0,
   [junit4]   2>     
"metrics:solr.node:ADMIN./admin/authorization.clientErrors:count":0,
   [junit4]   2>     "totaldisk":10240}}
   [junit4]   2> 840844 INFO  
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.TestSimComputePlanAction * Live nodes: [127.0.0.1:10028_solr]
   [junit4]   2> 840844 INFO  
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.s.TestSimComputePlanAction * Collection testNodeAdded state: 
DocCollection(testNodeAdded//clusterstate.json/3)={
   [junit4]   2>   "replicationFactor":"1",
   [junit4]   2>   "pullReplicas":"0",
   [junit4]   2>   "router":{"name":"compositeId"},
   [junit4]   2>   "maxShardsPerNode":"-1",
   [junit4]   2>   "autoAddReplicas":"false",
   [junit4]   2>   "nrtReplicas":"4",
   [junit4]   2>   "tlogReplicas":"0",
   [junit4]   2>   "autoCreated":"true",
   [junit4]   2>   "shards":{"shard1":{
   [junit4]   2>       "replicas":{},
   [junit4]   2>       "range":"80000000-7fffffff",
   [junit4]   2>       "state":"active"}}}
   [junit4]   2> 840844 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
   [junit4]   2> 840844 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeAddedTrigger Found livenodes: 1
   [junit4]   2> 840844 DEBUG (ScheduledTrigger-5685-thread-4) [    ] 
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with 
currently live nodes: 1 and last live nodes: 1
   [junit4]   2> 840845 INFO  (Simulated OverseerAutoScalingTriggerThread) [    
] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are 
closed, exiting.
   [junit4]   2> 840848 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
   [junit4]   2> 840848 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
   [junit4]   2> 840848 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
   [junit4]   2> 840848 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool 
executor
   [junit4]   2> 840849 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
   [junit4]   2> 840849 DEBUG 
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
   [junit4]   2> 840849 INFO  
(TEST-TestSimComputePlanAction.testNodeAdded-seed#[9DEAD04B921F287]) [    ] 
o.a.s.SolrTestCaseJ4 ###Ending testNodeAdded
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=TestSimComputePlanAction -Dtests.method=testNodeAdded 
-Dtests.seed=9DEAD04B921F287 -Dtests.slow=true -Dtests.locale=fi 
-Dtests.timezone=US/East-Indiana -Dtests.asserts=true 
-Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.90s J0 | TestSimComputePlanAction.testNodeAdded <<<
   [junit4]    > Throwable #1: java.util.concurrent.TimeoutException: 
OverseerTriggerThread never caught up to the latest znodeVersion
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9DEAD04B921F287:6C1DFB731B825A84]:0)
   [junit4]    >        at org.apache.solr.util.TimeOut.waitFor(TimeOut.java:66)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.sim.SimSolrCloudTestCase.assertAutoscalingUpdateComplete(SimSolrCloudTestCase.java:71)
   [junit4]    >        at 
org.apache.solr.cloud.autoscaling.sim.TestSimComputePlanAction.testNodeAdded(TestSimComputePlanAction.java:314)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.sim.TestSimComputePlanAction_9DEAD04B921F287-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene80): {}, 
docValues:{}, maxPointsInLeafNode=1540, maxMBSortInHeap=5.347205638435432, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@ff5ce5a),
 locale=fi, timezone=US/East-Indiana
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_191 
(64-bit)/cpus=3,threads=1,free=261185312,total=515899392
   [junit4]   2> NOTE: All tests run in this JVM: [ReplicationFactorTest, 
InfixSuggestersTest, SpellCheckCollatorWithCollapseTest, 
TestSolrFieldCacheBean, CdcrWithNodesRestartsTest, CdcrOpsAndBoundariesTest, 
CollectionsAPIDistributedZkTest, HdfsNNFailoverTest, 
TestPartialUpdateDeduplication, RollingRestartTest, 
NodeMarkersRegistrationTest, ZkShardTermsTest, CollectionsAPISolrJTest, 
TestManagedResource, VersionInfoTest, TestZkAclsWithHadoopAuth, TestLazyCores, 
PeerSyncWithLeaderAndIndexFingerprintCachingTest, TestSimNodeLostTrigger, 
TestTlogReplica, TestRandomFaceting, TestShardHandlerFactory, 
TestHdfsUpdateLog, CustomCollectionTest, 
TestOverriddenPrefixQueryForCustomFieldType, TestDownShardTolerantSearch, 
TestReplicationHandler, TestIntervalFaceting, OverseerTaskQueueTest, 
RootFieldTest, OpenCloseCoreStressTest, LeaderTragicEventTest, TestTrie, 
TestSolrCoreSnapshots, TestRecoveryHdfs, ScheduledMaintenanceTriggerTest, 
AutoAddReplicasIntegrationTest, RuleEngineTest, CdcrBidirectionalTest, 
TestPayloadScoreQParserPlugin, TestLFUCache, HLLSerializationTest, 
EchoParamsTest, DistributedTermsComponentTest, RequestHandlersTest, 
TestFieldCache, JWTAuthPluginIntegrationTest, AlternateDirectoryTest, 
SpellCheckComponentTest, TestGraphTermsQParserPlugin, ShardsWhitelistTest, 
TestInitParams, TestManagedSchemaThreadSafety, 
DistributedFacetPivotLongTailTest, TlogReplayBufferedWhileIndexingTest, 
DistributedSpellCheckComponentTest, TestComplexPhraseLeadingWildcard, 
CoreAdminOperationTest, TestSimComputePlanAction]
   [junit4] Completed [162/846 (1!)] on J0 in 1.46s, 3 tests, 1 error, 1 
skipped <<< FAILURES!

[...truncated 999 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> 2021869 INFO  
(SUITE-BasicDistributedZkTest-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001/init-core-data-001
   [junit4]   2> 2021870 WARN  
(SUITE-BasicDistributedZkTest-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 2021870 INFO  
(SUITE-BasicDistributedZkTest-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) 
w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2021872 INFO  
(SUITE-BasicDistributedZkTest-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 2021872 INFO  
(SUITE-BasicDistributedZkTest-seed#[9DEAD04B921F287]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: 
/dj_ncx/
   [junit4]   2> 2021877 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2021878 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2021878 INFO  (ZkTestServer Run Thread) [    ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2021978 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:41968
   [junit4]   2> 2021978 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:41968
   [junit4]   2> 2021978 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1 41968
   [junit4]   2> 2021984 INFO  (zkConnectionManagerCallback-16870-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2021987 INFO  (zkConnectionManagerCallback-16872-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2021989 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 2021992 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 2022010 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2022011 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 2022013 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 2022014 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 2022015 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2022017 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2022018 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2022019 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2022021 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkTestServer put 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 2022022 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly 
asked otherwise
   [junit4]   2> 2022362 WARN  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.s.AbstractConnector Ignoring deprecated socket close linger time
   [junit4]   2> 2022362 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.s.e.JettySolrRunner Start Jetty (original configured port=0)
   [junit4]   2> 2022362 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 1 ...
   [junit4]   2> 2022362 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] o.e.j.s.Server 
jetty-9.4.14.v20181114; built: 2018-11-14T21:20:31.478Z; git: 
c4550056e785fb5665914545889f21dc136ad9e6; jvm 1.8.0_191-b12
   [junit4]   2> 2022364 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2022364 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2022364 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.s.session node0 Scavenging every 660000ms
   [junit4]   2> 2022366 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@74a920f5{/dj_ncx,null,AVAILABLE}
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.s.AbstractConnector Started ServerConnector@39b8fc48{HTTP/1.1,[http/1.1, 
h2c]}{127.0.0.1:62133}
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] o.e.j.s.Server 
Started @2024170ms
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001/tempDir-001/control/data,
 replicaType=NRT, hostContext=/dj_ncx, hostPort=62133, 
coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001/control-001/cores}
   [junit4]   2> 2022367 ERROR 
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be 
missing or incomplete.
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.s.SolrDispatchFilter Using logger factory 
org.apache.logging.slf4j.Log4jLoggerFactory
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 
8.1.0
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2022367 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2019-03-08T06:31:42.697Z
   [junit4]   2> 2022369 INFO  (zkConnectionManagerCallback-16874-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2022370 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 2022370 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001/control-001/solr.xml
   [junit4]   2> 2022374 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay 
is ignored
   [junit4]   2> 2022374 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.SolrXmlConfig Configuration parameter 
autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2022385 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.SolrXmlConfig MBean server found: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1067851d, but no JMX reporters were 
configured - adding default JMX reporter.
   [junit4]   2> 2022550 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: 
WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false]
   [junit4]   2> 2022551 WARN  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@30b391de[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2022555 WARN  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for 
SslContextFactory@36b431dd[provider=null,keyStore=null,trustStore=null]
   [junit4]   2> 2022557 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41968/solr
   [junit4]   2> 2022558 INFO  (zkConnectionManagerCallback-16880-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2022561 INFO  (zkConnectionManagerCallback-16882-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2022633 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:62133_dj_ncx
   [junit4]   2> 2022633 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.c.Overseer Overseer 
(id=72206872121507844-127.0.0.1:62133_dj_ncx-n_0000000000) starting
   [junit4]   2> 2022639 INFO  (zkConnectionManagerCallback-16889-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2022641 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster 
at 127.0.0.1:41968/solr ready
   [junit4]   2> 2022642 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:62133_dj_ncx
   [junit4]   2> 2022642 INFO  
(OverseerStateUpdate-72206872121507844-127.0.0.1:62133_dj_ncx-n_0000000000) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.c.Overseer Starting to work on the main 
queue : 127.0.0.1:62133_dj_ncx
   [junit4]   2> 2022644 INFO  (zkCallback-16888-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2022645 INFO  (zkCallback-16881-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2022663 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.h.a.MetricsHistoryHandler No .system 
collection, keeping metrics history in memory.
   [junit4]   2> 2022677 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.node' (registry 'solr.node') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1067851d
   [junit4]   2> 2022684 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jvm' (registry 'solr.jvm') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1067851d
   [junit4]   2> 2022685 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.jetty' (registry 'solr.jetty') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1067851d
   [junit4]   2> 2022685 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001/control-001/cores
   [junit4]   2> 2022701 INFO  (zkConnectionManagerCallback-16895-thread-1) [   
 ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 2022702 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2022704 INFO  
(TEST-BasicDistributedZkTest.test-seed#[9DEAD04B921F287]) [    ] 
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41968/solr ready
   [junit4]   2> 2022705 INFO  (qtp1568851560-41306) [n:127.0.0.1:62133_dj_ncx  
  ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params 
collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:62133_dj_ncx&wt=javabin&version=2
 and sendToOCPQueue=true
   [junit4]   2> 2022724 INFO  
(OverseerThreadFactory-11471-thread-1-processing-n:127.0.0.1:62133_dj_ncx) 
[n:127.0.0.1:62133_dj_ncx    ] o.a.s.c.a.c.CreateCollectionCmd Create 
collection control_collection
   [junit4]   2> 2022835 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx  
  x:control_collection_shard1_replica_n1] o.a.s.h.a.CoreAdminOperation core 
create command 
qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2022835 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx  
  x:control_collection_shard1_replica_n1] o.a.s.c.TransientSolrCoreCacheDefault 
Allocating transient cache for 4 transient cores
   [junit4]   2> 2023861 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.1.0
   [junit4]   2> 2023874 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 2024036 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2024109 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' 
using configuration from collection control_collection, trusted=true
   [junit4]   2> 2024109 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.m.r.SolrJmxReporter JMX monitoring for 
'solr.core.control_collection.shard1.replica_n1' (registry 
'solr.core.control_collection.shard1.replica_n1') enabled at server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@1067851d
   [junit4]   2> 2024110 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore 
at 
[/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001/control-001/cores/control_collection_shard1_replica_n1],
 
dataDir=[/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 2024112 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=14, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 2024114 WARN  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,attributes = 
{initParams=a, name=/dump, class=DumpRequestHandler},args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 2024173 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 2024174 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2024176 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2024176 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2024177 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=1.0]
   [junit4]   2> 2024177 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.s.SolrIndexSearcher Opening 
[Searcher@46eaa5b9[control_collection_shard1_replica_n1] main]
   [junit4]   2> 2024187 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 2024188 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2024188 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2024188 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1627417953716666368
   [junit4]   2> 2024192 INFO  
(searcherExecutor-11476-thread-1-processing-n:127.0.0.1:62133_dj_ncx 
x:control_collection_shard1_replica_n1 c:control_collection s:shard1) 
[n:127.0.0.1:62133_dj_ncx c:control_collection s:shard1  
x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore 
[control_collection_shard1_replica_n1] Registered new searcher 
Searcher@46eaa5b9[control_collection_shard1_replica_n1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2024202 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ZkShardTerms Successful update of terms at 
/collections/control_collection/terms/shard1 to Terms{values={core_node2=0}, 
version=0}
   [junit4]   2> 2024202 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContextBase make sure parent is created 
/collections/control_collection/leaders/shard1
   [junit4]   2> 2024212 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2024212 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2024212 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:62133/dj_ncx/control_collection_shard1_replica_n1/
   [junit4]   2> 2024213 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2024214 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.SyncStrategy 
http://127.0.0.1:62133/dj_ncx/control_collection_shard1_replica_n1/ has no 
replicas
   [junit4]   2> 2024215 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replica_n1] 
o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node 
/collections/control_collection/leaders/shard1/leader after winning as 
/collections/control_collection/leader_elect/shard1/election/72206872121507844-core_node2-n_0000000000
   [junit4]   2> 2024222 INFO  (qtp1568851560-41308) [n:127.0.0.1:62133_dj_ncx 
c:control_collection s:shard1  x:control_collection_shard1_replic

[...truncated too long message...]

ption.create(KeeperException.java:130)
   [junit4]    >        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:54)
   [junit4]    >        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1221)
   [junit4]    >        at 
org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:358)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:71)
   [junit4]    >        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:358)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1378)
   [junit4]    >        at 
org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1364)
   [junit4]    >        ... 46 moreThrowable #2: 
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=41913, name=testExecutor-11618-thread-2, 
state=RUNNABLE, group=TGRP-BasicDistributedZkTest]
   [junit4]    > Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:44521/dj_ncx: ADDREPLICA failed to create 
replica
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9DEAD04B921F287]:0)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:649)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:207)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:224)
   [junit4]    >        at 
org.apache.solr.cloud.BasicDistributedZkTest.lambda$createCollectionInOneInstance$1(BasicDistributedZkTest.java:657)
   [junit4]    >        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:209)
   [junit4]    >        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]    >        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]    >        at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.BasicDistributedZkTest_9DEAD04B921F287-001
   [junit4]   2> NOTE: test params are: codec=Lucene80, 
sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4df2511e),
 locale=zh, timezone=WET
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_191 
(64-bit)/cpus=3,threads=1,free=159222968,total=488636416
   [junit4]   2> NOTE: All tests run in this JVM: [RestartWhileUpdatingTest, 
PhrasesIdentificationComponentTest, SpellPossibilityIteratorTest, TestSolrJ, 
HDFSCollectionsAPITest, CdcrReplicationHandlerTest, 
ConcurrentDeleteAndCreateCollectionTest, HdfsRecoverLeaseTest, 
TimeRoutedAliasUpdateProcessorTest, SSLMigrationTest, RestoreTriggerStateTest, 
ZkSolrClientTest, ConcurrentCreateRoutedAliasTest, TestManagedResourceStorage, 
AddSchemaFieldsUpdateProcessorFactoryTest, CacheHeaderTest, 
TestMergePolicyConfig, PeerSyncWithLeaderTest, TestSimPolicyCloud, 
TestTolerantUpdateProcessorCloud, TestSimpleTrackingShardHandler, 
TestSimpleTextCodec, TestInPlaceUpdatesDistrib, 
HdfsCollectionsAPIDistributedZkTest, TestPayloadCheckQParserPlugin, 
TestExclusionRuleCollectionAccess, TestReplicationHandlerBackup, 
TestRemoteStreaming, OverseerTest, SoftAutoCommitTest, PluginInfoTest, 
LeaderVoteWaitTimeoutTest, PathHierarchyTokenizerFactoryTest, 
BinaryUpdateRequestHandlerTest, TestReload, ScheduledTriggerIntegrationTest, 
AutoAddReplicasPlanActionTest, RulesTest, CdcrBootstrapTest, 
TestPseudoReturnFields, TestLRUCache, HLLUtilTest, MinimalSchemaTest, 
FacetPivotSmallTest, ResourceLoaderTest, TestFieldCacheReopen, 
JWTAuthPluginTest, BlobRepositoryCloudTest, StatsComponentTest, 
TestHashQParserPlugin, ShufflingReplicaListTransformerTest, TestJmxIntegration, 
TestOmitPositions, DistributedFacetPivotSmallAdvancedTest, 
TriLevelCompositeIdRoutingTest, DistributedSuggestComponentTest, 
TestComplexPhraseQParserPlugin, CoreAdminRequestStatusTest, 
TestSimDistribStateManager, ByteBuffersDirectoryFactoryTest, FileUtilsTest, 
TestSkipOverseerOperations, TestSolrConfigHandlerCloud, ShardRoutingCustomTest, 
DocValuesMultiTest, TestDocumentBuilder, TestDelegationWithHadoopAuth, 
TestRandomFlRTGCloud, MultiSolrCloudTestCaseTest, TestSystemCollAutoCreate, 
SimpleMLTQParserTest, AtomicUpdatesTest, DebugComponentTest, 
LeaderElectionContextKeyTest, TestExceedMaxTermLength, TestDistributedMap, 
TestSchemaNameResource, TestTolerantSearch, HdfsChaosMonkeySafeLeaderTest, 
TestWordDelimiterFilterFactory, TestChildDocTransformer, TestBinaryField, 
ResponseHeaderTest, TestSimExecutePlanAction, MetricUtilsTest, 
BadIndexSchemaTest, TestConfigReload, TestLRUStatsCache, RemoteQueryErrorTest, 
XsltUpdateRequestHandlerTest, TestSort, TestScoreJoinQPNoScore, 
HdfsDirectoryFactoryTest, PingRequestHandlerTest, TestZkChroot, 
UniqFieldsUpdateProcessorFactoryTest, SharedFSAutoReplicaFailoverTest, 
SolrTestCaseJ4Test, TestFunctionQuery, HttpPartitionTest, TestRecovery, 
PeerSyncWithIndexFingerprintCachingTest, TestTrackingShardHandlerFactory, 
TemplateUpdateProcessorTest, ChaosMonkeyNothingIsSafeTest, 
BlockJoinFacetDistribTest, ZookeeperStatusHandlerTest, TestUninvertingReader, 
TestBulkSchemaAPI, TestCloudJSONFacetSKG, URLClassifyProcessorTest, 
DistributedFacetSimpleRefinementLongTailTest, OverseerModifyCollectionTest, 
TestSubQueryTransformerDistrib, TestSchemaManager, 
SimpleCollectionCreateDeleteTest, ComputePlanActionTest, SampleTest, 
FieldMutatingUpdateProcessorTest, ZkControllerTest, 
TestLMDirichletSimilarityFactory, UpdateParamsTest, TestSubQueryTransformer, 
OverseerStatusTest, TestSolrDeletionPolicy1, TestLegacyTerms, 
DateMathParserTest, TestConfigSetsAPI, BufferStoreTest, 
TestJsonFacetsWithNestedObjects, TestRebalanceLeaders, SuggestComponentTest, 
CollectionsAPIAsyncDistributedZkTest, LeaderFailureAfterFreshStartTest, 
TestNoOpRegenerator, TestCollapseQParserPlugin, TestJsonFacets, 
TestReloadAndDeleteDocs, DocValuesNotIndexedTest, HttpSolrCallGetCoreTest, 
TestMissingGroups, NodeAddedTriggerTest, JsonLoaderTest, 
PreAnalyzedUpdateProcessorTest, TestSafeXMLParsing, TestStressLucene, 
TestNamedUpdateProcessors, DataDrivenBlockJoinTest, TestDistributedMissingSort, 
LargeFieldTest, TestNumericTerms32, ChangedSchemaMergeTest, 
CollectionReloadTest, TestRandomCollapseQParserPlugin, 
ConjunctionSolrSpellCheckerTest, CircularListTest, 
TestHighFrequencyDictionaryFactory, TestUtilizeNode, OrderedExecutorTest, 
SolrIndexSplitterTest, TestXIncludeConfig, TestAuthorizationFramework, 
TestAnalyzeInfixSuggestions, TestCloudRecovery, 
IgnoreLargeDocumentProcessorFactoryTest, CheckHdfsIndexTest, 
TestPHPSerializedResponseWriter, TestJettySolrRunner, 
CustomHighlightComponentTest, BaseCdcrDistributedZkTest, 
TestLocalFSCloudBackupRestore, TestDynamicFieldCollectionResource, 
TestManagedSynonymGraphFilterFactory, MetricsHistoryIntegrationTest, 
TestObjectReleaseTracker, ManagedSchemaRoundRobinCloudTest, 
SchemaVersionSpecificBehaviorTest, JvmMetricsTest, TestCorePropertiesReload, 
DistributedQueryElevationComponentTest, HdfsUnloadDistributedZkTest, 
TestReRankQParserPlugin, TestInPlaceUpdatesStandalone, 
ClassificationUpdateProcessorIntegrationTest, TestRetrieveFieldsOptimizer, 
SpellCheckCollatorTest, DeleteStatusTest, TestSearchPerf, DeleteReplicaTest, 
TestSystemIdResolver, TestPullReplica, TestFieldCacheWithThreads, 
OverriddenZkACLAndCredentialsProvidersTest, 
TestDistributedStatsComponentCardinality, TestUseDocValuesAsStored2, 
FileBasedSpellCheckerTest, AnalysisErrorHandlingTest, TestSimpleQParserPlugin, 
TestMaxScoreQueryParser, DirectoryFactoryTest, TestSQLHandler, 
HdfsThreadLeakTest, TestManagedStopFilterFactory, BasicDistributedZkTest]
   [junit4] Completed [465/846 (2!)] on J1 in 727.01s, 1 test, 1 error <<< 
FAILURES!

[...truncated 1328 lines...]
   [junit4] JVM J1: stdout was not empty, see: 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/solr/build/solr-core/test/temp/junit4-J1-20190308_055800_0293389328313476136364.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: Java heap space
   [junit4] Dumping heap to 
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/heapdumps/java_pid6208.hprof
 ...
   [junit4] Heap dump file created [518569419 bytes in 13.092 secs]
   [junit4] <<< JVM J1: EOF ----

[...truncated 8932 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/build.xml:633: The 
following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-8.x-Solaris/build.xml:585: Some of 
the tests produced a heap dump, but did not fail. Maybe a suppressed 
OutOfMemoryError? Dumps created:
* java_pid6208.hprof

Total time: 110 minutes 37 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting 
ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to