Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2401/
1 tests failed. FAILED: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster.testAddNode Error Message: no MOVEREPLICA ops? Stack Trace: java.lang.AssertionError: no MOVEREPLICA ops? at __randomizedtesting.SeedInfo.seed([FD2E2C2A99B258F7:5AC1318956FFD7EF]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.apache.solr.cloud.autoscaling.sim.TestLargeCluster.testAddNode(TestLargeCluster.java:262) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) Build Log: [...truncated 12208 lines...] [junit4] Suite: org.apache.solr.cloud.autoscaling.sim.TestLargeCluster [junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestLargeCluster_FD2E2C2A99B258F7-001/init-core-data-001 [junit4] 2> 359220 WARN (SUITE-TestLargeCluster-seed#[FD2E2C2A99B258F7]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1 [junit4] 2> 359220 INFO (SUITE-TestLargeCluster-seed#[FD2E2C2A99B258F7]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 359222 INFO (SUITE-TestLargeCluster-seed#[FD2E2C2A99B258F7]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN) [junit4] 2> 359222 INFO (SUITE-TestLargeCluster-seed#[FD2E2C2A99B258F7]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> 359455 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger [junit4] 2> 359455 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0 [junit4] 2> 359455 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [] [junit4] 2> 359455 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1 [junit4] 2> 359455 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0 [junit4] 2> 359490 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 359490 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0 [junit4] 2> 359491 DEBUG (ScheduledTrigger-549-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 1 [junit4] 2> 359650 DEBUG (ScheduledTrigger-549-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 71 [junit4] 2> 359677 DEBUG (ScheduledTrigger-549-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 99 [junit4] 2> 359705 DEBUG (ScheduledTrigger-549-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 359738 DEBUG (ScheduledTrigger-549-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 359738 INFO (TEST-TestLargeCluster.testAddNode-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAddNode [junit4] 2> 359738 DEBUG (TEST-TestLargeCluster.testAddNode-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 359738 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 359738 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 359738 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 359738 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 359740 INFO (TEST-TestLargeCluster.testAddNode-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimCloudManager === Restarting OverseerTriggerThread and clearing object cache... [junit4] 2> 359740 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 359840 DEBUG (TEST-TestLargeCluster.testAddNode-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly [junit4] 2> 359843 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger [junit4] 2> 359864 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2 [junit4] 2> 359864 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10095_solr, 127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 127.0.0.1:10098_solr, 127.0.0.1:10003_solr, 127.0.0.1:10001_solr, 127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10071_solr, 127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 127.0.0.1:10000_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10002_solr, 127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10037_solr, 127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10056_solr, 127.0.0.1:10072_solr] [junit4] 2> 359864 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion -1 [junit4] 2> 359864 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2 [junit4] 2> 359867 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 359867 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2 [junit4] 2> 359867 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 359888 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 359991 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360011 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360031 DEBUG (simCloudManagerPool-551-thread-1) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 360031 DEBUG (simCloudManagerPool-551-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3 [junit4] 2> 360031 DEBUG (simCloudManagerPool-551-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10095_solr, 127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 127.0.0.1:10098_solr, 127.0.0.1:10003_solr, 127.0.0.1:10001_solr, 127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10071_solr, 127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 127.0.0.1:10000_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10002_solr, 127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10037_solr, 127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10056_solr, 127.0.0.1:10072_solr] [junit4] 2> 360032 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360032 DEBUG (simCloudManagerPool-551-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:10082_solr, 127.0.0.1:10004_solr, 127.0.0.1:10018_solr, 127.0.0.1:10049_solr, 127.0.0.1:10020_solr, 127.0.0.1:10065_solr, 127.0.0.1:10021_solr, 127.0.0.1:10005_solr, 127.0.0.1:10066_solr, 127.0.0.1:10035_solr, 127.0.0.1:10051_solr, 127.0.0.1:10019_solr, 127.0.0.1:10096_solr, 127.0.0.1:10022_solr, 127.0.0.1:10033_solr, 127.0.0.1:10017_solr, 127.0.0.1:10047_solr, 127.0.0.1:10095_solr, 127.0.0.1:10081_solr, 127.0.0.1:10084_solr, 127.0.0.1:10036_solr, 127.0.0.1:10052_solr, 127.0.0.1:10006_solr, 127.0.0.1:10079_solr, 127.0.0.1:10098_solr, 127.0.0.1:10003_solr, 127.0.0.1:10001_solr, 127.0.0.1:10054_solr, 127.0.0.1:10099_solr, 127.0.0.1:10071_solr, 127.0.0.1:10023_solr, 127.0.0.1:10076_solr, 127.0.0.1:10007_solr, 127.0.0.1:10055_solr, 127.0.0.1:10010_solr, 127.0.0.1:10016_solr, 127.0.0.1:10070_solr, 127.0.0.1:10077_solr, 127.0.0.1:10038_solr, 127.0.0.1:10032_solr, 127.0.0.1:10093_solr, 127.0.0.1:10061_solr, 127.0.0.1:10067_solr, 127.0.0.1:10086_solr, 127.0.0.1:10089_solr, 127.0.0.1:10045_solr, 127.0.0.1:10042_solr, 127.0.0.1:10029_solr, 127.0.0.1:10083_solr, 127.0.0.1:10080_solr, 127.0.0.1:10048_solr, 127.0.0.1:10064_solr, 127.0.0.1:10043_solr, 127.0.0.1:10057_solr, 127.0.0.1:10074_solr, 127.0.0.1:10026_solr, 127.0.0.1:10012_solr, 127.0.0.1:10060_solr, 127.0.0.1:10073_solr, 127.0.0.1:10058_solr, 127.0.0.1:10013_solr, 127.0.0.1:10090_solr, 127.0.0.1:10088_solr, 127.0.0.1:10027_solr, 127.0.0.1:10039_solr, 127.0.0.1:10025_solr, 127.0.0.1:10044_solr, 127.0.0.1:10028_solr, 127.0.0.1:10092_solr, 127.0.0.1:10041_solr, 127.0.0.1:10087_solr, 127.0.0.1:10009_solr, 127.0.0.1:10000_solr, 127.0.0.1:10030_solr, 127.0.0.1:10014_solr, 127.0.0.1:10011_solr, 127.0.0.1:10040_solr, 127.0.0.1:10085_solr, 127.0.0.1:10046_solr, 127.0.0.1:10068_solr, 127.0.0.1:10063_solr, 127.0.0.1:10015_solr, 127.0.0.1:10069_solr, 127.0.0.1:10062_solr, 127.0.0.1:10008_solr, 127.0.0.1:10024_solr, 127.0.0.1:10050_solr, 127.0.0.1:10075_solr, 127.0.0.1:10078_solr, 127.0.0.1:10002_solr, 127.0.0.1:10097_solr, 127.0.0.1:10031_solr, 127.0.0.1:10034_solr, 127.0.0.1:10091_solr, 127.0.0.1:10094_solr, 127.0.0.1:10037_solr, 127.0.0.1:10053_solr, 127.0.0.1:10059_solr, 127.0.0.1:10056_solr, 127.0.0.1:10072_solr] [junit4] 2> 360032 DEBUG (simCloudManagerPool-551-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=5, actions=[{name=compute, class=org.apache.solr.cloud.autoscaling.ComputePlanAction}, {name=execute, class=org.apache.solr.cloud.autoscaling.ExecutePlanAction}], enabled=true} [junit4] 2> 360032 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3 [junit4] 2> 360032 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3 [junit4] 2> 360033 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360033 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360066 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360067 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360067 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360091 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360103 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360123 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360143 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360144 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360144 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360176 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360176 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360176 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360196 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360196 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360196 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360233 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360233 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360233 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360269 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360269 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360270 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360306 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360306 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360306 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360334 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360334 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360335 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360355 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360355 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360355 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360375 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360375 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360375 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360411 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360411 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360412 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360448 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360448 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360448 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360484 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360485 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360485 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360521 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360521 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360521 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360558 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360558 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360558 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360594 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360594 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360594 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360631 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360631 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360631 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360651 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360651 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360651 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360672 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360672 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360672 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360708 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360708 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360708 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360744 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360745 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360745 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360781 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360781 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360781 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360817 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360818 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360818 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360854 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360854 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360854 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360891 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360891 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360891 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360927 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360927 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360927 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 360976 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 360976 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 360976 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361012 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361012 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361013 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361049 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361049 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361049 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361199 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361199 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361199 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361219 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361219 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361219 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361256 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361256 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361256 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361292 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361292 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361293 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361329 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361329 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361329 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361365 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361366 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361366 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361402 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361402 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361402 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361434 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361434 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361435 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361455 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361455 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361455 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361507 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361508 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361508 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361528 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361528 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361528 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361564 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361564 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361564 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361589 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361589 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361589 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361625 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361626 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361626 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361646 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361646 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361646 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361682 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361682 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361682 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361719 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361719 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361719 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361747 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361747 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361784 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361784 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361793 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361820 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361820 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361821 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361857 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361857 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361857 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361894 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361894 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361894 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361914 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361914 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361915 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361935 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361935 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361935 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361963 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361963 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361963 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 361984 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 361984 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 361985 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362011 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362012 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362012 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362032 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362032 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362032 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362076 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362077 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362077 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362109 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362109 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362121 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362133 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362142 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362142 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362170 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362170 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362170 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362190 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362190 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362190 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362211 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362211 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362211 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362231 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362231 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362231 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362263 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362263 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362263 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362316 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362316 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362316 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362337 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362337 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362337 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362373 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362373 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362373 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362409 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362410 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362410 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362446 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362446 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362446 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362478 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362478 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362478 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362499 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362499 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362499 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362519 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362519 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362519 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362539 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362539 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362539 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362560 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362560 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362560 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362580 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362580 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362580 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362616 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362616 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362616 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362637 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362637 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362637 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362665 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362665 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362665 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362685 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362686 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362686 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362714 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362714 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362714 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362759 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362759 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362759 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362791 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362791 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362791 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362819 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362820 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362820 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362840 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362840 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362840 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362863 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362863 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362863 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362897 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362897 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362897 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362917 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362917 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362917 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362953 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362953 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362953 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 362997 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 362997 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 362997 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363027 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363027 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363027 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363063 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363063 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363063 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363083 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363083 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363083 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363104 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363104 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363104 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363128 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363128 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363128 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363148 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363148 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363148 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363169 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363169 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363169 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363205 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363205 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363205 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363225 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363225 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363225 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363246 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363246 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363246 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363266 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363266 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363266 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363286 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363286 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363286 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363307 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363307 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363307 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363339 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363339 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363339 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363359 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363359 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363359 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363380 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363380 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363380 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363408 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363408 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363408 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363428 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363428 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363428 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363449 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363449 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363449 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363469 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363469 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363469 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363489 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363489 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363489 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363510 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363510 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363510 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363530 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363530 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363530 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363550 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363550 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363550 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363570 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363571 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363571 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363595 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363595 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363595 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363615 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363615 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363615 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363635 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363635 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363635 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363656 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363656 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363656 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363676 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363676 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363676 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363696 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363696 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363696 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363717 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363717 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363717 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363737 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363737 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363737 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363761 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363761 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363761 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363782 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363782 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363782 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363802 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363802 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363802 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363822 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363822 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363822 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363842 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363842 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363842 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363876 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363876 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363876 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363896 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363896 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363896 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363916 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363916 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363916 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363936 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363937 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363937 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363957 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363957 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363957 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363977 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363977 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363977 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 363997 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 363997 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 363997 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364018 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364018 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364018 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364038 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364038 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364038 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364070 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364070 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364070 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364090 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364090 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364090 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364111 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364111 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364111 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364131 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364131 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364131 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364151 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364151 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364151 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364172 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364172 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364172 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364192 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364192 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364192 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364212 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364212 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364212 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364232 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364232 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364232 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364253 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364253 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364253 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364273 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364273 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364273 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364293 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364293 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364293 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364314 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364314 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364314 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364334 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364334 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364334 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364354 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364354 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364354 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364374 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364374 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364375 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364395 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364395 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364395 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364431 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364431 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364431 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364451 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364451 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364451 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364475 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364476 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364476 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364512 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364512 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364512 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364532 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364533 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364533 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364565 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364565 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364565 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364593 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364593 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364593 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364613 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364613 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364613 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364634 DEBUG (ScheduledTrigger-552-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364634 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364634 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364654 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364654 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364654 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364674 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364674 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364674 DEBUG (ScheduledTrigger-552-thread-4) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364695 DEBUG (ScheduledTrigger-552-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 100 [junit4] 2> 364695 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger [junit4] 2> 364695 DEBUG (ScheduledTrigger-552-thread-3) [ ] o.a.s.c.a.NodeAddedTrigger Found livenodes: 100 [junit4] 2> 364715 DEBUG (ScheduledTrigger-552-thread-1) [ [...truncated too long message...] } [junit4] 2> 423204 INFO (AutoscalingActionExecutor-559-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=MOVEREPLICA&collection=testBasic&targetNode=127.0.0.1:10091_solr&inPlaceMove=true&replica=core_node48 [junit4] 2> 423205 INFO (AutoscalingActionExecutor-559-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2531565972 sessionWrapper.createTime 2531559445492458, this.sessionWrapper.createTime 2531559445492458 [junit4] 2> 423205 DEBUG (AutoscalingActionExecutor-559-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: { [junit4] 2> "id":"8fe6f5db36e3aT5uayhcwzqkb7sml4j06saknvl", [junit4] 2> "source":"node_lost_trigger", [junit4] 2> "eventTime":2531554080550458, [junit4] 2> "eventType":"NODELOST", [junit4] 2> "properties":{ [junit4] 2> "eventTimes":[2531554080550458], [junit4] 2> "_enqueue_time_":2531559368268808, [junit4] 2> "nodeNames":["127.0.0.1:10139_solr"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$MoveReplica@3b2ab918], AFTER_ACTION=[compute], BEFORE_ACTION=[compute, execute]} [junit4] 2> 423205 DEBUG (AutoscalingActionExecutor-559-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=MOVEREPLICA&collection=testBasic&targetNode=127.0.0.1:10091_solr&inPlaceMove=true&replica=core_node48 [junit4] 2> 423336 DEBUG (simCloudManagerPool-557-thread-89) [ ] o.a.s.c.a.s.SimClusterStateProvider -- new replica: {"core_node93":{ [junit4] 2> "core":"testBasic_shard4_replica_n92", [junit4] 2> "shard":"shard4", [junit4] 2> "collection":"testBasic", [junit4] 2> "node_name":"127.0.0.1:10091_solr", [junit4] 2> "type":"NRT"}} [junit4] 2> 423468 DEBUG (AutoscalingActionExecutor-559-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: .auto_add_replicas after 100ms [junit4] 2> 423468 DEBUG (AutoscalingActionExecutor-559-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: node_lost_trigger after 100ms [junit4] 2> 423468 DEBUG (AutoscalingActionExecutor-559-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 19739 ms for event id=8fe6f5db36e3aT5uayhcwzqkb7sml4j06saknvl [junit4] 2> 423504 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.TestLargeCluster Ready after 2909ms [junit4] 2> 423504 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.TestLargeCluster ==== Flaky replicas: 69. Additional MOVEREPLICA count: 1 [junit4] 2> 423504 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBasic [junit4] 2> 423504 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase [junit4] 2> [junit4] 2> 423504 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> 423504 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############ FINAL CLUSTER STATS ############ [junit4] 2> 423504 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ############################################# [junit4] 2> [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Live nodes: 92 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Empty nodes: 17 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Dead nodes: 8 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10042_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10046_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10054_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10055_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10070_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10108_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10112_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## 127.0.0.1:10120_solr [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Collections: [testBasic] [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Max replicas per node: 1 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Min replicas per node: 0 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## Total replicas: 75 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * testBasic 75 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - active 75 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Final Solr op counts ########## [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - CREATE 1 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - DELETESTATUS 9 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - MOVEREPLICA 9 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - REQUESTSTATUS 9 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - autoscaling 2 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - update 12 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ######### Autoscaling event counts ########### [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: .auto_add_replicas [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 2 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 2 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## * Trigger: node_lost_trigger [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - STARTED 4 [junit4] 2> 423505 INFO (TEST-TestLargeCluster.testBasic-seed#[FD2E2C2A99B258F7]) [ ] o.a.s.c.a.s.SimSolrCloudTestCase ## - SUCCEEDED 4 [junit4] IGNOR/A 0.00s J2 | TestLargeCluster.testSearchRate [junit4] > Assumption #1: 'badapple' test group is disabled (@BadApple(bugUrl=https://issues.apache.org/jira/browse/SOLR-11714)) [junit4] 2> 423506 DEBUG (SUITE-TestLargeCluster-seed#[FD2E2C2A99B258F7]-worker) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly [junit4] 2> 423519 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.sim.TestLargeCluster_FD2E2C2A99B258F7-001 [junit4] 2> Mar 04, 2018 7:17:14 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks [junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1722bed5), locale=be-BY, timezone=Europe/Copenhagen [junit4] 2> NOTE: Linux 4.4.0-112-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=267807880,total=430440448 [junit4] 2> NOTE: All tests run in this JVM: [RestartWhileUpdatingTest, DistanceFunctionTest, ReturnFieldsTest, TestShardHandlerFactory, DistributedExpandComponentTest, ResponseHeaderTest, TestDistributedMap, TestUnifiedSolrHighlighter, CustomCollectionTest, MoveReplicaHDFSFailoverTest, RecoveryZkTest, AutoScalingHandlerTest, TestLargeCluster] [junit4] Completed [46/780 (1!)] on J2 in 65.13s, 4 tests, 1 failure, 1 skipped <<< FAILURES! [...truncated 50443 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org