Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21900/ Java: 64bit/jdk-9.0.4 -XX:+UseCompressedOops -XX:+UseG1GC
1 tests failed. FAILED: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration Error Message: did not finish processing in time Stack Trace: java.lang.AssertionError: did not finish processing in time at __randomizedtesting.SeedInfo.seed([1981903BF1DA6793:4A38D28B13CBF269]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:404) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:564) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.base/java.lang.Thread.run(Thread.java:844) Build Log: [...truncated 14498 lines...] [junit4] Suite: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest [junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_1981903BF1DA6793-001/init-core-data-001 [junit4] 2> 1565372 WARN (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9 [junit4] 2> 1565372 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 1565373 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0) [junit4] 2> 1565373 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> 1565373 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_1981903BF1DA6793-001/tempDir-001 [junit4] 2> 1565373 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1565373 INFO (Thread-4898) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1565373 INFO (Thread-4898) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1565375 ERROR (Thread-4898) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 1565473 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34321 [junit4] 2> 1565475 INFO (zkConnectionManagerCallback-5112-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565478 INFO (jetty-launcher-5109-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 1565478 INFO (jetty-launcher-5109-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T04:27:37+07:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8 [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-1) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-2) [ ] o.e.j.s.session Scavenging every 600000ms [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d11f173{/solr,null,AVAILABLE} [junit4] 2> 1565479 INFO (jetty-launcher-5109-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@62c95899{/solr,null,AVAILABLE} [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@35d6f83c{HTTP/1.1,[http/1.1]}{127.0.0.1:44663} [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@76593fad{HTTP/1.1,[http/1.1]}{127.0.0.1:33043} [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.e.j.s.Server Started @1565517ms [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.e.j.s.Server Started @1565517ms [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44663} [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33043} [junit4] 2> 1565481 ERROR (jetty-launcher-5109-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1565481 ERROR (jetty-launcher-5109-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0 [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-25T00:23:45.065354Z [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1565481 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-04-25T00:23:45.065384Z [junit4] 2> 1565485 INFO (zkConnectionManagerCallback-5114-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565485 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1565485 INFO (zkConnectionManagerCallback-5116-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565485 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1565488 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007f29debc0002, likely client has closed socket [junit4] 2> 1565489 INFO (jetty-launcher-5109-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34321/solr [junit4] 2> 1565489 INFO (jetty-launcher-5109-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34321/solr [junit4] 2> 1565490 INFO (zkConnectionManagerCallback-5124-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565490 INFO (zkConnectionManagerCallback-5122-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565491 INFO (zkConnectionManagerCallback-5126-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565491 INFO (zkConnectionManagerCallback-5128-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565521 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1565521 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1565521 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33043_solr [junit4] 2> 1565522 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44663_solr [junit4] 2> 1565522 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.Overseer Overseer (id=72197411845177349-127.0.0.1:33043_solr-n_0000000000) starting [junit4] 2> 1565522 INFO (zkCallback-5127-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1565522 INFO (zkCallback-5125-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1565524 INFO (zkConnectionManagerCallback-5137-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565525 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1565525 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34321/solr ready [junit4] 2> 1565525 DEBUG (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers [junit4] 2> 1565526 DEBUG (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 1565526 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1565526 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33043_solr [junit4] 2> 1565526 DEBUG (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1 [junit4] 2> 1565526 DEBUG (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 1565526 INFO (zkCallback-5125-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1565526 INFO (zkCallback-5127-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1565529 INFO (zkCallback-5136-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1565530 DEBUG (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:33043_solr, 127.0.0.1:44663_solr] [junit4] 2> 1565530 DEBUG (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1565530 DEBUG (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 1565530 DEBUG (ScheduledTrigger-8188-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565599 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33043.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4deeed2d [junit4] 2> 1565600 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44663.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4deeed2d [junit4] 2> 1565604 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33043.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4deeed2d [junit4] 2> 1565604 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33043.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4deeed2d [junit4] 2> 1565605 INFO (jetty-launcher-5109-thread-2) [n:127.0.0.1:33043_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_1981903BF1DA6793-001/tempDir-001/node2/. [junit4] 2> 1565605 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44663.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4deeed2d [junit4] 2> 1565605 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44663.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4deeed2d [junit4] 2> 1565606 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_1981903BF1DA6793-001/tempDir-001/node1/. [junit4] 2> 1565608 INFO (zkConnectionManagerCallback-5142-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565609 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 1565610 INFO (jetty-launcher-5109-thread-1) [n:127.0.0.1:44663_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34321/solr ready [junit4] 2> 1565630 INFO (zkConnectionManagerCallback-5144-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565631 INFO (zkConnectionManagerCallback-5149-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1565632 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 1565632 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34321/solr ready [junit4] 2> 1565634 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and .scheduled_maintenance triggers [junit4] 2> 1565634 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 0 [junit4] 2> 1565634 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion -1 [junit4] 2> 1565634 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 0 [junit4] 2> 1565634 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial livenodes: [127.0.0.1:10001_solr, 127.0.0.1:10000_solr] [junit4] 2> 1565634 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1565634 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 0, lastZnodeVersion 0 [junit4] 2> 1565635 DEBUG (ScheduledTrigger-8197-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565655 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565675 DEBUG (ScheduledTrigger-8197-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565696 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565716 DEBUG (ScheduledTrigger-8197-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565736 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565756 DEBUG (ScheduledTrigger-8197-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565776 DEBUG (ScheduledTrigger-8197-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565796 DEBUG (ScheduledTrigger-8197-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565816 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565837 DEBUG (ScheduledTrigger-8197-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565845 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTrigger [junit4] 2> 1565857 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565878 DEBUG (ScheduledTrigger-8197-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565898 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565900 DEBUG (simCloudManagerPool-8196-thread-7) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard1: {"core_node1":{ [junit4] 2> "core":"testTrigger_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testTrigger_collection"}} [junit4] 2> 1565900 DEBUG (simCloudManagerPool-8196-thread-6) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testTrigger_collection / shard2: {"core_node3":{ [junit4] 2> "core":"testTrigger_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"testTrigger_collection"}} [junit4] 2> 1565918 DEBUG (ScheduledTrigger-8197-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565938 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565958 DEBUG (ScheduledTrigger-8197-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565978 DEBUG (ScheduledTrigger-8197-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1565999 DEBUG (ScheduledTrigger-8197-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1566019 DEBUG (ScheduledTrigger-8197-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1566039 DEBUG (ScheduledTrigger-8197-thread-4) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1566059 DEBUG (ScheduledTrigger-8197-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1566079 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1566090 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.IndexSizeTriggerTest ####################################### [junit4] 2> ############ CLUSTER STATE ############ [junit4] 2> ####################################### [junit4] 2> ## Live nodes: 2 [junit4] 2> ## Empty nodes: 0 [junit4] 2> ## Dead nodes: 0 [junit4] 2> ## Collections: [testTrigger_collection] [junit4] 2> DocCollection(testTrigger_collection//clusterstate.json/28)={ [junit4] 2> "replicationFactor":"2", [junit4] 2> "pullReplicas":"0", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "autoCreated":"true", [junit4] 2> "shards":{ [junit4] 2> "shard2":{ [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testTrigger_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testTrigger_collection_shard2_replica_n4", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}}, [junit4] 2> "range":"0-7fffffff", [junit4] 2> "state":"active"}, [junit4] 2> "shard1":{ [junit4] 2> "replicas":{ [junit4] 2> "core_node1":{ [junit4] 2> "core":"testTrigger_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}, [junit4] 2> "core_node2":{ [junit4] 2> "core":"testTrigger_collection_shard1_replica_n2", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}}, [junit4] 2> "range":"80000000-ffffffff", [junit4] 2> "state":"active"}}} [junit4] 2> ## Max replicas per node: 2 [junit4] 2> ## Min replicas per node: 2 [junit4] 2> ## Total replicas: 4 [junit4] 2> ## * testTrigger_collection 4 [junit4] 2> ## - active 4 [junit4] 2> ######### Solr op counts ########## [junit4] 2> ## - CREATE 1 [junit4] 2> ## - update 26 [junit4] 2> ######### Autoscaling event counts ########### [junit4] 2> [junit4] 2> 1566090 DEBUG (TEST-IndexSizeTriggerTest.testTrigger-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1 [junit4] 2> 1566090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1 [junit4] 2> 1566090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1566090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1566090 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1 [junit4] 2> 1566190 INFO (TEST-IndexSizeTriggerTest.testTrigger-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTrigger [junit4] 2> 1566204 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMergeIntegration [junit4] 2> 1566238 DEBUG (simCloudManagerPool-8196-thread-40) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testMergeIntegration_collection / shard1: {"core_node1":{ [junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testMergeIntegration_collection"}} [junit4] 2> 1566269 DEBUG (simCloudManagerPool-8196-thread-52) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 1566269 DEBUG (simCloudManagerPool-8196-thread-52) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2 [junit4] 2> 1566269 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2 [junit4] 2> 1566269 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1566269 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1566269 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2 [junit4] 2> 1566270 DEBUG (simCloudManagerPool-8196-thread-53) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 1566270 DEBUG (simCloudManagerPool-8196-thread-53) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3 [junit4] 2> 1566270 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3 [junit4] 2> 1566271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1566271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1566271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3 [junit4] 2> 1566271 DEBUG (simCloudManagerPool-8196-thread-54) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 1566271 DEBUG (simCloudManagerPool-8196-thread-54) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4 [junit4] 2> 1566271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4 [junit4] 2> 1566271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1566271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1566271 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4 [junit4] 2> 1566531 DEBUG (ScheduledTrigger-8188-thread-2) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1567531 DEBUG (ScheduledTrigger-8188-thread-1) [ ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: 2 [junit4] 2> 1567553 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.IndexSizeTriggerTest ####################################### [junit4] 2> ############ CLUSTER STATE ############ [junit4] 2> ####################################### [junit4] 2> ## Live nodes: 2 [junit4] 2> ## Empty nodes: 0 [junit4] 2> ## Dead nodes: 0 [junit4] 2> ## Collections: [testMergeIntegration_collection] [junit4] 2> DocCollection(testMergeIntegration_collection//clusterstate.json/48)={ [junit4] 2> "replicationFactor":"2", [junit4] 2> "pullReplicas":"0", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "autoCreated":"true", [junit4] 2> "shards":{ [junit4] 2> "shard2":{ [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n3", [junit4] 2> "SEARCHER.searcher.maxDoc":3, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":3}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testMergeIntegration_collection_shard2_replica_n4", [junit4] 2> "SEARCHER.searcher.maxDoc":3, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":3}}, [junit4] 2> "range":"0-7fffffff", [junit4] 2> "state":"active"}, [junit4] 2> "shard1":{ [junit4] 2> "replicas":{ [junit4] 2> "core_node1":{ [junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":5, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":2}, [junit4] 2> "core_node2":{ [junit4] 2> "core":"testMergeIntegration_collection_shard1_replica_n2", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":5, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":2}}, [junit4] 2> "range":"80000000-ffffffff", [junit4] 2> "state":"active"}}} [junit4] 2> ## Max replicas per node: 2 [junit4] 2> ## Min replicas per node: 2 [junit4] 2> ## Total replicas: 4 [junit4] 2> ## * testMergeIntegration_collection 4 [junit4] 2> ## - active 4 [junit4] 2> ######### Solr op counts ########## [junit4] 2> ## - CREATE 1 [junit4] 2> ## - autoscaling 3 [junit4] 2> ## - update 17 [junit4] 2> ######### Autoscaling event counts ########### [junit4] 2> [junit4] 2> 1567553 DEBUG (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5 [junit4] 2> 1567558 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5 [junit4] 2> 1567558 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1567558 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1567558 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5 [junit4] 2> 1567654 INFO (TEST-IndexSizeTriggerTest.testMergeIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMergeIntegration [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=IndexSizeTriggerTest -Dtests.method=testMergeIntegration -Dtests.seed=1981903BF1DA6793 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca-IT -Dtests.timezone=Europe/Podgorica -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [junit4] FAILURE 1.46s J0 | IndexSizeTriggerTest.testMergeIntegration <<< [junit4] > Throwable #1: java.lang.AssertionError: did not finish processing in time [junit4] > at __randomizedtesting.SeedInfo.seed([1981903BF1DA6793:4A38D28B13CBF269]:0) [junit4] > at org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest.testMergeIntegration(IndexSizeTriggerTest.java:404) [junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564) [junit4] > at java.base/java.lang.Thread.run(Thread.java:844) [junit4] 2> 1567672 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testMixedBounds [junit4] 2> 1567672 WARN (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.IndexSizeTriggerTest Requires SOLR-12208 [junit4] 2> 1567672 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.IndexSizeTriggerTest ####################################### [junit4] 2> ############ CLUSTER STATE ############ [junit4] 2> ####################################### [junit4] 2> ## Live nodes: 2 [junit4] 2> ## Empty nodes: 2 [junit4] 2> ## Dead nodes: 0 [junit4] 2> ## Collections: [] [junit4] 2> ## Max replicas per node: 0 [junit4] 2> ## Min replicas per node: 0 [junit4] 2> ## Total replicas: 0 [junit4] 2> ######### Solr op counts ########## [junit4] 2> ######### Autoscaling event counts ########### [junit4] 2> [junit4] 2> 1567672 DEBUG (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6 [junit4] 2> 1567672 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6 [junit4] 2> 1567672 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1567672 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1567672 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6 [junit4] 2> 1567773 INFO (TEST-IndexSizeTriggerTest.testMixedBounds-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testMixedBounds [junit4] 2> 1567788 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSplitIntegration [junit4] 2> 1567830 DEBUG (simCloudManagerPool-8196-thread-66) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2: {"core_node3":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 1567830 DEBUG (simCloudManagerPool-8196-thread-67) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1: {"core_node1":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":0, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":0, [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 1567840 DEBUG (simCloudManagerPool-8196-thread-68) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 1567840 DEBUG (simCloudManagerPool-8196-thread-68) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7 [junit4] 2> 1567840 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7 [junit4] 2> 1567841 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1567841 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1567841 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7 [junit4] 2> 1567841 DEBUG (simCloudManagerPool-8196-thread-69) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 1567841 DEBUG (simCloudManagerPool-8196-thread-69) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8 [junit4] 2> 1567841 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8 [junit4] 2> 1567841 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1567841 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1567841 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8 [junit4] 2> 1567842 DEBUG (simCloudManagerPool-8196-thread-70) [ ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration [junit4] 2> 1567842 DEBUG (simCloudManagerPool-8196-thread-70) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9 [junit4] 2> 1567842 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9 [junit4] 2> 1567842 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1567842 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1567842 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9 [junit4] 2> 1567983 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: { [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} [junit4] 2> 1567983 DEBUG (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.ScheduledTriggers Pausing all triggers: [index_size_trigger] [junit4] 2> 1567984 INFO (ScheduledTrigger-8197-thread-3) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2133568217052196, stage=STARTED, actionName='null', event={ [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 1567985 DEBUG (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing actions for { [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} [junit4] 2> 1567986 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2133568304041196, stage=BEFORE_ACTION, actionName='compute_plan', event={ [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 1567986 DEBUG (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ComputePlanAction -- processing event: { [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {BEFORE_ACTION=[compute_plan]} [junit4] 2> 1567986 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1 [junit4] 2> 1567986 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ComputePlanAction Computed Plan: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2 [junit4] 2> 1567986 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.s.c.a.PolicyHelper returnSession, curr-time 2133568347 sessionWrapper.createTime 2133568333842946, this.sessionWrapper.createTime 2133568333842946 [junit4] 2> 1567987 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2133568348775946, stage=AFTER_ACTION, actionName='compute_plan', event={ [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":2, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 1567987 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2133568361079796, stage=BEFORE_ACTION, actionName='execute_plan', event={ [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":2, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan]}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 1567987 DEBUG (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ExecutePlanAction -- processing event: { [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":2, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}} with context properties: {operations=[org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@6af0c097, org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard@1e0d8c6c], AFTER_ACTION=[compute_plan], BEFORE_ACTION=[compute_plan, execute_plan]} [junit4] 2> 1567987 DEBUG (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard1 [junit4] 2> 1568131 DEBUG (simCloudManagerPool-8196-thread-101) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_1: {"core_node10":{ [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "base_url":"http://127.0.0.1:10000/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7, [junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1", [junit4] 2> "shard":"shard1_1", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 1568131 DEBUG (simCloudManagerPool-8196-thread-102) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard1_0: {"core_node7":{ [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "base_url":"http://127.0.0.1:10001/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7, [junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0", [junit4] 2> "shard":"shard1_0", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 1568131 DEBUG (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ExecutePlanAction Executing operation: action=SPLITSHARD&collection=testSplitIntegration_collection&shard=shard2 [junit4] 2> 1568275 DEBUG (simCloudManagerPool-8196-thread-111) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_0: {"core_node14":{ [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":6, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "base_url":"http://127.0.0.1:10000/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":6, [junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica1", [junit4] 2> "shard":"shard2_0", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 1568275 DEBUG (simCloudManagerPool-8196-thread-108) [ ] o.a.s.c.a.s.SimClusterStateProvider -- elected new leader for testSplitIntegration_collection / shard2_1: {"core_node16":{ [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":5, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "base_url":"http://127.0.0.1:10000/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":5, [junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica1", [junit4] 2> "shard":"shard2_1", [junit4] 2> "collection":"testSplitIntegration_collection"}} [junit4] 2> 1568275 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2133582774944846, stage=AFTER_ACTION, actionName='execute_plan', event={ [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":2, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={properties.operations=[{class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/79476655b8b34T35dnlvswkfhxragdss7t8a9ri/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard1}, {class=org.apache.solr.client.solrj.request.CollectionAdminRequest$SplitShard, method=GET, params.action=SPLITSHARD, params.async=index_size_trigger/79476655b8b34T35dnlvswkfhxragdss7t8a9ri/0, params.waitForFinalState=true, params.collection=testSplitIntegration_collection, params.shard=shard2}], properties.BEFORE_ACTION=[compute_plan, execute_plan], properties.responses=[{status={state=completed,msg=found [index_size_trigger/79476655b8b34T35dnlvswkfhxragdss7t8a9ri/0] in completed tasks},success=}, {status={state=completed,msg=found [index_size_trigger/79476655b8b34T35dnlvswkfhxragdss7t8a9ri/0] in completed tasks},success=}], source=index_size_trigger, properties.AFTER_ACTION=[compute_plan, execute_plan]}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 1568276 INFO (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.IndexSizeTriggerTest =======> CapturedEvent{timestamp=2133582801436846, stage=SUCCEEDED, actionName='null', event={ [junit4] 2> "id":"79476655b8b34T35dnlvswkfhxragdss7t8a9ri", [junit4] 2> "source":"index_size_trigger", [junit4] 2> "eventTime":2133561064524596, [junit4] 2> "eventType":"INDEXSIZE", [junit4] 2> "properties":{ [junit4] 2> "__start__":2, [junit4] 2> "aboveSize":{"testSplitIntegration_collection":[ [junit4] 2> "{\"core_node1\":{\n \"core\":\"testSplitIntegration_collection_shard1_replica_n1\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":14,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":14,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":14,\n \"__bytes__\":1,\n \"shard\":\"shard1\",\n \"collection\":\"testSplitIntegration_collection\"}}", [junit4] 2> "{\"core_node3\":{\n \"core\":\"testSplitIntegration_collection_shard2_replica_n3\",\n \"leader\":\"true\",\n \"SEARCHER.searcher.maxDoc\":11,\n \"SEARCHER.searcher.deletedDocs\":0,\n \"INDEX.sizeInBytes\":1,\n \"__docs__\":11,\n \"violationType\":\"aboveDocs\",\n \"node_name\":\"127.0.0.1:10000_solr\",\n \"state\":\"active\",\n \"type\":\"NRT\",\n \"SEARCHER.searcher.numDocs\":11,\n \"__bytes__\":1,\n \"shard\":\"shard2\",\n \"collection\":\"testSplitIntegration_collection\"}}"]}, [junit4] 2> "belowSize":{}, [junit4] 2> "_enqueue_time_":2133568186958546, [junit4] 2> "requestedOps":[ [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard1\"}]}}", [junit4] 2> "Op{action=SPLITSHARD, hints={COLL_SHARD=[{\n \"first\":\"testSplitIntegration_collection\",\n \"second\":\"shard2\"}]}}"]}}, context={}, config={ [junit4] 2> "trigger":"index_size_trigger", [junit4] 2> "stage":[ [junit4] 2> "STARTED", [junit4] 2> "ABORTED", [junit4] 2> "SUCCEEDED", [junit4] 2> "FAILED"], [junit4] 2> "afterAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"], [junit4] 2> "class":"org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest$CapturingTriggerListener", [junit4] 2> "beforeAction":[ [junit4] 2> "compute_plan", [junit4] 2> "execute_plan"]}, message='null'} [junit4] 2> 1568277 DEBUG (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Resuming trigger: index_size_trigger after 100ms [junit4] 2> 1568277 DEBUG (AutoscalingActionExecutor-8198-thread-1) [ ] o.a.s.c.a.ScheduledTriggers -- processing took 14578 ms for event id=79476655b8b34T35dnlvswkfhxragdss7t8a9ri [junit4] 2> 1568278 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.IndexSizeTriggerTest ####################################### [junit4] 2> ############ CLUSTER STATE ############ [junit4] 2> ####################################### [junit4] 2> ## Live nodes: 2 [junit4] 2> ## Empty nodes: 0 [junit4] 2> ## Dead nodes: 0 [junit4] 2> ## Collections: [testSplitIntegration_collection] [junit4] 2> DocCollection(testSplitIntegration_collection//clusterstate.json/83)={ [junit4] 2> "replicationFactor":"2", [junit4] 2> "pullReplicas":"0", [junit4] 2> "router":{"name":"compositeId"}, [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "autoAddReplicas":"false", [junit4] 2> "nrtReplicas":"2", [junit4] 2> "tlogReplicas":"0", [junit4] 2> "autoCreated":"true", [junit4] 2> "shards":{ [junit4] 2> "shard2":{ [junit4] 2> "stateTimestamp":"1524615957166681550", [junit4] 2> "replicas":{ [junit4] 2> "core_node3":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n3", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}, [junit4] 2> "core_node4":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_replica_n4", [junit4] 2> "SEARCHER.searcher.maxDoc":11, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":11}}, [junit4] 2> "range":"0-7fffffff", [junit4] 2> "state":"inactive"}, [junit4] 2> "shard1":{ [junit4] 2> "stateTimestamp":"1524615950004409900", [junit4] 2> "replicas":{ [junit4] 2> "core_node1":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n1", [junit4] 2> "leader":"true", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}, [junit4] 2> "core_node2":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_replica_n2", [junit4] 2> "SEARCHER.searcher.maxDoc":14, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":14}}, [junit4] 2> "range":"80000000-ffffffff", [junit4] 2> "state":"inactive"}, [junit4] 2> "shard2_1":{ [junit4] 2> "parent":"shard2", [junit4] 2> "stateTimestamp":"1524615957167087100", [junit4] 2> "range":"40000000-7fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node16":{ [junit4] 2> "leader":"true", [junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica1", [junit4] 2> "SEARCHER.searcher.maxDoc":5, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "base_url":"http://127.0.0.1:10000/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":5}, [junit4] 2> "core_node15":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_1_replica0", [junit4] 2> "SEARCHER.searcher.maxDoc":5, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "base_url":"http://127.0.0.1:10001/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":5}}}, [junit4] 2> "shard1_1":{ [junit4] 2> "parent":"shard1", [junit4] 2> "stateTimestamp":"1524615950014186900", [junit4] 2> "range":"c0000000-ffffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node10":{ [junit4] 2> "leader":"true", [junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica1", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "base_url":"http://127.0.0.1:10000/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}, [junit4] 2> "core_node9":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_1_replica0", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "base_url":"http://127.0.0.1:10001/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}}}, [junit4] 2> "shard1_0":{ [junit4] 2> "parent":"shard1", [junit4] 2> "stateTimestamp":"1524615950014071150", [junit4] 2> "range":"80000000-bfffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node7":{ [junit4] 2> "leader":"true", [junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica0", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "base_url":"http://127.0.0.1:10001/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}, [junit4] 2> "core_node8":{ [junit4] 2> "core":"testSplitIntegration_collection_shard1_0_replica1", [junit4] 2> "SEARCHER.searcher.maxDoc":7, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "base_url":"http://127.0.0.1:10000/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":7}}}, [junit4] 2> "shard2_0":{ [junit4] 2> "parent":"shard2", [junit4] 2> "stateTimestamp":"1524615957166968600", [junit4] 2> "range":"0-3fffffff", [junit4] 2> "state":"active", [junit4] 2> "replicas":{ [junit4] 2> "core_node14":{ [junit4] 2> "leader":"true", [junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica1", [junit4] 2> "SEARCHER.searcher.maxDoc":6, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10000_solr", [junit4] 2> "base_url":"http://127.0.0.1:10000/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":6}, [junit4] 2> "core_node13":{ [junit4] 2> "core":"testSplitIntegration_collection_shard2_0_replica0", [junit4] 2> "SEARCHER.searcher.maxDoc":6, [junit4] 2> "SEARCHER.searcher.deletedDocs":0, [junit4] 2> "INDEX.sizeInBytes":1, [junit4] 2> "node_name":"127.0.0.1:10001_solr", [junit4] 2> "base_url":"http://127.0.0.1:10001/solr", [junit4] 2> "state":"active", [junit4] 2> "type":"NRT", [junit4] 2> "SEARCHER.searcher.numDocs":6}}}}} [junit4] 2> ## Max replicas per node: 6 [junit4] 2> ## Min replicas per node: 6 [junit4] 2> ## Total replicas: 12 [junit4] 2> ## * testSplitIntegration_collection 12 [junit4] 2> ## - active 12 [junit4] 2> ######### Solr op counts ########## [junit4] 2> ## - CREATE 1 [junit4] 2> ## - DELETESTATUS 2 [junit4] 2> ## - REQUESTSTATUS 2 [junit4] 2> ## - SPLITSHARD 2 [junit4] 2> ## - autoscaling 3 [junit4] 2> ## - update 28 [junit4] 2> ######### Autoscaling event counts ########### [junit4] 2> ## * Trigger: index_size_trigger [junit4] 2> ## - STARTED 1 [junit4] 2> ## - SUCCEEDED 1 [junit4] 2> [junit4] 2> 1568278 DEBUG (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 10 [junit4] 2> 1568278 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 10 [junit4] 2> 1568279 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers [junit4] 2> 1568279 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers [junit4] 2> 1568279 DEBUG (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 10, lastZnodeVersion 10 [junit4] 2> 1568379 INFO (TEST-IndexSizeTriggerTest.testSplitIntegration-seed#[1981903BF1DA6793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSplitIntegration [junit4] 2> 1568379 DEBUG (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now [junit4] 2> 1568379 WARN (Simulated OverseerAutoScalingTriggerThread) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 1568380 DEBUG (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now [junit4] 2> 1568380 DEBUG (SUITE-IndexSizeTr [...truncated too long message...] ) [junit4] 2> 1568393 INFO (jetty-closer-5110-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72197411845177349-127.0.0.1:33043_solr-n_0000000000) closing [junit4] 2> 1568393 INFO (OverseerStateUpdate-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33043_solr [junit4] 2> 1568393 WARN (OverseerAutoScalingTriggerThread-72197411845177349-127.0.0.1:33043_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 1568393 INFO (zkCallback-5141-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (0) [junit4] 2> 1568393 DEBUG (jetty-closer-5110-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now [junit4] 2> 1568393 DEBUG (jetty-closer-5110-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now [junit4] 2> 1568393 DEBUG (jetty-closer-5110-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor [junit4] 2> 1568394 DEBUG (jetty-closer-5110-thread-1) [ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool executor [junit4] 2> 1568394 DEBUG (jetty-closer-5110-thread-1) [ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely [junit4] 2> 1568394 DEBUG (jetty-closer-5110-thread-1) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly [junit4] 2> 1568394 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1007f29debc0006, likely client has closed socket [junit4] 2> 1568394 INFO (jetty-closer-5110-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d11f173{/solr,null,UNAVAILABLE} [junit4] 2> 1568397 INFO (jetty-closer-5110-thread-2) [ ] o.e.j.s.session Stopped scavenging [junit4] 2> 1568397 INFO (jetty-closer-5110-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@62c95899{/solr,null,UNAVAILABLE} [junit4] 2> 1568398 INFO (jetty-closer-5110-thread-1) [ ] o.e.j.s.session Stopped scavenging [junit4] 2> 1568398 ERROR (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 1568398 INFO (SUITE-IndexSizeTriggerTest-seed#[1981903BF1DA6793]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34321 34321 [junit4] 2> 1569197 INFO (Thread-4898) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34321 34321 [junit4] 2> 1569197 WARN (Thread-4898) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 5 /solr/aliases.json [junit4] 2> 5 /solr/clusterprops.json [junit4] 2> 2 /solr/security.json [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 5 /solr/clusterstate.json [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 5 /solr/live_nodes [junit4] 2> 5 /solr/collections [junit4] 2> [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.IndexSizeTriggerTest_1981903BF1DA6793-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1999, maxMBSortInHeap=6.205405259145021, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@4e484692), locale=ca-IT, timezone=Europe/Podgorica [junit4] 2> NOTE: Linux 4.13.0-37-generic amd64/Oracle Corporation 9.0.4 (64-bit)/cpus=8,threads=1,free=347122488,total=536870912 [junit4] 2> NOTE: All tests run in this JVM: [TokenizerChainTest, DistributedQueryElevationComponentTest, TestHighlightDedupGrouping, TestManagedSchemaAPI, BlobRepositoryCloudTest, TestShortCircuitedRequests, VMParamsZkACLAndCredentialsProvidersTest, SolrCloudExampleTest, ChaosMonkeyNothingIsSafeTest, TestRemoteStreaming, ExitableDirectoryReaderTest, TestJsonFacetsWithNestedObjects, TestNoOpRegenerator, SolrGraphiteReporterTest, SaslZkACLProviderTest, ScheduledTriggerIntegrationTest, DistributedFacetSimpleRefinementLongTailTest, LeaderFailureAfterFreshStartTest, TestSmileRequest, TestUnifiedSolrHighlighter, HdfsUnloadDistributedZkTest, TestPrepRecovery, UUIDFieldTest, MultiThreadedOCPTest, ConnectionReuseTest, ResponseBuilderTest, BlockJoinFacetRandomTest, ImplicitSnitchTest, DistributedSuggestComponentTest, DataDrivenBlockJoinTest, MigrateRouteKeyTest, HdfsChaosMonkeyNothingIsSafeTest, TestSimpleTextCodec, TestMultiValuedNumericRangeQuery, TestReloadDeadlock, CurrencyFieldTypeTest, NodeMarkersRegistrationTest, TestDocumentBuilder, TestEmbeddedSolrServerConstructors, TestDefaultStatsCache, TestStressLucene, TestRestManager, TestHashPartitioner, TestLeaderElectionWithEmptyReplica, TestJavabinTupleStreamParser, TestFieldSortValues, SolrIndexSplitterTest, TestCloudNestedDocsSort, TestScoreJoinQPScore, SolrSlf4jReporterTest, TestIndexingPerformance, ZkCLITest, TestFastOutputStream, TestCrossCoreJoin, TestMacroExpander, SolrIndexConfigTest, TestHighFrequencyDictionaryFactory, ConjunctionSolrSpellCheckerTest, SuggesterWFSTTest, TestClusterStateProvider, AddBlockUpdateTest, DistributedFacetPivotLongTailTest, TestMergePolicyConfig, DebugComponentTest, TestDocBasedVersionConstraints, CdcrBidirectionalTest, ShardRoutingTest, BadIndexSchemaTest, TestCustomStream, CdcrReplicationHandlerTest, MetricTriggerIntegrationTest, TestSort, DistributedExpandComponentTest, HttpPartitionOnCommitTest, SolrRequestParserTest, TestComplexPhraseLeadingWildcard, TestPayloadScoreQParserPlugin, TestMaxTokenLenTokenizer, OpenExchangeRatesOrgProviderTest, StatsComponentTest, TestCloudRecovery, HdfsSyncSliceTest, TestSchemaNameResource, TermVectorComponentDistributedTest, TestSolrCLIRunExample, TestTrackingShardHandlerFactory, TestExactStatsCache, TestRandomFlRTGCloud, LIRRollingUpdatesTest, LargeFieldTest, TestExportWriter, TestDistributedMap, TestSimDistributedQueue, TestLockTree, TestSubQueryTransformerDistrib, EnumFieldTest, PluginInfoTest, TestNumericTokenStream, TestBlendedInfixSuggestions, TestCoreAdminApis, SolrMetricReporterTest, EchoParamsTest, SpellCheckCollatorTest, TestApiFramework, WrapperMergePolicyFactoryTest, CreateRoutedAliasTest, TestSolrDeletionPolicy1, TestReplicationHandlerBackup, FieldAnalysisRequestHandlerTest, BasicAuthStandaloneTest, TestSolrFieldCacheBean, CursorPagingTest, TestLegacyFieldReuse, DistribJoinFromCollectionTest, TestRequestStatusCollectionAPI, TestWriterPerf, TestExpandComponent, TestSortByMinMaxFunction, TestTlogReplica, TestCloudJSONFacetJoinDomain, CustomCollectionTest, TestUseDocValuesAsStored, TestChildDocTransformer, TestSchemaManager, TestDynamicFieldCollectionResource, TestMaxScoreQueryParser, AliasIntegrationTest, TestCollationFieldDocValues, TestBackupRepositoryFactory, TestIBSimilarityFactory, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, SyncSliceTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest, TestReplicationHandler, TestReload, DistributedTermsComponentTest, SolrCoreTest, TestGroupingSearch, QueryElevationComponentTest, BasicFunctionalityTest, TestLazyCores, TestCoreDiscovery, SuggesterTest, TestCSVLoader, PolyFieldTest, WordBreakSolrSpellCheckerTest, TestWordDelimiterFilterFactory, StatelessScriptUpdateProcessorFactoryTest, TestReversedWildcardFilterFactory, TestQueryTypes, RequestHandlersTest, TermVectorComponentTest, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, MBeansHandlerTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CleanupOldIndexTest, ConfigSetsAPITest, DeleteInactiveReplicaTest, DeleteNodeTest, DeleteStatusTest, DistribCursorPagingTest, MoveReplicaHDFSTest, NodeMutatorTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, PeerSyncReplicationTest, RecoveryAfterSoftCommitTest, TestClusterProperties, TestConfigSetsAPI, TestRequestForwarding, TestSSLRandomization, TestStressCloudBlindAtomicUpdates, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, CollectionsAPIAsyncDistributedZkTest, SimpleCollectionCreateDeleteTest, TestCollectionAPI, TestReplicaProperties, HdfsAutoAddReplicasIntegrationTest, IndexSizeTriggerTest] [junit4] Completed [610/804 (1!)] on J0 in 3.84s, 4 tests, 1 failure <<< FAILURES! [...truncated 44347 lines...] [repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/21900/consoleText [repro] Revision: ac027145fba8a315ff2fec88d1cfd23d8536f42c [repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" [repro] Repro line: ant test -Dtestcase=IndexSizeTriggerTest -Dtests.method=testMergeIntegration -Dtests.seed=1981903BF1DA6793 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca-IT -Dtests.timezone=Europe/Podgorica -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [repro] ant clean [...truncated 6 lines...] [repro] Test suites by module: [repro] solr/core [repro] IndexSizeTriggerTest [repro] ant compile-test [...truncated 3303 lines...] [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.IndexSizeTriggerTest" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseG1GC" -Dtests.seed=1981903BF1DA6793 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ca-IT -Dtests.timezone=Europe/Podgorica -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [...truncated 91 lines...] [repro] Failures: [repro] 0/5 failed: org.apache.solr.cloud.autoscaling.IndexSizeTriggerTest [repro] Exiting with code 0 [...truncated 40 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org