Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.4-Linux/8/ Java: 64bit/jdk-11-ea+14 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed. FAILED: org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader Error Message: Doc with id=4 not found in https://127.0.0.1:38353/solr/outOfSyncReplicasCannotBecomeLeader-false due to: Path not found: /id; rsp={doc=null} Stack Trace: java.lang.AssertionError: Doc with id=4 not found in https://127.0.0.1:38353/solr/outOfSyncReplicasCannotBecomeLeader-false due to: Path not found: /id; rsp={doc=null} at __randomizedtesting.SeedInfo.seed([87DB00AB3F1B54B5:F93020BBFC7C5B8F]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.apache.solr.cloud.TestCloudConsistency.assertDocExists(TestCloudConsistency.java:252) at org.apache.solr.cloud.TestCloudConsistency.assertDocsExistInAllReplicas(TestCloudConsistency.java:236) at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:129) at org.apache.solr.cloud.TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeader(TestCloudConsistency.java:92) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.base/java.lang.Thread.run(Thread.java:832) Build Log: [...truncated 13999 lines...] [junit4] Suite: org.apache.solr.cloud.TestCloudConsistency [junit4] 2> 1489876 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom [junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/init-core-data-001 [junit4] 2> 1489877 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false [junit4] 2> 1489877 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0) [junit4] 2> 1489877 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001 [junit4] 2> 1489877 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1489878 INFO (Thread-5515) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1489878 INFO (Thread-5515) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1489879 ERROR (Thread-5515) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 1489978 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:40957 [junit4] 2> 1489979 INFO (zkConnectionManagerCallback-4529-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1489982 INFO (jetty-launcher-4526-thread-2) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1489982 INFO (jetty-launcher-4526-thread-4) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1489982 INFO (jetty-launcher-4526-thread-3) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1489982 INFO (jetty-launcher-4526-thread-1) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-1) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-2) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e57e869{/solr,null,AVAILABLE} [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a731976{/solr,null,AVAILABLE} [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-3) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-3) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-4) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-3) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-4) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1489983 INFO (jetty-launcher-4526-thread-4) [ ] o.e.j.s.session node0 Scavenging every 660000ms [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@58b960cb{/solr,null,AVAILABLE} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3435f0fc{/solr,null,AVAILABLE} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5993e044{SSL,[ssl, http/1.1]}{127.0.0.1:34135} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@32060858{SSL,[ssl, http/1.1]}{127.0.0.1:38335} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.e.j.s.Server Started @1490014ms [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.e.j.s.Server Started @1490014ms [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34135} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38335} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@761b92a{SSL,[ssl, http/1.1]}{127.0.0.1:36839} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@38761c62{SSL,[ssl, http/1.1]}{127.0.0.1:35327} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.e.j.s.Server Started @1490014ms [junit4] 2> 1489985 ERROR (jetty-launcher-4526-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1489985 ERROR (jetty-launcher-4526-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.e.j.s.Server Started @1490014ms [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36839} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35327} [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:49.696586Z [junit4] 2> 1489985 ERROR (jetty-launcher-4526-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1489985 ERROR (jetty-launcher-4526-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:49.696629Z [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:49.696751Z [junit4] 2> 1489985 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:49.696759Z [junit4] 2> 1489994 INFO (zkConnectionManagerCallback-4535-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1489994 INFO (zkConnectionManagerCallback-4537-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1489994 INFO (zkConnectionManagerCallback-4531-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1489994 INFO (zkConnectionManagerCallback-4533-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1489994 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1489994 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1489994 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1489994 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1490009 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x1009676641a0004, likely client has closed socket [junit4] 2> 1490052 INFO (jetty-launcher-4526-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490053 INFO (zkConnectionManagerCallback-4541-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490056 INFO (zkConnectionManagerCallback-4543-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490057 INFO (jetty-launcher-4526-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490061 INFO (zkConnectionManagerCallback-4547-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490062 INFO (zkConnectionManagerCallback-4551-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490065 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490065 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36839_solr [junit4] 2> 1490065 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.c.Overseer Overseer (id=72223029267660808-127.0.0.1:36839_solr-n_0000000000) starting [junit4] 2> 1490068 INFO (zkConnectionManagerCallback-4558-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490069 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490076 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36839_solr [junit4] 2> 1490077 INFO (zkCallback-4557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1490080 INFO (zkCallback-4550-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1490083 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1490084 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490086 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490086 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35327_solr [junit4] 2> 1490092 INFO (zkCallback-4557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1490092 INFO (zkCallback-4550-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1490092 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1490099 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490100 INFO (zkConnectionManagerCallback-4565-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490100 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 1490100 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490100 INFO (jetty-launcher-4526-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490104 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490104 INFO (zkConnectionManagerCallback-4569-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490109 INFO (zkConnectionManagerCallback-4571-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490111 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36839.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490112 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2) [junit4] 2> 1490112 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490113 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490113 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38335_solr [junit4] 2> 1490114 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35327.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490116 INFO (zkCallback-4550-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1490116 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1490116 INFO (zkCallback-4557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1490116 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1490117 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36839.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490117 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36839.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490117 INFO (zkCallback-4564-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3) [junit4] 2> 1490117 INFO (jetty-launcher-4526-thread-4) [n:127.0.0.1:36839_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node4/. [junit4] 2> 1490119 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35327.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490119 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35327.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490120 INFO (jetty-launcher-4526-thread-3) [n:127.0.0.1:35327_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node3/. [junit4] 2> 1490121 INFO (zkConnectionManagerCallback-4578-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490121 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 1490122 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490124 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490131 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38335.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490148 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38335.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490148 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38335.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490149 INFO (jetty-launcher-4526-thread-1) [n:127.0.0.1:38335_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node1/. [junit4] 2> 1490152 INFO (jetty-launcher-4526-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490153 INFO (zkConnectionManagerCallback-4583-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490154 INFO (zkConnectionManagerCallback-4585-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490156 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 1490157 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490158 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490158 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34135_solr [junit4] 2> 1490158 INFO (zkCallback-4550-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490158 INFO (zkCallback-4564-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490158 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490158 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490158 INFO (zkCallback-4557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490159 INFO (zkCallback-4577-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490159 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490167 INFO (zkConnectionManagerCallback-4592-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490168 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 1490168 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490168 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490176 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490181 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490181 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34135.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490181 INFO (jetty-launcher-4526-thread-2) [n:127.0.0.1:34135_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node2/. [junit4] 2> 1490203 INFO (zkConnectionManagerCallback-4595-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490205 INFO (zkConnectionManagerCallback-4600-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490205 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 1490206 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490208 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@761b92a{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 1490208 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1210722006 [junit4] 2> 1490208 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 1490208 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@dde39ee: rootName = solr_36839, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5d42086b [junit4] 2> 1490212 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 1490212 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@577883a1: rootName = solr_36839, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2b21ee53 [junit4] 2> 1490215 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 1490215 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3e36d7a3: rootName = solr_36839, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2c183ecb [junit4] 2> 1490216 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:36839_solr [junit4] 2> 1490217 INFO (zkCallback-4564-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (zkCallback-4557-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (zkCallback-4577-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (zkCallback-4591-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 1490217 INFO (zkCallback-4550-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490217 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490217 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.Overseer Overseer (id=72223029267660808-127.0.0.1:36839_solr-n_0000000000) closing [junit4] 2> 1490217 INFO (OverseerStateUpdate-72223029267660808-127.0.0.1:36839_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36839_solr [junit4] 2> 1490217 WARN (OverseerAutoScalingTriggerThread-72223029267660808-127.0.0.1:36839_solr-n_0000000000) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 1490219 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35327_solr [junit4] 2> 1490219 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3435f0fc{/solr,null,UNAVAILABLE} [junit4] 2> 1490219 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 1490219 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72223029267660806-127.0.0.1:35327_solr-n_0000000001) starting [junit4] 2> 1490220 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1490220 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1490220 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1490220 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@12272e7e{/solr,null,AVAILABLE} [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6e5f756c{SSL,[ssl, http/1.1]}{127.0.0.1:42579} [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server Started @1490250ms [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36035} [junit4] 2> 1490221 ERROR (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1490221 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:49.932967Z [junit4] 2> 1490225 INFO (zkConnectionManagerCallback-4602-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490225 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1490311 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490312 INFO (zkConnectionManagerCallback-4606-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490313 INFO (zkConnectionManagerCallback-4608-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490315 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 1490316 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490317 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490317 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36035_solr [junit4] 2> 1490318 INFO (zkCallback-4591-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490318 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490318 INFO (zkCallback-4577-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490318 INFO (zkCallback-4564-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490318 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490318 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490318 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490318 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490325 INFO (zkConnectionManagerCallback-4615-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490326 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 1490327 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490327 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490335 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36035.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490340 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36035.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490340 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36035.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490340 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:36035_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node4/. [junit4] 2> 1490364 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:42579/solr. Proxy: https://127.0.0.1:36035/solr [junit4] 2> 1490365 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@38761c62{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 1490365 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2076364319 [junit4] 2> 1490366 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 1490366 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@11a0ef99: rootName = solr_35327, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@570c7acc [junit4] 2> 1490370 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 1490370 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4e5ab4c5: rootName = solr_35327, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2b21ee53 [junit4] 2> 1490372 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 1490372 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c7b4d42: rootName = solr_35327, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2c183ecb [junit4] 2> 1490373 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:35327_solr [junit4] 2> 1490374 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 1490374 INFO (zkCallback-4591-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4577-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4564-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4542-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4614-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490374 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490375 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.Overseer Overseer (id=72223029267660806-127.0.0.1:35327_solr-n_0000000001) closing [junit4] 2> 1490375 INFO (OverseerStateUpdate-72223029267660806-127.0.0.1:35327_solr-n_0000000001) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35327_solr [junit4] 2> 1490375 WARN (OverseerAutoScalingTriggerThread-72223029267660806-127.0.0.1:35327_solr-n_0000000001) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 1490376 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38335_solr [junit4] 2> 1490377 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@58b960cb{/solr,null,UNAVAILABLE} [junit4] 2> 1490377 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 1490377 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72223029267660812-127.0.0.1:38335_solr-n_0000000002) starting [junit4] 2> 1490377 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1490378 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1490378 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1490378 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 1490378 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a483647{/solr,null,AVAILABLE} [junit4] 2> 1490378 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@44cb559f{SSL,[ssl, http/1.1]}{127.0.0.1:45449} [junit4] 2> 1490378 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server Started @1490408ms [junit4] 2> 1490378 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38353} [junit4] 2> 1490379 ERROR (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1490379 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1490379 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1490379 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1490379 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1490379 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:50.090318Z [junit4] 2> 1490380 INFO (zkConnectionManagerCallback-4618-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490380 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1490521 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490522 INFO (zkConnectionManagerCallback-4622-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490523 INFO (zkConnectionManagerCallback-4624-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490526 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 1490527 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490528 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490528 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38353_solr [junit4] 2> 1490528 INFO (zkCallback-4591-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490528 INFO (zkCallback-4614-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490528 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490528 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490528 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490528 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490528 INFO (zkCallback-4577-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490528 INFO (zkCallback-4623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490544 INFO (zkConnectionManagerCallback-4631-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490545 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 1490545 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490545 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490553 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38353.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490558 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38353.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490558 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38353.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490559 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:38353_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node3/. [junit4] 2> 1490581 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:45449/solr. Proxy: https://127.0.0.1:38353/solr [junit4] 2> 1490581 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@32060858{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 1490582 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=453154118 [junit4] 2> 1490582 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 1490582 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@690e8806: rootName = solr_38335, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@261fa29b [junit4] 2> 1490586 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 1490586 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1d6a138d: rootName = solr_38335, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2b21ee53 [junit4] 2> 1490589 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 1490589 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@291dab32: rootName = solr_38335, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2c183ecb [junit4] 2> 1490590 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38335_solr [junit4] 2> 1490590 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 1490590 INFO (zkCallback-4591-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490590 INFO (zkCallback-4614-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490590 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490591 INFO (zkCallback-4623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490591 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490591 INFO (zkCallback-4577-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490591 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490591 INFO (zkCallback-4570-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490591 INFO (zkCallback-4630-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490591 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.Overseer Overseer (id=72223029267660812-127.0.0.1:38335_solr-n_0000000002) closing [junit4] 2> 1490591 INFO (OverseerStateUpdate-72223029267660812-127.0.0.1:38335_solr-n_0000000002) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38335_solr [junit4] 2> 1490591 WARN (OverseerAutoScalingTriggerThread-72223029267660812-127.0.0.1:38335_solr-n_0000000002) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 1490593 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34135_solr [junit4] 2> 1490593 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5a731976{/solr,null,UNAVAILABLE} [junit4] 2> 1490593 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 1490593 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72223029267660815-127.0.0.1:34135_solr-n_0000000003) starting [junit4] 2> 1490594 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1490594 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1490594 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1490594 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 1490594 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7371436e{/solr,null,AVAILABLE} [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@158a3ffa{SSL,[ssl, http/1.1]}{127.0.0.1:41513} [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server Started @1490624ms [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35707} [junit4] 2> 1490595 ERROR (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1490595 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:50.306754Z [junit4] 2> 1490596 INFO (zkConnectionManagerCallback-4634-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490596 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1490646 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490647 INFO (zkConnectionManagerCallback-4638-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490649 INFO (zkConnectionManagerCallback-4640-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490652 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 1490653 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490655 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490655 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35707_solr [junit4] 2> 1490656 INFO (zkCallback-4591-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490656 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490656 INFO (zkCallback-4623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490656 INFO (zkCallback-4614-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490656 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490656 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490656 INFO (zkCallback-4630-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490656 INFO (zkCallback-4639-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490666 INFO (zkConnectionManagerCallback-4647-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490667 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 1490667 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490667 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490679 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35707.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490685 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35707.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490685 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35707.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490686 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:35707_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node1/. [junit4] 2> 1490708 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:41513/solr. Proxy: https://127.0.0.1:35707/solr [junit4] 2> 1490709 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5993e044{SSL,[ssl, http/1.1]}{127.0.0.1:0} [junit4] 2> 1490709 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=978871174 [junit4] 2> 1490709 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null [junit4] 2> 1490710 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@79bae270: rootName = solr_34135, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3ab9a46 [junit4] 2> 1490714 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null [junit4] 2> 1490714 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@41d524e3: rootName = solr_34135, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@2b21ee53 [junit4] 2> 1490716 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null [junit4] 2> 1490716 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@550023e4: rootName = solr_34135, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2c183ecb [junit4] 2> 1490718 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:34135_solr [junit4] 2> 1490719 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null [junit4] 2> 1490719 INFO (zkCallback-4591-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490719 INFO (zkCallback-4614-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490719 INFO (zkCallback-4584-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490719 INFO (zkCallback-4630-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490720 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490720 INFO (zkCallback-4639-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490719 INFO (zkCallback-4623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490719 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490720 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.Overseer Overseer (id=72223029267660815-127.0.0.1:34135_solr-n_0000000003) closing [junit4] 2> 1490720 INFO (zkCallback-4646-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3) [junit4] 2> 1490720 INFO (OverseerStateUpdate-72223029267660815-127.0.0.1:34135_solr-n_0000000003) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34135_solr [junit4] 2> 1490720 WARN (OverseerAutoScalingTriggerThread-72223029267660815-127.0.0.1:34135_solr-n_0000000003) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting. [junit4] 2> 1490722 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@e57e869{/solr,null,UNAVAILABLE} [junit4] 2> 1490722 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36035_solr [junit4] 2> 1490722 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 1490723 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72223029267660821-127.0.0.1:36035_solr-n_0000000004) starting [junit4] 2> 1490723 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server jetty-9.4.10.v20180503; built: 2018-05-03T15:56:21.710Z; git: daa59876e6f384329b122929e70a80934569428c; jvm 11-ea+14 [junit4] 2> 1490724 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 [junit4] 2> 1490724 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session No SessionScavenger set, using defaults [junit4] 2> 1490724 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.session node0 Scavenging every 600000ms [junit4] 2> 1490724 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@16fb1691{/solr,null,AVAILABLE} [junit4] 2> 1490724 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.AbstractConnector Started ServerConnector@385a014e{SSL,[ssl, http/1.1]}{127.0.0.1:35195} [junit4] 2> 1490724 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.e.j.s.Server Started @1490753ms [junit4] 2> 1490724 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=32915} [junit4] 2> 1490724 ERROR (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. [junit4] 2> 1490730 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory [junit4] 2> 1490730 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.4.0 [junit4] 2> 1490730 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null [junit4] 2> 1490730 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null [junit4] 2> 1490730 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-06-18T17:33:50.441662Z [junit4] 2> 1490731 INFO (zkConnectionManagerCallback-4650-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490731 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading... [junit4] 2> 1490903 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40957/solr [junit4] 2> 1490903 INFO (zkConnectionManagerCallback-4654-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490905 INFO (zkConnectionManagerCallback-4656-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490907 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3) [junit4] 2> 1490908 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1490909 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores [junit4] 2> 1490909 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32915_solr [junit4] 2> 1490910 INFO (zkCallback-4630-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490910 INFO (zkCallback-4614-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490910 INFO (zkCallback-4607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490910 INFO (zkCallback-4646-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490910 INFO (zkCallback-4599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490910 INFO (zkCallback-4623-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490910 INFO (zkCallback-4639-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490910 INFO (zkCallback-4655-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4) [junit4] 2> 1490921 INFO (zkConnectionManagerCallback-4663-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected [junit4] 2> 1490921 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4) [junit4] 2> 1490921 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40957/solr ready [junit4] 2> 1490922 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. [junit4] 2> 1490930 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32915.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490937 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32915.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490937 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_32915.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ce98828 [junit4] 2> 1490938 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [n:127.0.0.1:32915_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001/tempDir-001/node2/. [junit4] 2> 1490970 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.TestCloudConsistency Adding proxy for URL: https://127.0.0.1:35195/solr. Proxy: https://127.0.0.1:32915/solr [junit4] 2> 1490988 INFO (TEST-TestCloudConsistency.testOutOfSyncReplicasCannotBecomeLeaderAfterRestart-seed#[87DB00AB3F1B54B5]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOutOfSyncReplicasCannotBecomeLeaderAfterRestart [junit4] 2> 1490989 INFO (SocketProxy-Acceptor-32915) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=35576,localport=32915], receiveBufferSize:531000 [junit4] 2> 1490989 INFO (SocketProxy-Acceptor-32915) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35195,localport=54764], receiveBufferSize=530904 [junit4] 2> 1491038 INFO (qtp249739928-18659) [n:127.0.0.1:32915_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=3&name=outOfSyncReplicasCannotBecomeLeader-true&nrtReplicas=3&action=CREATE&numShards=1&tlogReplicas=0&createNodeSet=&wt=javabin&version=2 and sendToOCPQueue=true [junit4] 2> 1491040 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.a.c.CreateCollectionCmd Create collection outOfSyncReplicasCannotBecomeLeader-true [junit4] 2> 1491040 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/protwords.txt [junit4] 2> 1491041 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/managed-schema [junit4] 2> 1491041 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/solrconfig.xml [junit4] 2> 1491042 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/synonyms.txt [junit4] 2> 1491042 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/stopwords.txt [junit4] 2> 1491043 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/contractions_it.txt [junit4] 2> 1491044 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stemdict_nl.txt [junit4] 2> 1491044 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_hy.txt [junit4] 2> 1491045 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_no.txt [junit4] 2> 1491045 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/contractions_ca.txt [junit4] 2> 1491046 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_id.txt [junit4] 2> 1491046 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_ga.txt [junit4] 2> 1491046 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_hi.txt [junit4] 2> 1491047 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_da.txt [junit4] 2> 1491047 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_ja.txt [junit4] 2> 1491048 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_pt.txt [junit4] 2> 1491048 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_hu.txt [junit4] 2> 1491049 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_el.txt [junit4] 2> 1491050 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_ru.txt [junit4] 2> 1491050 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_tr.txt [junit4] 2> 1491051 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_ar.txt [junit4] 2> 1491051 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/userdict_ja.txt [junit4] 2> 1491052 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_eu.txt [junit4] 2> 1491052 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_it.txt [junit4] 2> 1491053 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_cz.txt [junit4] 2> 1491053 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stoptags_ja.txt [junit4] 2> 1491054 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/contractions_fr.txt [junit4] 2> 1491054 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_de.txt [junit4] 2> 1491055 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_fa.txt [junit4] 2> 1491055 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/contractions_ga.txt [junit4] 2> 1491056 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_ca.txt [junit4] 2> 1491056 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_nl.txt [junit4] 2> 1491057 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_bg.txt [junit4] 2> 1491057 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_lv.txt [junit4] 2> 1491058 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_en.txt [junit4] 2> 1491059 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_es.txt [junit4] 2> 1491059 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_th.txt [junit4] 2> 1491060 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_ro.txt [junit4] 2> 1491060 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_fr.txt [junit4] 2> 1491060 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_sv.txt [junit4] 2> 1491061 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/stopwords_fi.txt [junit4] 2> 1491061 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/lang/hyphenations_ga.txt [junit4] 2> 1491062 INFO (OverseerThreadFactory-6373-thread-1) [ ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt [...truncated too long message...] l,UNAVAILABLE} [junit4] 2> 1537810 INFO (jetty-closer-4527-thread-1) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 1540713 ERROR (recoveryExecutor-4670-thread-1-processing-n:127.0.0.1:38353_solr x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n63 c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node64) [n:127.0.0.1:38353_solr c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node64 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n63] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n63 [junit4] 2> 1540715 INFO (zkCallback-4689-thread-3) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35707_solr [junit4] 2> 1540715 INFO (jetty-closer-4527-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@735969cd{/solr,null,UNAVAILABLE} [junit4] 2> 1540716 INFO (jetty-closer-4527-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 1541146 ERROR (recoveryExecutor-4686-thread-1-processing-n:127.0.0.1:35707_solr x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n65 c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node66) [n:127.0.0.1:35707_solr c:outOfSyncReplicasCannotBecomeLeader-false s:shard1 r:core_node66 x:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n65] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:outOfSyncReplicasCannotBecomeLeader-false_shard1_replica_n65 [junit4] 2> 1541148 INFO (jetty-closer-4527-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e800978{/solr,null,UNAVAILABLE} [junit4] 2> 1541148 INFO (jetty-closer-4527-thread-3) [ ] o.e.j.s.session node0 Stopped scavenging [junit4] 2> 1541149 ERROR (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes [junit4] 2> 1541149 INFO (SUITE-TestCloudConsistency-seed#[87DB00AB3F1B54B5]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40957 40957 [junit4] 2> 1541931 INFO (Thread-5515) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40957 40957 [junit4] 2> 1541932 WARN (Thread-5515) [ ] o.a.s.c.ZkTestServer Watch limit violations: [junit4] 2> Maximum concurrent create/delete watches above limit: [junit4] 2> [junit4] 2> 45 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/terms/shard1 [junit4] 2> 27 /solr/collections/outOfSyncReplicasCannotBecomeLeader-false/terms/shard1 [junit4] 2> 25 /solr/aliases.json [junit4] 2> 12 /solr/security.json [junit4] 2> 6 /solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED [junit4] 2> 6 /solr/configs/outOfSyncReplicasCannotBecomeLeader-true.AUTOCREATED/managed-schema [junit4] 2> 4 /solr/configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED/managed-schema [junit4] 2> 4 /solr/configs/outOfSyncReplicasCannotBecomeLeader-false.AUTOCREATED [junit4] 2> [junit4] 2> Maximum concurrent data watches above limit: [junit4] 2> [junit4] 2> 31 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/state.json [junit4] 2> 30 /solr/collections/outOfSyncReplicasCannotBecomeLeader-false/state.json [junit4] 2> 25 /solr/clusterprops.json [junit4] 2> 25 /solr/clusterstate.json [junit4] 2> 6 /solr/autoscaling.json [junit4] 2> 3 /solr/overseer_elect/election/72223029267660821-127.0.0.1:36035_solr-n_0000000004 [junit4] 2> 2 /solr/overseer_elect/election/72223029267660841-127.0.0.1:35707_solr-n_0000000009 [junit4] 2> 2 /solr/collections/outOfSyncReplicasCannotBecomeLeader-true/leader_elect/shard1/election/72223029267660821-core_node62-n_0000000000 [junit4] 2> [junit4] 2> Maximum concurrent children watches above limit: [junit4] 2> [junit4] 2> 25 /solr/live_nodes [junit4] 2> 25 /solr/collections [junit4] 2> 6 /solr/overseer/queue [junit4] 2> 6 /solr/autoscaling/events/.scheduled_maintenance [junit4] 2> 6 /solr/autoscaling/events/.auto_add_replicas [junit4] 2> 6 /solr/overseer/queue-work [junit4] 2> 6 /solr/overseer/collection-queue-work [junit4] 2> [junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-7.4-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudConsistency_87DB00AB3F1B54B5-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1719, maxMBSortInHeap=5.378520323709236, sim=RandomSimilarity(queryNorm=true): {}, locale=bg, timezone=Africa/Niamey [junit4] 2> NOTE: Linux 4.13.0-41-generic amd64/Oracle Corporation 11-ea (64-bit)/cpus=8,threads=1,free=154534096,total=518979584 [junit4] 2> NOTE: All tests run in this JVM: [ImplicitSnitchTest, TestClassicSimilarityFactory, TestFileDictionaryLookup, VMParamsZkACLAndCredentialsProvidersTest, TestRequestForwarding, TestInitParams, TestInPlaceUpdatesDistrib, CircularListTest, TestLFUCache, SearchRateTriggerTest, ClassificationUpdateProcessorIntegrationTest, TestRealTimeGet, TestUseDocValuesAsStored, HdfsUnloadDistributedZkTest, ShufflingReplicaListTransformerTest, SchemaApiFailureTest, LeaderElectionTest, SimpleCollectionCreateDeleteTest, BadCopyFieldTest, OverseerStatusTest, IndexSchemaRuntimeFieldTest, TestClusterStateProvider, TestDistributedMap, V2ApiIntegrationTest, ConnectionManagerTest, TestTlogReplica, LeaderFailoverAfterPartitionTest, TestLeaderElectionWithEmptyReplica, MissingSegmentRecoveryTest, SolrCloudReportersTest, TestCloudDeleteByQuery, SolrMetricsIntegrationTest, TestFieldResource, DisMaxRequestHandlerTest, AtomicUpdateProcessorFactoryTest, TestDistribIDF, TestDocTermOrdsUninvertLimit, CheckHdfsIndexTest, ParsingFieldUpdateProcessorsTest, TestRangeQuery, CdcrReplicationHandlerTest, BJQParserTest, TestRandomDVFaceting, TestSchemaManager, NumericFieldsTest, TestNumericTerms64, DistributedQueueTest, SolrXmlInZkTest, MoveReplicaTest, TestBadConfig, PreAnalyzedFieldTest, ReturnFieldsTest, NodeMutatorTest, TemplateUpdateProcessorTest, TestSearcherReuse, TestSlowCompositeReaderWrapper, SearchHandlerTest, BlobRepositoryCloudTest, DocExpirationUpdateProcessorFactoryTest, TestLazyCores, TestCryptoKeys, ForceLeaderTest, UpdateLogTest, TestCodecSupport, TestImpersonationWithHadoopAuth, TestSubQueryTransformerDistrib, SolrCoreMetricManagerTest, PingRequestHandlerTest, TestSuggestSpellingConverter, TestJmxIntegration, MetricTriggerIntegrationTest, TestRequestStatusCollectionAPI, TestHashQParserPlugin, ResponseLogComponentTest, TestFastWriter, TestNestedDocsSort, TestSchemaVersionResource, SpellCheckCollatorWithCollapseTest, TestJavabinTupleStreamParser, TestSolrCoreProperties, TestAtomicUpdateErrorCases, HDFSCollectionsAPITest, RegexBoostProcessorTest, SolrTestCaseJ4Test, TestSolrCloudWithDelegationTokens, TestIntervalFaceting, TestSolrCLIRunExample, HdfsRecoverLeaseTest, TestCollectionAPIs, HdfsDirectoryTest, TestValueSourceCache, CopyFieldTest, DeleteReplicaTest, ConfigureRecoveryStrategyTest, TestShardHandlerFactory, AnalysisAfterCoreReloadTest, TestUpdate, TestFieldSortValues, TestRestoreCore, CollectionsAPISolrJTest, CollectionsAPIAsyncDistributedZkTest, TestPayloadScoreQParserPlugin, DocValuesTest, TestMaxScoreQueryParser, TestStressReorder, NumberUtilsTest, RegexBytesRefFilterTest, TestManagedStopFilterFactory, DistanceFunctionTest, TestStandardQParsers, URLClassifyProcessorTest, TestManagedSchemaAPI, TestQueryTypes, SmileWriterTest, TestPrepRecovery, TestObjectReleaseTracker, TestReRankQParserPlugin, TestDocBasedVersionConstraints, TestBackupRepositoryFactory, RecoveryAfterSoftCommitTest, TestLRUStatsCache, TestPerFieldSimilarityWithDefaultOverride, TestLMJelinekMercerSimilarityFactory, TestCloudRecovery, MinimalSchemaTest, TestRawTransformer, ReplaceNodeTest, ClusterStateUpdateTest, TestFieldCacheSort, TestConfigSetsAPI, RecoveryZkTest, LukeRequestHandlerTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, ConcurrentCreateRoutedAliasTest, CreateCollectionCleanupTest, CreateRoutedAliasTest, DeleteInactiveReplicaTest, DeleteShardTest, DistribCursorPagingTest, LegacyCloudClusterPropTest, MetricsHistoryIntegrationTest, MoveReplicaHDFSTest, PeerSyncReplicationTest, RemoteQueryErrorTest, SSLMigrationTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverTest, TestAuthenticationFramework, TestCloudConsistency] [junit4] Completed [463/818 (1!)] on J2 in 52.06s, 2 tests, 1 failure <<< FAILURES! [...truncated 45168 lines...] [repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-7.4-Linux/8/consoleText [repro] Revision: 3aa6086ed99fa7158d423dc7c33dae6da466b093 [repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" [repro] Repro line: ant test -Dtestcase=TestCloudConsistency -Dtests.method=testOutOfSyncReplicasCannotBecomeLeader -Dtests.seed=87DB00AB3F1B54B5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=bg -Dtests.timezone=Africa/Niamey -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [repro] ant clean [...truncated 6 lines...] [repro] Test suites by module: [repro] solr/core [repro] TestCloudConsistency [repro] ant compile-test [...truncated 3323 lines...] [repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5 -Dtests.class="*.TestCloudConsistency" -Dtests.showOutput=onerror "-Dargs=-XX:+UseCompressedOops -XX:+UseSerialGC" -Dtests.seed=87DB00AB3F1B54B5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=bg -Dtests.timezone=Africa/Niamey -Dtests.asserts=true -Dtests.file.encoding=UTF-8 [...truncated 81 lines...] [repro] Failures: [repro] 0/5 failed: org.apache.solr.cloud.TestCloudConsistency [repro] Exiting with code 0 [...truncated 40 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
