Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1761/
Java: 64bit/jdk-10 -XX:+UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED:
org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeLost/127.0.0.1:38385_solr exists
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeLost/127.0.0.1:38385_solr exists
at
__randomizedtesting.SeedInfo.seed([BE0B3C272B7D7794:A6B1B42B2548BA7B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at
org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest.testNodeMarkersRegistration(NodeMarkersRegistrationTest.java:120)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:564)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.base/java.lang.Thread.run(Thread.java:844)
Build Log:
[...truncated 14506 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest
[junit4] 2> Creating dataDir:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_BE0B3C272B7D7794-001/init-core-data-001
[junit4] 2> 1864407 INFO
(SUITE-NodeMarkersRegistrationTest-seed#[BE0B3C272B7D7794]-worker) [ ]
o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_BE0B3C272B7D7794-001/tempDir-001
[junit4] 2> 1864407 INFO
(SUITE-NodeMarkersRegistrationTest-seed#[BE0B3C272B7D7794]-worker) [ ]
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1864407 INFO (Thread-5059) [ ] o.a.s.c.ZkTestServer client
port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1864407 INFO (Thread-5059) [ ] o.a.s.c.ZkTestServer
Starting server
[junit4] 2> 1864408 ERROR (Thread-5059) [ ] o.a.z.s.ZooKeeperServer
ZKShutdownHandler is not registered, so ZooKeeper server won't take any action
on ERROR or SHUTDOWN server state changes
[junit4] 2> 1864507 INFO
(SUITE-NodeMarkersRegistrationTest-seed#[BE0B3C272B7D7794]-worker) [ ]
o.a.s.c.ZkTestServer start zk server on port:35201
[junit4] 2> 1864508 INFO (zkConnectionManagerCallback-9243-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864511 INFO (jetty-launcher-9240-thread-2) [ ]
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T07:57:37+10:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1864511 INFO (jetty-launcher-9240-thread-1) [ ]
o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T07:57:37+10:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-1) [ ]
o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-1) [ ]
o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@1d82d9c3{/solr,null,AVAILABLE}
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-1) [ ]
o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-1) [ ]
o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@8b31012{/solr,null,AVAILABLE}
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@50955bb1{SSL,[ssl,
http/1.1]}{127.0.0.1:38385}
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.e.j.s.Server Started @1864548ms
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=38385}
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-1) [ ]
o.e.j.s.AbstractConnector Started ServerConnector@7c6a60dc{SSL,[ssl,
http/1.1]}{127.0.0.1:36889}
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-1) [ ]
o.e.j.s.Server Started @1864549ms
[junit4] 2> 1864512 ERROR (jetty-launcher-9240-thread-2) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1864512 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=36889}
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.4.0
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-04-20T16:46:06.459048Z
[junit4] 2> 1864513 ERROR (jetty-launcher-9240-thread-1) [ ]
o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be
missing or incomplete.
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version
7.4.0
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-04-20T16:46:06.459180Z
[junit4] 2> 1864513 INFO (zkConnectionManagerCallback-9245-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864513 INFO (zkConnectionManagerCallback-9247-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1864513 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1864517 INFO (jetty-launcher-9240-thread-2) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35201/solr
[junit4] 2> 1864517 INFO (jetty-launcher-9240-thread-1) [ ]
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35201/solr
[junit4] 2> 1864518 INFO (zkConnectionManagerCallback-9255-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864518 INFO (zkConnectionManagerCallback-9254-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864519 INFO (zkConnectionManagerCallback-9258-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864519 INFO (zkConnectionManagerCallback-9259-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864554 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1864555 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.OverseerElectionContext I am going to be
the leader 127.0.0.1:38385_solr
[junit4] 2> 1864555 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.Overseer Overseer
(id=72172963076505606-127.0.0.1:38385_solr-n_0000000000) starting
[junit4] 2> 1864558 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1864559 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:36889_solr
[junit4] 2> 1864559 INFO (zkConnectionManagerCallback-9268-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864559 INFO (zkCallback-9257-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1864559 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (1)
[junit4] 2> 1864560 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster
at 127.0.0.1:35201/solr ready
[junit4] 2> 1864561 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating
transient cache for 2147483647 transient cores
[junit4] 2> 1864561 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:38385_solr
[junit4] 2> 1864561 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Adding .auto_add_replicas and
.scheduled_maintenance triggers
[junit4] 2> 1864561 INFO (zkCallback-9257-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1864561 INFO (zkCallback-9267-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1864562 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode
version 1
[junit4] 2> 1864562 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1,
lastZnodeVersion -1
[junit4] 2> 1864562 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto
znodeVersion 1
[junit4] 2> 1864563 INFO (zkCallback-9256-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1864564 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial
livenodes: [127.0.0.1:36889_solr, 127.0.0.1:38385_solr]
[junit4] 2> 1864564 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1864564 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1,
lastZnodeVersion 1
[junit4] 2> 1864564 DEBUG (ScheduledTrigger-9288-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 2
[junit4] 2> 1864702 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_38385.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864707 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_36889.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864710 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_38385.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864710 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_38385.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864711 INFO (jetty-launcher-9240-thread-2)
[n:127.0.0.1:38385_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_BE0B3C272B7D7794-001/tempDir-001/node2/.
[junit4] 2> 1864711 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_36889.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864711 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_36889.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864712 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_BE0B3C272B7D7794-001/tempDir-001/node1/.
[junit4] 2> 1864714 INFO (zkConnectionManagerCallback-9273-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864715 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (2)
[junit4] 2> 1864715 INFO (jetty-launcher-9240-thread-1)
[n:127.0.0.1:36889_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster
at 127.0.0.1:35201/solr ready
[junit4] 2> 1864747 INFO (zkConnectionManagerCallback-9275-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864750 INFO (zkConnectionManagerCallback-9280-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864750 INFO
(SUITE-NodeMarkersRegistrationTest-seed#[BE0B3C272B7D7794]-worker) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1864750 INFO
(SUITE-NodeMarkersRegistrationTest-seed#[BE0B3C272B7D7794]-worker) [ ]
o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35201/solr ready
[junit4] 2> 1864763 INFO (qtp1406690343-28907) [n:127.0.0.1:36889_solr
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 1864774 INFO (qtp2066173437-28911) [n:127.0.0.1:38385_solr
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics
params={prefix=CONTAINER.fs.usableSpace,CORE.coreName&wt=javabin&version=2&group=solr.node,solr.core}
status=0 QTime=0
[junit4] 2> 1864774 DEBUG (qtp1406690343-28918) [n:127.0.0.1:36889_solr
] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1864774 INFO (qtp1406690343-28918) [n:127.0.0.1:36889_solr
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling
params={wt=javabin&version=2} status=0 QTime=14
[junit4] 2> 1864775 DEBUG (zkCallback-9267-thread-1) [ ]
o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version
2
[junit4] 2> 1864776 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto
znodeVersion 2
[junit4] 2> 1864779 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1864779 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2,
lastZnodeVersion 2
[junit4] 2> 1864784 INFO (qtp1406690343-28920) [n:127.0.0.1:36889_solr
] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with
params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1864786 INFO (qtp1406690343-28920) [n:127.0.0.1:36889_solr
] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections
params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 1864787 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp:
2017-11-22T07:57:37+10:30, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1864788 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1864788 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1864788 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1864788 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.h.ContextHandler Started
o.e.j.s.ServletContextHandler@17d7dfbe{/solr,null,AVAILABLE}
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.AbstractConnector Started ServerConnector@7bf1d7fe{SSL,[ssl,
http/1.1]}{127.0.0.1:41753}
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.Server Started @1864825ms
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr,
hostPort=41753}
[junit4] 2> 1864789 ERROR
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging
may be missing or incomplete.
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.s.SolrDispatchFilter Using logger factory
org.apache.logging.slf4j.Log4jLoggerFactory
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™
version 7.4.0
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on
port null
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1864789 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time:
2018-04-20T16:46:06.735505Z
[junit4] 2> 1864790 INFO (zkConnectionManagerCallback-9282-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864790 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1864794 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35201/solr
[junit4] 2> 1864794 INFO (zkConnectionManagerCallback-9286-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864796 INFO (zkConnectionManagerCallback-9288-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864798 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (2)
[junit4] 2> 1864799 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1864800 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating
transient cache for 2147483647 transient cores
[junit4] 2> 1864800 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:41753_solr
[junit4] 2> 1864801 INFO (zkCallback-9267-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1864801 INFO (zkCallback-9257-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1864801 INFO (zkCallback-9272-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1864801 INFO (zkCallback-9279-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1864803 INFO (zkCallback-9256-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1864808 INFO (zkCallback-9287-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1864923 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_41753.solr.node' (registry 'solr.node') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864929 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_41753.solr.jvm' (registry 'solr.jvm') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864929 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for
'solr_41753.solr.jetty' (registry 'solr.jetty') enabled at server:
com.sun.jmx.mbeanserver.JmxMBeanServer@2ed611b9
[junit4] 2> 1864930 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.c.CorePropertiesLocator Found 0 core
definitions underneath
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_BE0B3C272B7D7794-001/tempDir-001/node3/.
[junit4] 2> 1864932 INFO (zkConnectionManagerCallback-9295-thread-1) [
] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1864933 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (0) -> (3)
[junit4] 2> 1864934 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[n:127.0.0.1:41753_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster
at 127.0.0.1:35201/solr ready
[junit4] 2> 1864954 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.a.NodeMarkersRegistrationTest ====== KILL OVERSEER 1
[junit4] 2> 1864955 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.AbstractConnector Stopped ServerConnector@50955bb1{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 1864955 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2011660752
[junit4] 2> 1864955 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.node, tag=null
[junit4] 2> 1864955 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@3802c645: rootName =
solr_38385, domain = solr.node, service url = null, agent id = null] for
registry solr.node / com.codahale.metrics.MetricRegistry@29c5e35c
[junit4] 2> 1864962 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.jvm, tag=null
[junit4] 2> 1864962 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@6eb13709: rootName =
solr_38385, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@61691e42
[junit4] 2> 1864967 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.jetty, tag=null
[junit4] 2> 1864967 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@449812b6: rootName =
solr_38385, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@39208d54
[junit4] 2> 1864969 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:38385_solr
[junit4] 2> 1864969 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.m.SolrMetricManager Closing metric reporters for
registry=solr.cluster, tag=null
[junit4] 2> 1864969 INFO (zkCallback-9272-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1864969 INFO (zkCallback-9279-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1864969 INFO (zkCallback-9256-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1864969 INFO (zkCallback-9267-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1864969 INFO (zkCallback-9257-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1864970 INFO (zkCallback-9294-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1864970 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.Overseer Overseer
(id=72172963076505606-127.0.0.1:38385_solr-n_0000000000) closing
[junit4] 2> 1864970 INFO
(OverseerStateUpdate-72172963076505606-127.0.0.1:38385_solr-n_0000000000) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38385_solr
[junit4] 2> 1864970 WARN
(OverseerAutoScalingTriggerThread-72172963076505606-127.0.0.1:38385_solr-n_0000000000)
[ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we
are closed, exiting.
[junit4] 2> 1864970 DEBUG
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool
executor now
[junit4] 2> 1864970 DEBUG
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 1864970 DEBUG
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 1864970 DEBUG
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread
pool executor
[junit4] 2> 1864971 DEBUG
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 1864971 DEBUG
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed
explicitly
[junit4] 2> 1864971 INFO (zkCallback-9256-thread-1) [ ]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36889_solr
[junit4] 2> 1864971 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@1d82d9c3{/solr,null,UNAVAILABLE}
[junit4] 2> 1864971 INFO
(TEST-NodeMarkersRegistrationTest.testNodeMarkersRegistration-seed#[BE0B3C272B7D7794])
[ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 1864972 INFO (zkCallback-9256-thread-1) [ ]
o.a.s.c.Overseer Overseer
(id=72172963076505605-127.0.0.1:36889_solr-n_0000000001) starting
[junit4] 2> 1864973 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode
version 2
[junit4] 2> 1864974 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2,
lastZnodeVersion -1
[junit4] 2> 1864974 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto
znodeVersion 2
[junit4] 2> 1864974 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger .auto_add_replicas - Initial
livenodes: [127.0.0.1:36889_solr, 127.0.0.1:41753_solr]
[junit4] 2> 1864974 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.NodeLostTrigger Adding lost node from marker path:
127.0.0.1:38385_solr
[junit4] 2> 1864974 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1864974 DEBUG
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2,
lastZnodeVersion 2
[junit4] 2> 1864974 DEBUG (ScheduledTrigger-9303-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 2
[junit4] 2> 1864974 DEBUG (ScheduledTrigger-9303-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:38385_solr
[junit4] 2> 1864975 INFO (zkCallback-9287-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1865975 DEBUG (ScheduledTrigger-9303-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 2
[junit4] 2> 1866975 DEBUG (ScheduledTrigger-9303-thread-2) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 2
[junit4] 2> 1867976 DEBUG (ScheduledTrigger-9303-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 2
[junit4] 2> 1868976 DEBUG (ScheduledTrigger-9303-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 2
[junit4] 2> NOTE: reproduce with: ant test
-Dtestcase=NodeMarkersRegistrationTest
-Dtests.method=testNodeMarkersRegistration -Dtests.seed=BE0B3C272B7D7794
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ha-NE
-Dtests.timezone=America/Lower_Princes -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
[junit4] FAILURE 5.20s J2 |
NodeMarkersRegistrationTest.testNodeMarkersRegistration <<<
[junit4] > Throwable #1: java.lang.AssertionError: Path
/autoscaling/nodeLost/127.0.0.1:38385_solr exists
[junit4] > at
__randomizedtesting.SeedInfo.seed([BE0B3C272B7D7794:A6B1B42B2548BA7B]:0)
[junit4] > at
org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest.testNodeMarkersRegistration(NodeMarkersRegistrationTest.java:120)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] > at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[junit4] > at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] > at
java.base/java.lang.reflect.Method.invoke(Method.java:564)
[junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[junit4] 2> 1869975 INFO (jetty-closer-9241-thread-2) [ ]
o.e.j.s.AbstractConnector Stopped ServerConnector@7bf1d7fe{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 1869975 INFO (jetty-closer-9241-thread-1) [ ]
o.e.j.s.AbstractConnector Stopped ServerConnector@7c6a60dc{SSL,[ssl,
http/1.1]}{127.0.0.1:0}
[junit4] 2> 1869975 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1514343074
[junit4] 2> 1869975 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node,
tag=null
[junit4] 2> 1869975 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@671fca12: rootName =
solr_36889, domain = solr.node, service url = null, agent id = null] for
registry solr.node / com.codahale.metrics.MetricRegistry@44caac77
[junit4] 2> 1869975 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.c.CoreContainer Shutting down CoreContainer instance=1292326434
[junit4] 2> 1869975 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node,
tag=null
[junit4] 2> 1869976 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@692775e9: rootName =
solr_41753, domain = solr.node, service url = null, agent id = null] for
registry solr.node / com.codahale.metrics.MetricRegistry@297389d3
[junit4] 2> 1869976 DEBUG (ScheduledTrigger-9303-thread-1) [ ]
o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with
currently live nodes: 2
[junit4] 2> 1869980 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm,
tag=null
[junit4] 2> 1869980 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@60d04e6c: rootName =
solr_36889, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@61691e42
[junit4] 2> 1869981 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm,
tag=null
[junit4] 2> 1869981 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@15cda2b8: rootName =
solr_41753, domain = solr.jvm, service url = null, agent id = null] for
registry solr.jvm / com.codahale.metrics.MetricRegistry@61691e42
[junit4] 2> 1869983 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 1869983 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@26d83ebc: rootName =
solr_41753, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@39208d54
[junit4] 2> 1869984 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty,
tag=null
[junit4] 2> 1869984 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.m.r.SolrJmxReporter Closing reporter
[org.apache.solr.metrics.reporters.SolrJmxReporter@2af23bbe: rootName =
solr_36889, domain = solr.jetty, service url = null, agent id = null] for
registry solr.jetty / com.codahale.metrics.MetricRegistry@39208d54
[junit4] 2> 1869984 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:41753_solr
[junit4] 2> 1869985 INFO (jetty-closer-9241-thread-2) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 1869985 INFO (zkCallback-9272-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1869985 INFO (zkCallback-9294-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1869985 INFO (zkCallback-9287-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1869985 INFO (zkCallback-9256-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1869985 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.c.ZkController Remove node as live in
ZooKeeper:/live_nodes/127.0.0.1:36889_solr
[junit4] 2> 1869986 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster,
tag=null
[junit4] 2> 1869986 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647
transient cores
[junit4] 2> 1869986 INFO (zkCallback-9272-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1869986 INFO (zkCallback-9256-thread-1) [ ]
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 1869986 INFO (jetty-closer-9241-thread-2) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@17d7dfbe{/solr,null,UNAVAILABLE}
[junit4] 2> 1869986 INFO (jetty-closer-9241-thread-1) [ ]
o.a.s.c.Overseer Overseer
(id=72172963076505605-127.0.0.1:36889_solr-n_0000000001) closing
[junit4] 2> 1869986 INFO (jetty-closer-9241-thread-2) [ ]
o.e.j.s.session Stopped scavenging
[junit4] 2> 1869986 INFO
(OverseerStateUpdate-72172963076505605-127.0.0.1:36889_solr-n_0000000001) [
] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:36889_solr
[junit4] 2> 1869986 WARN
(OverseerAutoScalingTriggerThread-72172963076505605-127.0.0.1:36889_solr-n_0000000001)
[ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we
are closed, exiting.
[junit4] 2> 1869986 DEBUG (jetty-closer-9241-thread-1) [ ]
o.a.s.c.a.ScheduledTriggers Shutting down scheduled thread pool executor now
[junit4] 2> 1869987 DEBUG (jetty-closer-9241-thread-1) [ ]
o.a.s.c.a.ScheduledTriggers Shutting down action executor now
[junit4] 2> 1869987 DEBUG (jetty-closer-9241-thread-1) [ ]
o.a.s.c.a.ScheduledTriggers Awaiting termination for action executor
[junit4] 2> 1869987 DEBUG (jetty-closer-9241-thread-1) [ ]
o.a.s.c.a.ScheduledTriggers Awaiting termination for scheduled thread pool
executor
[junit4] 2> 1869987 DEBUG (jetty-closer-9241-thread-1) [ ]
o.a.s.c.a.ScheduledTriggers ScheduledTriggers closed completely
[junit4] 2> 1869987 DEBUG (jetty-closer-9241-thread-1) [ ]
o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1869987 INFO (jetty-closer-9241-thread-1) [ ]
o.e.j.s.h.ContextHandler Stopped
o.e.j.s.ServletContextHandler@8b31012{/solr,null,UNAVAILABLE}
[junit4] 2> 1869987 INFO (jetty-closer-9241-thread-1) [ ]
o.e.j.s.session Stopped scavenging
[junit4] 2> 1869988 ERROR
(SUITE-NodeMarkersRegistrationTest-seed#[BE0B3C272B7D7794]-worker) [ ]
o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper
server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1869988 INFO
(SUITE-NodeMarkersRegistrationTest-seed#[BE0B3C272B7D7794]-worker) [ ]
o.a.s.c.ZkTestServer connecting to 127.0.0.1:35201 35201
[junit4] 2> 1870765 INFO (Thread-5059) [ ] o.a.s.c.ZkTestServer
connecting to 127.0.0.1:35201 35201
[junit4] 2> 1870766 WARN (Thread-5059) [ ] o.a.s.c.ZkTestServer Watch
limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 3 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at:
/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.NodeMarkersRegistrationTest_BE0B3C272B7D7794-001
[junit4] 2> NOTE: test params are:
codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY,
chunkSize=9, maxDocsPerChunk=5, blockSize=577),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY,
chunkSize=9, blockSize=577)), sim=RandomSimilarity(queryNorm=true): {},
locale=ha-NE, timezone=America/Lower_Princes
[junit4] 2> NOTE: Linux 4.13.0-37-generic amd64/Oracle Corporation 10
(64-bit)/cpus=8,threads=1,free=137027320,total=524288000
[junit4] 2> NOTE: All tests run in this JVM: [NumericFieldsTest,
TestConfigSetProperties, EnumFieldTest, TestPKIAuthenticationPlugin,
MoveReplicaHDFSTest, TestSortByMinMaxFunction, TestCustomStream,
TestSchemaManager, TestReplicationHandlerBackup,
TestMultiValuedNumericRangeQuery, SpatialFilterTest, TestUtilizeNode,
TestJettySolrRunner, SchemaApiFailureTest, RecoveryZkTest,
BasicDistributedZk2Test, SearchRateTriggerTest,
TestComplexPhraseLeadingWildcard, TestCollationFieldDocValues,
DistributedExpandComponentTest, ClusterStateUpdateTest, BufferStoreTest,
HdfsSyncSliceTest, VMParamsZkACLAndCredentialsProvidersTest,
TestAnalyzedSuggestions, TestDefaultStatsCache, MigrateRouteKeyTest,
TestInPlaceUpdatesDistrib, LargeFieldTest, TestRequestForwarding,
MultiTermTest, AnalyticsQueryTest, TestSimDistributedQueue,
TestImplicitCoreProperties, DistributedSpellCheckComponentTest,
HdfsUnloadDistributedZkTest, DistributedFacetPivotLongTailTest,
TestCloudConsistency, TestTrackingShardHandlerFactory, BasicAuthStandaloneTest,
TestBlendedInfixSuggestions, LIRRollingUpdatesTest, TestBadConfig,
TestDocTermOrds, MetricTriggerIntegrationTest, CoreAdminHandlerTest,
SolrTestCaseJ4Test, TestHighFrequencyDictionaryFactory, TestDistributedMap,
TestDynamicFieldCollectionResource, TestNumericTokenStream, TestRestManager,
AssignTest, V2StandaloneTest, TestSolrConfigHandlerConcurrent,
TestQuerySenderListener, BlockJoinFacetRandomTest,
ScheduledTriggerIntegrationTest, RestartWhileUpdatingTest,
TestNonDefinedSimilarityFactory, AutoScalingHandlerTest,
AsyncCallRequestStatusResponseTest, TestMacroExpander, CoreAdminOperationTest,
TimeZoneUtilsTest, ConfigureRecoveryStrategyTest,
WrapperMergePolicyFactoryTest, TestUseDocValuesAsStored, InfoHandlerTest,
TestSubQueryTransformerDistrib, TestPayloadScoreQParserPlugin,
TestCodecSupport, TestSolrCoreProperties,
DistribDocExpirationUpdateProcessorTest, SolrSlf4jReporterTest,
TestJsonFacetsWithNestedObjects, TestSolrDeletionPolicy2,
LeaderElectionIntegrationTest, TestFieldSortValues, NotRequiredUniqueKeyTest,
TestObjectReleaseTracker, TestBackupRepositoryFactory, ConvertedLegacyTest,
ReplaceNodeNoTargetTest, TestScoreJoinQPScore,
TestLeaderElectionWithEmptyReplica, SolrCloudExampleTest, TestRangeQuery,
CollectionsAPIAsyncDistributedZkTest, ReplicaListTransformerTest,
AnalysisAfterCoreReloadTest, TestExpandComponent,
TestDocBasedVersionConstraints, TestBulkSchemaConcurrent, ClusterStateTest,
SolrGraphiteReporterTest, BitVectorTest, AtomicUpdatesTest,
RegexBytesRefFilterTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest,
DistributedFacetSimpleRefinementLongTailTest, CustomCollectionTest,
TestLFUCache, PreAnalyzedFieldTest, TestSolrCloudSnapshots, TestLockTree,
MetricsConfigTest, TestSchemaVersionResource, TestNoOpRegenerator,
TestChildDocTransformer, NodeAddedTriggerTest, TestSolrFieldCacheBean,
SimpleMLTQParserTest, CurrencyFieldTypeTest,
OverriddenZkACLAndCredentialsProvidersTest, TestConfigSetsAPI, MetricUtilsTest,
SuggesterTSTTest, TriggerCooldownIntegrationTest, MinimalSchemaTest,
TestSolrCloudWithDelegationTokens, TestSmileRequest, URLClassifyProcessorTest,
TestCoreDiscovery, TestFieldCacheVsDocValues,
TimeRoutedAliasUpdateProcessorTest, TestManagedSchemaAPI,
ConcurrentCreateRoutedAliasTest, TestHdfsCloudBackupRestore,
TestGroupingSearch, PeerSyncTest, BasicFunctionalityTest, TestLazyCores,
ShowFileRequestHandlerTest, SolrIndexSplitterTest, TestExtendedDismaxParser,
SuggesterFSTTest, TestFoldingMultitermQuery, DocValuesTest, TestTrie,
PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest,
SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest,
TestPseudoReturnFields, TestUpdate, TestAtomicUpdateErrorCases,
TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest,
DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest,
SortByFunctionTest, DocValuesMultiTest, DistanceFunctionTest,
XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest,
LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils,
DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestQueryTypes,
FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest,
RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache,
PathHierarchyTokenizerFactoryTest, TermVectorComponentTest,
TestIndexingPerformance, MoreLikeThisHandlerTest, IndexSchemaRuntimeFieldTest,
LoggingHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest,
IndexSchemaTest, TestJmxIntegration, TestCollationField, ReturnFieldsTest,
UpdateRequestProcessorFactoryTest, MBeansHandlerTest,
UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest,
TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter,
PingRequestHandlerTest, SearchHandlerTest, HighlighterConfigTest, SOLR749Test,
UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig,
TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest,
BadComponentTest, TestStressRecovery, TestMergePolicyConfig,
TestElisionMultitermQuery, TestConfig, OutputWriterTest,
TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter,
DirectSolrConnectionTest, SpellPossibilityIteratorTest, TestCharFilters,
TestDFRSimilarityFactory, TestPerFieldSimilarity,
TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory,
TestIBSimilarityFactory, TestFastWriter, TestFastOutputStream,
TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest,
PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest,
TestUtils, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest,
FileUtilsTest, CircularListTest, DistributedMLTComponentTest,
TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestTolerantSearch,
TestLuceneIndexBackCompat, CollectionPropsTest, ConfigSetsAPITest,
CreateCollectionCleanupTest, DeleteLastCustomShardedReplicaTest,
DeleteNodeTest, DeleteReplicaTest, HttpPartitionTest,
LeaderFailureAfterFreshStartTest, SSLMigrationTest, SaslZkACLProviderTest,
SolrXmlInZkTest, TestAuthenticationFramework, TestCloudDeleteByQuery,
TestCloudPseudoReturnFields, TestCloudRecovery, TestConfigSetsAPIZkFailure,
TestCryptoKeys, TestExclusionRuleCollectionAccess,
TestLeaderInitiatedRecoveryThread, TestPrepRecovery, TestPullReplica,
TestSSLRandomization, TestSegmentSorting, TestShortCircuitedRequests,
TestSizeLimitedDistributedMap, TestSkipOverseerOperations,
TestStressInPlaceUpdates, TestStressLiveNodes, ZkShardTermsTest,
CollectionReloadTest, ConcurrentDeleteAndCreateCollectionTest,
HdfsCollectionsAPIDistributedZkTest, ShardSplitTest,
SimpleCollectionCreateDeleteTest, AutoAddReplicasIntegrationTest,
ExecutePlanActionTest, NodeLostTriggerIntegrationTest,
NodeMarkersRegistrationTest]
[junit4] Completed [578/802 (1!)] on J2 in 6.37s, 1 test, 1 failure <<<
FAILURES!
[...truncated 44511 lines...]
[repro] Jenkins log URL:
https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1761/consoleText
[repro] Revision: 8c9b00a7a0ae631dfef741efde6bd696a30b80f4
[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
[repro] Repro line: ant test -Dtestcase=NodeMarkersRegistrationTest
-Dtests.method=testNodeMarkersRegistration -Dtests.seed=BE0B3C272B7D7794
-Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ha-NE
-Dtests.timezone=America/Lower_Princes -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
[repro] ant clean
[...truncated 6 lines...]
[repro] Test suites by module:
[repro] solr/core
[repro] NodeMarkersRegistrationTest
[repro] ant compile-test
[...truncated 3321 lines...]
[repro] ant test-nocompile -Dtests.dups=5 -Dtests.maxfailures=5
-Dtests.class="*.NodeMarkersRegistrationTest" -Dtests.showOutput=onerror
"-Dargs=-XX:+UseCompressedOops -XX:+UseParallelGC"
-Dtests.seed=BE0B3C272B7D7794 -Dtests.multiplier=3 -Dtests.slow=true
-Dtests.locale=ha-NE -Dtests.timezone=America/Lower_Princes
-Dtests.asserts=true -Dtests.file.encoding=UTF-8
[...truncated 76 lines...]
[repro] Failures:
[repro] 0/5 failed:
org.apache.solr.cloud.autoscaling.NodeMarkersRegistrationTest
[repro] Exiting with code 0
[...truncated 40 lines...]
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
