Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5406/
2 tests failed.
FAILED:
org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
Error Message:
java.lang.Exception: Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([541459EE55893D9C]:0)
FAILED: org.apache.solr.cloud.LeaderElectionIntegrationTest.classMethod
Error Message:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([541459EE55893D9C]:0)
Build Log:
[...truncated 1294 lines...]
# ERROR: Solr is still running at http://localhost:7574/solr after 5 seconds
#
# Please find the SOLR_HOME snapshot for failed test #2 at:
/tmp/src/solr/solr/packaging/build/test-output/failure-snapshots/62-2
# Last output:
#
# Found 2 Solr nodes running! Must either specify a port using -p or -all to
stop all Solr nodes on this host.
ok 63 status detects locally running solr in 14670ms
ok 64 status does not expose cli parameters to end user in 209ms
ok 65 listing out files in 2183ms
ok 66 copying files around in 6625ms
ok 67 upconfig in 2614ms
ok 68 zkcli.sh gets 'solrhome' from 'solr.home' system property in 1228ms
ok 69 zkcli.sh gets 'solrhome' from 'solrhome' command line option in 1242ms
> Task :solr:packaging:integrationTests FAILED
> Task :solr:core:test
org.apache.solr.cloud.LeaderElectionIntegrationTest >
testSimpleSliceLeaderElection FAILED
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([541459EE55893D9C]:0)
org.apache.solr.cloud.LeaderElectionIntegrationTest > classMethod FAILED
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([541459EE55893D9C]:0)
org.apache.solr.cloud.LeaderElectionIntegrationTest > test suite's output saved
to
/tmp/src/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.LeaderElectionIntegrationTest.txt,
copied below:
2> 18583 INFO
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to
test-framework derived value of
'/tmp/src/solr/solr/server/solr/configsets/_default/conf'
2> 18583 INFO
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks:
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
2> 18584 INFO
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-5 after mutting 0 log messages
2> 18585 INFO
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-6 for ERROR logs matching
regex: ignore_exception
2> 18586 INFO
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.SolrTestCaseJ4 Created dataDir:
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/data-dir-2-001
2> 18587 WARN
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=39 numCloses=39
2> 18587 INFO
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true)
w/NUMERIC_DOCVALUES_SYSPROP=true
2> 18589 INFO
(SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]-worker) []
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via:
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0,
clientAuth=0.0/0.0)
2> 18599 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.SolrTestCaseJ4 ###Starting testSimpleSliceLeaderElection
2> 18605 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.u.t.SimplePropagator Always-on trace id generation enabled.
2> 18605 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.MiniSolrCloudCluster Starting cluster of 6 servers in
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001
2> 18614 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
2> 18622 INFO (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer client port:
0.0.0.0/0.0.0.0:0
2> 18622 INFO (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer Starting
server
2> 19154 WARN (ZkTestServer Run Thread) [] o.a.z.s.ServerCnxnFactory
maxCnxns is not configured, using default value 0.
2> 19193 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.ZkTestServer start zk server on port: 40701
2> 19547 WARN
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector.
ZkCredentialsInjector is not secure, it creates an empty list of credentials
which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 19621 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to
ZooKeeper
2> 19698 INFO (zkConnectionManagerCallback-23-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 19699 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 19699 WARN
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is
not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 19726 WARN
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector.
ZkCredentialsInjector is not secure, it creates an empty list of credentials
which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 19748 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to
ZooKeeper
2> 19757 INFO (zkConnectionManagerCallback-25-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 19759 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 19759 WARN
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is
not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 19759 WARN
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector.
ZkCredentialsInjector is not secure, it creates an empty list of credentials
which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 19790 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to
ZooKeeper
2> 19800 INFO (zkConnectionManagerCallback-27-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 19800 INFO
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 19801 WARN
(TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C])
[] o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is
not secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 20133 INFO (jetty-launcher-28-thread-4) [] o.a.s.e.JettySolrRunner Start
Jetty (configured port=0, binding port=0)
2> 20134 INFO (jetty-launcher-28-thread-2) [] o.a.s.e.JettySolrRunner Start
Jetty (configured port=0, binding port=0)
2> 20134 INFO (jetty-launcher-28-thread-5) [] o.a.s.e.JettySolrRunner Start
Jetty (configured port=0, binding port=0)
2> 20134 INFO (jetty-launcher-28-thread-1) [] o.a.s.e.JettySolrRunner Start
Jetty (configured port=0, binding port=0)
2> 20134 INFO (jetty-launcher-28-thread-1) [] o.a.s.e.JettySolrRunner Trying
to start Jetty on port 0 try number 2 ...
2> 20135 INFO (jetty-launcher-28-thread-3) [] o.a.s.e.JettySolrRunner Start
Jetty (configured port=0, binding port=0)
2> 20134 INFO (jetty-launcher-28-thread-5) [] o.a.s.e.JettySolrRunner Trying
to start Jetty on port 0 try number 2 ...
2> 20134 INFO (jetty-launcher-28-thread-6) [] o.a.s.e.JettySolrRunner Start
Jetty (configured port=0, binding port=0)
2> 20135 INFO (jetty-launcher-28-thread-3) [] o.a.s.e.JettySolrRunner Trying
to start Jetty on port 0 try number 2 ...
2> 20135 INFO (jetty-launcher-28-thread-2) [] o.a.s.e.JettySolrRunner Trying
to start Jetty on port 0 try number 2 ...
2> 20135 INFO (jetty-launcher-28-thread-6) [] o.a.s.e.JettySolrRunner Trying
to start Jetty on port 0 try number 2 ...
2> 20135 INFO (jetty-launcher-28-thread-4) [] o.a.s.e.JettySolrRunner Trying
to start Jetty on port 0 try number 2 ...
2> 20143 INFO (jetty-launcher-28-thread-4) [] o.e.j.s.Server jetty-10.0.16;
built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4;
jvm 11.0.16+8
2> 20143 INFO (jetty-launcher-28-thread-2) [] o.e.j.s.Server jetty-10.0.16;
built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4;
jvm 11.0.16+8
2> 20143 INFO (jetty-launcher-28-thread-5) [] o.e.j.s.Server jetty-10.0.16;
built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4;
jvm 11.0.16+8
2> 20143 INFO (jetty-launcher-28-thread-6) [] o.e.j.s.Server jetty-10.0.16;
built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4;
jvm 11.0.16+8
2> 20143 INFO (jetty-launcher-28-thread-3) [] o.e.j.s.Server jetty-10.0.16;
built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4;
jvm 11.0.16+8
2> 20146 INFO (jetty-launcher-28-thread-1) [] o.e.j.s.Server jetty-10.0.16;
built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4;
jvm 11.0.16+8
2> 20271 INFO (jetty-launcher-28-thread-5) []
o.e.j.s.s.DefaultSessionIdManager Session workerName=node0
2> 20275 INFO (jetty-launcher-28-thread-6) []
o.e.j.s.s.DefaultSessionIdManager Session workerName=node0
2> 20343 INFO (jetty-launcher-28-thread-1) []
o.e.j.s.s.DefaultSessionIdManager Session workerName=node0
2> 20376 INFO (jetty-launcher-28-thread-3) []
o.e.j.s.s.DefaultSessionIdManager Session workerName=node0
2> 20385 INFO (jetty-launcher-28-thread-1) [] o.e.j.s.h.ContextHandler
Started
o.e.j.s.ServletContextHandler@1061974f{/solr,file:///tmp/src/solr/solr/core/build/tmp/tests-cwd/,AVAILABLE}
2> 20385 INFO (jetty-launcher-28-thread-6) [] o.e.j.s.h.ContextHandler
Started
o.e.j.s.ServletContextHandler@43745fc5{/solr,file:///tmp/src/solr/solr/core/build/tmp/tests-cwd/,AVAILABLE}
2> 20385 INFO (jetty-launcher-28-thread-5) [] o.e.j.s.h.ContextHandler
Started
o.e.j.s.ServletContextHandler@17a82e31{/solr,file:///tmp/src/solr/solr/core/build/tmp/tests-cwd/,AVAILABLE}
2> 20387 INFO (jetty-launcher-28-thread-3) [] o.e.j.s.h.ContextHandler
Started
o.e.j.s.ServletContextHandler@383dd554{/solr,file:///tmp/src/solr/solr/core/build/tmp/tests-cwd/,AVAILABLE}
2> 20392 INFO (jetty-launcher-28-thread-6) [] o.e.j.s.AbstractConnector
Started ServerConnector@19047ebf{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:٣٤١٦٧}
2> 20392 INFO (jetty-launcher-28-thread-1) [] o.e.j.s.AbstractConnector
Started ServerConnector@5e4c352e{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:٤٦١١٩}
2> 20394 INFO (jetty-launcher-28-thread-5) [] o.e.j.s.AbstractConnector
Started ServerConnector@1146eb78{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:٤٢٤٩٩}
2> 20396 INFO (jetty-launcher-28-thread-3) [] o.e.j.s.AbstractConnector
Started ServerConnector@19118ba2{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:٣٧٣٥٣}
2> 20396 INFO (jetty-launcher-28-thread-6) [] o.e.j.s.Server Started
Server@7b2f5907{STARTING}[10.0.16,sto=٠] @٢٠٤١٥ms
2> 20396 INFO (jetty-launcher-28-thread-5) [] o.e.j.s.Server Started
Server@3cf890d6{STARTING}[10.0.16,sto=٠] @٢٠٤١٥ms
2> 20396 INFO (jetty-launcher-28-thread-1) [] o.e.j.s.Server Started
Server@2ee61e62{STARTING}[10.0.16,sto=٠] @٢٠٤١٥ms
2> 20396 INFO (jetty-launcher-28-thread-3) [] o.e.j.s.Server Started
Server@5ed83771{STARTING}[10.0.16,sto=٠] @٢٠٤١٥ms
2> 20399 INFO (jetty-launcher-28-thread-4) []
o.e.j.s.s.DefaultSessionIdManager Session workerName=node0
2> 20401 INFO (jetty-launcher-28-thread-4) [] o.e.j.s.h.ContextHandler
Started
o.e.j.s.ServletContextHandler@1be1b564{/solr,file:///tmp/src/solr/solr/core/build/tmp/tests-cwd/,AVAILABLE}
2> 20402 INFO (jetty-launcher-28-thread-4) [] o.e.j.s.AbstractConnector
Started ServerConnector@494d611d{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:٣٩٩٣٣}
2> 20403 INFO (jetty-launcher-28-thread-4) [] o.e.j.s.Server Started
Server@441f15ff{STARTING}[10.0.16,sto=٠] @٢٠٤٢٢ms
2> 20411 ERROR (jetty-launcher-28-thread-5) [] o.a.s.u.StartupLoggingUtils
Missing Java Option solr.log.dir. Logging may be missing or incomplete.
2> 20411 ERROR (jetty-launcher-28-thread-3) [] o.a.s.u.StartupLoggingUtils
Missing Java Option solr.log.dir. Logging may be missing or incomplete.
2> 20411 ERROR (jetty-launcher-28-thread-6) [] o.a.s.u.StartupLoggingUtils
Missing Java Option solr.log.dir. Logging may be missing or incomplete.
2> 20411 ERROR (jetty-launcher-28-thread-4) [] o.a.s.u.StartupLoggingUtils
Missing Java Option solr.log.dir. Logging may be missing or incomplete.
2> 20413 INFO (jetty-launcher-28-thread-5) [] o.a.s.s.CoreContainerProvider
Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 20413 INFO (jetty-launcher-28-thread-4) [] o.a.s.s.CoreContainerProvider
Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 20411 ERROR (jetty-launcher-28-thread-1) [] o.a.s.u.StartupLoggingUtils
Missing Java Option solr.log.dir. Logging may be missing or incomplete.
2> 20413 INFO (jetty-launcher-28-thread-1) [] o.a.s.s.CoreContainerProvider
Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 20414 INFO (jetty-launcher-28-thread-6) [] o.a.s.s.CoreContainerProvider
Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 20414 INFO (jetty-launcher-28-thread-3) [] o.a.s.s.CoreContainerProvider
Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 20419 INFO (jetty-launcher-28-thread-6) [] o.a.s.s.CoreContainerProvider
___ _ Welcome to Apache Solr™ version 9.4.0
2> 20419 INFO (jetty-launcher-28-thread-3) [] o.a.s.s.CoreContainerProvider
___ _ Welcome to Apache Solr™ version 9.4.0
2> 20419 INFO (jetty-launcher-28-thread-3) [] o.a.s.s.CoreContainerProvider
/ __| ___| |_ _ Starting in cloud mode on port null
2> 20419 INFO (jetty-launcher-28-thread-6) [] o.a.s.s.CoreContainerProvider
/ __| ___| |_ _ Starting in cloud mode on port null
2> 20419 INFO (jetty-launcher-28-thread-4) [] o.a.s.s.CoreContainerProvider
___ _ Welcome to Apache Solr™ version 9.4.0
2> 20419 INFO (jetty-launcher-28-thread-6) [] o.a.s.s.CoreContainerProvider
\__ \/ _ \ | '_| Install dir: /tmp/src/solr/solr
2> 20419 INFO (jetty-launcher-28-thread-3) [] o.a.s.s.CoreContainerProvider
\__ \/ _ \ | '_| Install dir: /tmp/src/solr/solr
2> 20420 INFO (jetty-launcher-28-thread-4) [] o.a.s.s.CoreContainerProvider
/ __| ___| |_ _ Starting in cloud mode on port null
2> 20419 INFO (jetty-launcher-28-thread-1) [] o.a.s.s.CoreContainerProvider
___ _ Welcome to Apache Solr™ version 9.4.0
2> 20420 INFO (jetty-launcher-28-thread-6) [] o.a.s.s.CoreContainerProvider
|___/\___/_|_| Start time: 2023-09-10T02:39:18.374032Z
2> 20420 INFO (jetty-launcher-28-thread-3) [] o.a.s.s.CoreContainerProvider
|___/\___/_|_| Start time: 2023-09-10T02:39:18.374036Z
2> 20420 INFO (jetty-launcher-28-thread-4) [] o.a.s.s.CoreContainerProvider
\__ \/ _ \ | '_| Install dir: /tmp/src/solr/solr
2> 20420 INFO (jetty-launcher-28-thread-4) [] o.a.s.s.CoreContainerProvider
|___/\___/_|_| Start time: 2023-09-10T02:39:18.374260Z
2> 20420 INFO (jetty-launcher-28-thread-1) [] o.a.s.s.CoreContainerProvider
/ __| ___| |_ _ Starting in cloud mode on port null
2> 20420 INFO (jetty-launcher-28-thread-5) [] o.a.s.s.CoreContainerProvider
___ _ Welcome to Apache Solr™ version 9.4.0
2> 20420 INFO (jetty-launcher-28-thread-5) [] o.a.s.s.CoreContainerProvider
/ __| ___| |_ _ Starting in cloud mode on port null
2> 20420 INFO (jetty-launcher-28-thread-1) [] o.a.s.s.CoreContainerProvider
\__ \/ _ \ | '_| Install dir: /tmp/src/solr/solr
2> 20420 INFO (jetty-launcher-28-thread-5) [] o.a.s.s.CoreContainerProvider
\__ \/ _ \ | '_| Install dir: /tmp/src/solr/solr
2> 20420 INFO (jetty-launcher-28-thread-1) [] o.a.s.s.CoreContainerProvider
|___/\___/_|_| Start time: 2023-09-10T02:39:18.374734Z
2> 20420 INFO (jetty-launcher-28-thread-5) [] o.a.s.s.CoreContainerProvider
|___/\___/_|_| Start time: 2023-09-10T02:39:18.374813Z
2> 20434 INFO (jetty-launcher-28-thread-2) []
o.e.j.s.s.DefaultSessionIdManager Session workerName=node0
2> 20440 INFO (jetty-launcher-28-thread-2) [] o.e.j.s.h.ContextHandler
Started
o.e.j.s.ServletContextHandler@7c6d73e8{/solr,file:///tmp/src/solr/solr/core/build/tmp/tests-cwd/,AVAILABLE}
2> 20441 INFO (jetty-launcher-28-thread-3) [] o.a.s.s.CoreContainerProvider
Solr Home:
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node3
(source: servlet config: solr.solr.home)
2> 20441 INFO (jetty-launcher-28-thread-6) [] o.a.s.s.CoreContainerProvider
Solr Home:
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node6
(source: servlet config: solr.solr.home)
2> 20441 INFO (jetty-launcher-28-thread-2) [] o.e.j.s.AbstractConnector
Started ServerConnector@57c4a1b9{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:٤٢٠٥١}
2> 20441 INFO (jetty-launcher-28-thread-2) [] o.e.j.s.Server Started
Server@6c29e103{STARTING}[10.0.16,sto=٠] @٢٠٤٦١ms
2> 20442 WARN (jetty-launcher-28-thread-6) [] o.a.s.c.c.SolrZkClient Using
default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates
an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper
nodes
2> 20442 WARN (jetty-launcher-28-thread-3) [] o.a.s.c.c.SolrZkClient Using
default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates
an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper
nodes
2> 20442 INFO (jetty-launcher-28-thread-5) [] o.a.s.s.CoreContainerProvider
Solr Home:
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node5
(source: servlet config: solr.solr.home)
2> 20442 ERROR (jetty-launcher-28-thread-2) [] o.a.s.u.StartupLoggingUtils
Missing Java Option solr.log.dir. Logging may be missing or incomplete.
2> 20442 INFO (jetty-launcher-28-thread-2) [] o.a.s.s.CoreContainerProvider
Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
2> 20442 INFO (jetty-launcher-28-thread-2) [] o.a.s.s.CoreContainerProvider
___ _ Welcome to Apache Solr™ version 9.4.0
2> 20442 INFO (jetty-launcher-28-thread-2) [] o.a.s.s.CoreContainerProvider
/ __| ___| |_ _ Starting in cloud mode on port null
2> 20442 WARN (jetty-launcher-28-thread-5) [] o.a.s.c.c.SolrZkClient Using
default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates
an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper
nodes
2> 20442 INFO (jetty-launcher-28-thread-2) [] o.a.s.s.CoreContainerProvider
\__ \/ _ \ | '_| Install dir: /tmp/src/solr/solr
2> 20442 INFO (jetty-launcher-28-thread-1) [] o.a.s.s.CoreContainerProvider
Solr Home:
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node1
(source: servlet config: solr.solr.home)
2> 20442 INFO (jetty-launcher-28-thread-4) [] o.a.s.s.CoreContainerProvider
Solr Home:
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node4
(source: servlet config: solr.solr.home)
2> 20442 INFO (jetty-launcher-28-thread-2) [] o.a.s.s.CoreContainerProvider
|___/\___/_|_| Start time: 2023-09-10T02:39:18.396869Z
2> 20443 INFO (jetty-launcher-28-thread-2) [] o.a.s.s.CoreContainerProvider
Solr Home:
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node2
(source: servlet config: solr.solr.home)
2> 20444 WARN (jetty-launcher-28-thread-2) [] o.a.s.c.c.SolrZkClient Using
default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates
an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper
nodes
2> 20445 WARN (jetty-launcher-28-thread-4) [] o.a.s.c.c.SolrZkClient Using
default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates
an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper
nodes
2> 20444 WARN (jetty-launcher-28-thread-1) [] o.a.s.c.c.SolrZkClient Using
default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates
an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper
nodes
2> 20463 INFO (jetty-launcher-28-thread-1) [] o.a.s.c.c.ConnectionManager
Waiting up to 30000ms for client to connect to ZooKeeper
2> 20477 INFO (jetty-launcher-28-thread-4) [] o.a.s.c.c.ConnectionManager
Waiting up to 30000ms for client to connect to ZooKeeper
2> 20492 INFO (jetty-launcher-28-thread-6) [] o.a.s.c.c.ConnectionManager
Waiting up to 30000ms for client to connect to ZooKeeper
2> 20506 INFO (jetty-launcher-28-thread-5) [] o.a.s.c.c.ConnectionManager
Waiting up to 30000ms for client to connect to ZooKeeper
2> 20458 INFO (jetty-launcher-28-thread-3) [] o.a.s.c.c.ConnectionManager
Waiting up to 30000ms for client to connect to ZooKeeper
2> 20514 INFO (jetty-launcher-28-thread-2) [] o.a.s.c.c.ConnectionManager
Waiting up to 30000ms for client to connect to ZooKeeper
2> 20541 INFO (zkConnectionManagerCallback-31-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 20541 INFO (jetty-launcher-28-thread-3) [] o.a.s.c.c.ConnectionManager
Client is connected to ZooKeeper
2> 20541 WARN (jetty-launcher-28-thread-3) [] o.a.s.c.c.SolrZkClient Using
default ZkACLProvider. DefaultZkACLProvider is not secure, it creates
'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 20554 INFO (zkConnectionManagerCallback-36-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 20554 INFO (jetty-launcher-28-thread-1) [] o.a.s.c.c.ConnectionManager
Client is connected to ZooKeeper
2> 20555 WARN (jetty-launcher-28-thread-1) [] o.a.s.c.c.SolrZkClient Using
default ZkACLProvider. DefaultZkACLProvider is not secure, it creates
'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 20570 INFO (zkConnectionManagerCallback-40-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 20570 INFO (jetty-launcher-28-thread-1) [] o.a.s.c.NodeConfig solr.xml
found in ZooKeeper. Loading...
2> 20570 INFO (jetty-launcher-28-thread-4) [] o.a.s.c.c.ConnectionManager
Client is connected to ZooKeeper
2> 20570 INFO (jetty-launcher-28-thread-3) [] o.a.s.c.NodeConfig solr.xml
found in ZooKeeper. Loading...
2> 20571 WARN (jetty-launcher-28-thread-4) [] o.a.s.c.c.SolrZkClient Using
default ZkACLProvider. DefaultZkACLProvider is not secure, it creates
'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 20571 WARN (jetty-launcher-28-thread-1) [] o.a.s.D.solrxml-zookeeper
Loading solr.xml from zookeeper is deprecated. See reference guide for details.
2> 20583 INFO (jetty-launcher-28-thread-3) [] o.a.s.c.SolrXmlConfig Metrics
collection is disabled.
2> 20584 INFO (jetty-launcher-28-thread-1) [] o.a.s.c.SolrXmlConfig Metrics
collection is disabled.
2> 20590 INFO (zkConnectionManagerCallback-38-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 20590 INFO (jetty-launcher-28-thread-2) [] o.a.s.c.c.ConnectionManager
Client is connected to ZooKeeper
2> 20590 WARN (jetty-launcher-28-thread-2) [] o.a.s.c.c.SolrZkClient Using
default ZkACLProvider. DefaultZkACLProvider is not secure, it creates
'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 20600 INFO (jetty-launcher-28-thread-2) [] o.a.s.c.NodeConfig solr.xml
found in ZooKeeper. Loading...
2> 20603 INFO (jetty-launcher-28-thread-4) [] o.a.s.c.NodeConfig solr.xml
found in ZooKeeper. Loading...
2> 20606 INFO (jetty-launcher-28-thread-2) [] o.a.s.c.SolrXmlConfig Metrics
collection is disabled.
2> 20607 INFO (jetty-launcher-28-thread-4) [] o.a.s.c.SolrXmlConfig Metrics
collection is disabled.
2> 20597 INFO (zkConnectionManagerCallback-34-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 20612 INFO (jetty-launcher-28-thread-5) [] o.a.s.c.c.ConnectionManager
Client is connected to ZooKeeper
2> 20612 WARN (jetty-launcher-28-thread-5) [] o.a.s.c.c.SolrZkClient Using
default ZkACLProvider. DefaultZkACLProvider is not secure, it creates
'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 20619 INFO (zkConnectionManagerCallback-32-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 20619 INFO (jetty-launcher-28-thread-6) [] o.a.s.c.c.ConnectionManager
Client is connected to ZooKeeper
2> 20619 WARN (jetty-launcher-28-thread-6) [] o.a.s.c.c.SolrZkClient Using
default ZkACLProvider. DefaultZkACLProvider is not secure, it creates
'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
2> 20624 INFO (jetty-launcher-28-thread-5) [] o.a.s.c.NodeConfig solr.xml
found in ZooKeeper. Loading...
2> 20627 INFO (jetty-launcher-28-thread-6) [] o.a.s.c.NodeConfig solr.xml
found in ZooKeeper. Loading...
2> 20630 INFO (jetty-launcher-28-thread-5) [] o.a.s.c.SolrXmlConfig Metrics
collection is disabled.
2> 20634 INFO (jetty-launcher-28-thread-6) [] o.a.s.c.SolrXmlConfig Metrics
collection is disabled.
2> 20889 INFO (jetty-launcher-28-thread-3) [] o.a.s.c.ZkContainer Zookeeper
client=127.0.0.1:40701/solr
2> 20933 INFO (jetty-launcher-28-thread-3) []
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 20985 INFO (jetty-launcher-28-thread-6) [] o.a.s.c.ZkContainer Zookeeper
client=127.0.0.1:40701/solr
2> 21005 INFO (jetty-launcher-28-thread-1) [] o.a.s.c.ZkContainer Zookeeper
client=127.0.0.1:40701/solr
2> 21005 INFO (jetty-launcher-28-thread-4) [] o.a.s.c.ZkContainer Zookeeper
client=127.0.0.1:40701/solr
2> 21005 INFO (jetty-launcher-28-thread-1) []
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21005 INFO (jetty-launcher-28-thread-4) []
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21013 INFO (jetty-launcher-28-thread-6) []
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21014 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to
ZooKeeper
2> 21083 INFO (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to
ZooKeeper
2> 21130 INFO (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to
ZooKeeper
2> 21155 INFO (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to
ZooKeeper
2> 21156 INFO (jetty-launcher-28-thread-5) [] o.a.s.c.ZkContainer Zookeeper
client=127.0.0.1:40701/solr
2> 21156 INFO (jetty-launcher-28-thread-5) []
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21167 INFO (jetty-launcher-28-thread-2) [] o.a.s.c.ZkContainer Zookeeper
client=127.0.0.1:40701/solr
2> 21167 INFO (jetty-launcher-28-thread-2) []
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21171 INFO (zkConnectionManagerCallback-88-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 21171 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 21173 INFO (zkConnectionManagerCallback-92-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 21173 INFO (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 21179 INFO (zkConnectionManagerCallback-90-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 21180 INFO (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 21202 INFO (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to
ZooKeeper
2> 21205 INFO (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to
ZooKeeper
2> 21216 INFO (zkConnectionManagerCallback-97-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 21217 INFO (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 21220 INFO (zkConnectionManagerCallback-94-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 21220 INFO (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 21254 INFO (zkConnectionManagerCallback-100-thread-1) []
o.a.s.c.c.ConnectionManager zkClient has connected
2> 21255 INFO (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
2> 21436 WARN (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable;
consider setting up ACLs as described in
https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 21436 WARN (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable;
consider setting up ACLs as described in
https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 21439 WARN (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable;
consider setting up ACLs as described in
https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 21439 WARN (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable;
consider setting up ACLs as described in
https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 21439 WARN (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable;
consider setting up ACLs as described in
https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 21440 WARN (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable;
consider setting up ACLs as described in
https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
2> 21497 INFO (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21499 INFO (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21499 INFO (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21499 INFO (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21499 INFO (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21499 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater
with useDistributedStateUpdate=true. Solr will be using distributed cluster
state updates.
2> 21533 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37353_solr
2> 21543 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.Overseer Overseer
(id=72057615793717260-127.0.0.1:37353_solr-n_0000000000) starting
2> 21543 INFO (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:46119_solr
2> 21546 INFO (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:34167_solr
2> 21546 INFO (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:42051_solr
2> 21546 INFO (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:42499_solr
2> 21547 INFO (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:39933_solr
2> 21606 INFO (zkCallback-89-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (0) -> (5)
2> 21657 INFO (zkCallback-99-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (0) -> (5)
2> 21658 INFO (zkCallback-93-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (0) -> (5)
2> 21663 INFO (zkCallback-87-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (0) -> (5)
2> 21663 INFO (zkCallback-91-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (0) -> (5)
2> 21663 INFO (zkCallback-96-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (0) -> (5)
2> 21688 WARN (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.c.CoreContainer Not all security plugins configured!
authentication=disabled authorization=disabled. Solr is only as secure as you
make it. Consider configuring authentication/authorization before exposing Solr
to users internal or external. See https://s.apache.org/solrsecurity for more
info
2> 21688 WARN (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.c.CoreContainer Not all security plugins configured!
authentication=disabled authorization=disabled. Solr is only as secure as you
make it. Consider configuring authentication/authorization before exposing Solr
to users internal or external. See https://s.apache.org/solrsecurity for more
info
2> 21690 WARN (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.c.CoreContainer Not all security plugins configured!
authentication=disabled authorization=disabled. Solr is only as secure as you
make it. Consider configuring authentication/authorization before exposing Solr
to users internal or external. See https://s.apache.org/solrsecurity for more
info
2> 21691 WARN (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.c.CoreContainer Not all security plugins configured!
authentication=disabled authorization=disabled. Solr is only as secure as you
make it. Consider configuring authentication/authorization before exposing Solr
to users internal or external. See https://s.apache.org/solrsecurity for more
info
2> 21696 WARN (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.c.CoreContainer Not all security plugins configured!
authentication=disabled authorization=disabled. Solr is only as secure as you
make it. Consider configuring authentication/authorization before exposing Solr
to users internal or external. See https://s.apache.org/solrsecurity for more
info
2> 21887 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.ZkController Publish node=127.0.0.1:37353_solr as DOWN
2> 21887 INFO
(OverseerStateUpdate-72057615793717260-127.0.0.1:37353_solr-n_0000000000)
[n:127.0.0.1:37353_solr] o.a.s.c.Overseer Starting to work on the main queue :
127.0.0.1:37353_solr
2> 21890 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.ZkController Register node as live in
ZooKeeper:/live_nodes/127.0.0.1:37353_solr
2> 21897 INFO (zkCallback-99-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (5) -> (6)
2> 21898 INFO (zkCallback-91-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (5) -> (6)
2> 21899 INFO
(OverseerStateUpdate-72057615793717260-127.0.0.1:37353_solr-n_0000000000)
[n:127.0.0.1:37353_solr] o.a.s.c.c.ZkStateReader Updated live nodes from
ZooKeeper... (5) -> (6)
2> 21899 INFO (zkCallback-89-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (5) -> (6)
2> 21899 INFO (zkCallback-96-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (5) -> (6)
2> 21899 INFO (zkCallback-93-thread-1) [] o.a.s.c.c.ZkStateReader Updated
live nodes from ZooKeeper... (5) -> (6)
2> 21909 WARN (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.CoreContainer Not all security plugins configured!
authentication=disabled authorization=disabled. Solr is only as secure as you
make it. Consider configuring authentication/authorization before exposing Solr
to users internal or external. See https://s.apache.org/solrsecurity for more
info
2> 22206 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node3
2> 22206 INFO (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node6
2> 22365 INFO (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node5
2> 22372 INFO (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 22374 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 22396 INFO (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node2
2> 22457 INFO (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node4
2> 22459 INFO (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath
/tmp/src/solr/solr/core/build/tmp/tests-tmp/solr.cloud.LeaderElectionIntegrationTest_541459EE55893D9C-001/tempDir-001/node1
2> 22527 INFO (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 22537 INFO (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 22540 INFO (jetty-launcher-28-thread-3) [n:127.0.0.1:37353_solr]
o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37353,
zkHost=127.0.0.1:40701/solr}
2> 22551 INFO (jetty-launcher-28-thread-6) [n:127.0.0.1:34167_solr]
o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34167,
zkHost=127.0.0.1:40701/solr}
2> 22703 INFO (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 22710 INFO (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
2> 22718 INFO (jetty-launcher-28-thread-5) [n:127.0.0.1:42499_solr]
o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42499,
zkHost=127.0.0.1:40701/solr}
2> 22718 INFO (jetty-launcher-28-thread-2) [n:127.0.0.1:42051_solr]
o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42051,
zkHost=127.0.0.1:40701/solr}
2> 22757 INFO (jetty-launcher-28-thread-4) [n:127.0.0.1:39933_solr]
o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39933,
zkHost=127.0.0.1:40701/solr}
2> 22763 INFO (jetty-launcher-28-thread-1) [n:127.0.0.1:46119_solr]
o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46119,
zkHost=127.0.0.1:40701/solr}
2> سبتمبر ١٠, ٢٠٢٣ ٢:٣٩:١٦ م
com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
2> WARNING: Suite execution timed out:
org.apache.solr.cloud.LeaderElectionIntegrationTest
2> ==== jstack at approximately timeout time ====
2> "Test worker" ID=1 WAITING on
com.carrotsearch.randomizedtesting.RandomizedRunner$2@75b68443
2> at [email protected]/java.lang.Object.wait(Native Method)
2> - waiting on
com.carrotsearch.randomizedtesting.RandomizedRunner$2@75b68443
2> at [email protected]/java.lang.Thread.join(Thread.java:1300)
2> at [email protected]/java.lang.Thread.join(Thread.java:1375)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:647)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:504)
2> at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:108)
2> at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:57)
2> at
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:39)
2> at
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
2> at
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:52)
2> at
[email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
2> at
[email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2> at
[email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2> at [email protected]/java.lang.reflect.Method.invoke(Method.java:566)
2> at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
2> at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
2> at
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
2> at
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
2> at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
2> at
org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:176)
2> at
org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:129)
2> at
org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:100)
2> at
org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:60)
2> at
org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
2> at
org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:113)
2> at
org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:65)
2> at
app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
2> at
app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
2>
2> "Reference Handler" ID=2 RUNNABLE
2> at
[email protected]/java.lang.ref.Reference.waitForReferencePendingList(Native
Method)
2> at
[email protected]/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
2> at
[email protected]/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
2>
2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@44a0de29
2> at [email protected]/java.lang.Object.wait(Native Method)
2> - waiting on java.lang.ref.ReferenceQueue$Lock@44a0de29
2> at
[email protected]/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2> at
[email protected]/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
2> at
[email protected]/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
2>
2> "Signal Dispatcher" ID=4 RUNNABLE
2>
2> "Common-Cleaner" ID=9 TIMED_WAITING on
java.lang.ref.ReferenceQueue$Lock@575de62
2> at [email protected]/java.lang.Object.wait(Native Method)
2> - timed waiting on java.lang.ref.ReferenceQueue$Lock@575de62
2> at
[email protected]/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2> at
[email protected]/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> at
[email protected]/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:161)
2>
2> "/127.0.0.1:52024 to /127.0.0.1:39479 workers" ID=11 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@54a47137
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@54a47137
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:367)
2> at
org.gradle.api.internal.tasks.testing.worker.TestWorker.submitToRun(TestWorker.java:207)
2> - locked
org.gradle.api.internal.tasks.testing.worker.TestWorker@3cb4d097
2> at
org.gradle.api.internal.tasks.testing.worker.TestWorker.processTestClass(TestWorker.java:169)
2> at
[email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
2> at
[email protected]/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
2> at
[email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2> at [email protected]/java.lang.reflect.Method.invoke(Method.java:566)
2> at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
2> at
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
2> at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:182)
2> at
org.gradle.internal.remote.internal.hub.MessageHubBackedObjectConnection$DispatchWrapper.dispatch(MessageHubBackedObjectConnection.java:164)
2> at
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:414)
2> at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
2> at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:49)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> Locked synchronizers:
2> - java.util.concurrent.ThreadPoolExecutor$Worker@37afeb11
2>
2> "/127.0.0.1:52024 to /127.0.0.1:39479 workers Thread 2" ID=12 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@16b7bc1c
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@16b7bc1c
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
org.gradle.internal.remote.internal.hub.queue.EndPointQueue.take(EndPointQueue.java:49)
2> at
org.gradle.internal.remote.internal.hub.MessageHub$ConnectionDispatch.run(MessageHub.java:322)
2> at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
2> at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:49)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> Locked synchronizers:
2> - java.util.concurrent.ThreadPoolExecutor$Worker@3e694b3f
2>
2> "/127.0.0.1:52024 to /127.0.0.1:39479 workers Thread 3" ID=13 RUNNABLE (in
native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@3d9af666
2> - locked sun.nio.ch.EPollSelectorImpl@27b0b92a
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
org.gradle.internal.remote.internal.inet.SocketConnection$SocketInputStream.read(SocketConnection.java:185)
2> at com.esotericsoftware.kryo.io.Input.fill(Input.java:146)
2> at com.esotericsoftware.kryo.io.Input.require(Input.java:178)
2> at com.esotericsoftware.kryo.io.Input.readByte(Input.java:295)
2> at
org.gradle.internal.serialize.kryo.KryoBackedDecoder.readByte(KryoBackedDecoder.java:88)
2> at
org.gradle.internal.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:64)
2> at
org.gradle.internal.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:52)
2> at
org.gradle.internal.remote.internal.inet.SocketConnection.receive(SocketConnection.java:81)
2> at
org.gradle.internal.remote.internal.hub.MessageHub$ConnectionReceive.run(MessageHub.java:270)
2> at
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
2> at
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:49)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> Locked synchronizers:
2> - java.util.concurrent.ThreadPoolExecutor$Worker@3590fc5b
2>
2> "ForkJoinPool.commonPool-worker-3" ID=25 WAITING on
java.util.concurrent.ForkJoinPool@50ea4922
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on java.util.concurrent.ForkJoinPool@50ea4922
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1628)
2> at
[email protected]/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
2>
2> "SUITE-LeaderElectionIntegrationTest-seed#[541459EE55893D9C]" ID=34
RUNNABLE
2> at
[email protected]/sun.management.ThreadImpl.dumpThreads0(Native Method)
2> at
[email protected]/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:521)
2> at
[email protected]/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:509)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:708)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:59)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:437)
2> - locked java.lang.Object@7b16587f
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:716)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:637)
2>
2>
"TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C]"
ID=35 WAITING on java.util.concurrent.FutureTask@1155b8bd
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on java.util.concurrent.FutureTask@1155b8bd
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.FutureTask.awaitDone(FutureTask.java:447)
2> at
[email protected]/java.util.concurrent.FutureTask.get(FutureTask.java:190)
2> at
[email protected]/java.util.concurrent.AbstractExecutorService.invokeAll(AbstractExecutorService.java:247)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:380)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster$Builder.build(MiniSolrCloudCluster.java:1311)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster$Builder.configure(MiniSolrCloudCluster.java:1278)
2> at
app//org.apache.solr.cloud.LeaderElectionIntegrationTest.setUp(LeaderElectionIntegrationTest.java:43)
2> at jdk.internal.reflect.GeneratedMethodAccessor7.invoke(Unknown Source)
2> at
[email protected]/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2> at [email protected]/java.lang.reflect.Method.invoke(Method.java:566)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:980)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
2> at
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
2> at
app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
2> at
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
2> at
app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
2> at
app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
2> at
app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
2> at
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
2> at
app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
2> at
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
2> at
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
2> at
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
2> at
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
2> at
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at
app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
2> at
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
2> at
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
2> at
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at
app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
2> at
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
2> at
app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
2> at
app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
2> at
app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
2> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
2> at
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
2> at
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$$Lambda$186/0x000000084021a040.run(Unknown
Source)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2> "ZkTestServer Run Thread" ID=36 WAITING on
org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread@330e2a54
2> at [email protected]/java.lang.Object.wait(Native Method)
2> - waiting on
org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread@330e2a54
2> at [email protected]/java.lang.Thread.join(Thread.java:1300)
2> at [email protected]/java.lang.Thread.join(Thread.java:1375)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:919)
2> at
app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:337)
2> at app//org.apache.solr.cloud.ZkTestServer$1.run(ZkTestServer.java:581)
2>
2> "NIOServerCxnFactory.SelectorThread-0" ID=38 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@312fd64e
2> - locked sun.nio.ch.EPollSelectorImpl@7833b5b4
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:403)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:368)
2>
2> "NIOServerCxnFactory.SelectorThread-1" ID=39 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@441f7a5f
2> - locked sun.nio.ch.EPollSelectorImpl@601b402
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:403)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:368)
2>
2> "NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:0" ID=40 RUNNABLE (in
native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@49539f2a
2> - locked sun.nio.ch.EPollSelectorImpl@2c281da1
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:205)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:181)
2>
2> "ConnnectionExpirer" ID=37 TIMED_WAITING
2> at [email protected]/java.lang.Thread.sleep(Native Method)
2> at
app//org.apache.zookeeper.server.NIOServerCnxnFactory$ConnectionExpirerThread.run(NIOServerCnxnFactory.java:554)
2>
2> "NIOWorkerThread-1" ID=41 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@13da47f9
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@13da47f9
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2> "SessionTracker" ID=42 TIMED_WAITING
2> at [email protected]/java.lang.Thread.sleep(Native Method)
2> at
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:163)
2>
2> "SyncThread:0" ID=43 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@18f05024
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@18f05024
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
app//org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:170)
2>
2> "ProcessThread(sid:0 cport:40701):" ID=44 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4d8f36df
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4d8f36df
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
app//org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:142)
2>
2> "RequestThrottler" ID=45 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@21a6ffda
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@21a6ffda
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
app//org.apache.zookeeper.server.RequestThrottler.run(RequestThrottler.java:147)
2>
2> "NIOWorkerThread-2" ID=46 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@13da47f9
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@13da47f9
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2>
"TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C]-SendThread(127.0.0.1:40701)"
ID=47 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@60029198
2> - locked sun.nio.ch.EPollSelectorImpl@7ae99ccc
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
2> at
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332)
2> at
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)
2>
2>
"TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C]-EventThread"
ID=48 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4e647480
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4e647480
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:534)
2>
2> "NIOWorkerThread-3" ID=49 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@13da47f9
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@13da47f9
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2> "zkConnectionManagerCallback-23-thread-1" ID=50 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@582a0ab9
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@582a0ab9
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2>
"TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C]-SendThread(127.0.0.1:40701)"
ID=51 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@2cd0de75
2> - locked sun.nio.ch.EPollSelectorImpl@1a6928df
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
2> at
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332)
2> at
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)
2>
2>
"TEST-LeaderElectionIntegrationTest.testSimpleSliceLeaderElection-seed#[541459EE55893D9C]-EventThread"
ID=52 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@77c48f66
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@77c48f66
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:534)
2>
2> "zkConnectionManagerCallback-25-thread-1" ID=53 WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7fb32ce5
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7fb32ce5
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2> at
[email protected]/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2> "jetty-launcher-28-thread-3" ID=59 WAITING on
java.util.concurrent.CountDownLatch$Sync@77dad21
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on java.util.concurrent.CountDownLatch$Sync@77dad21
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
2> at
[email protected]/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
2> at
app//org.apache.solr.servlet.CoreContainerProvider$ContextInitializationKey.waitForReadyService(CoreContainerProvider.java:525)
2> at
app//org.apache.solr.servlet.CoreContainerProvider$ServiceHolder.getService(CoreContainerProvider.java:564)
2> at
app//org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:147)
2> at
app//org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:133)
2> at
app//org.eclipse.jetty.servlet.ServletHandler.initializeHolders(ServletHandler.java:774)
2> at
app//org.eclipse.jetty.servlet.ServletHandler.setFilters(ServletHandler.java:1472)
2> at
app//org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:992)
2> at
app//org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:480)
2> at
app//org.apache.solr.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:427)
2> - locked org.apache.solr.embedded.JettySolrRunner$1@553a6610
2> at
app//org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:253)
2> at
app//org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:94)
2> at
app//org.apache.solr.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:616)
2> at
app//org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:554)
2> - locked org.apache.solr.embedded.JettySolrRunner@6c693b8
2> at
app//org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:525)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:569)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:375)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster$$Lambda$877/0x000000084089dc40.call(Unknown
Source)
2> at
[email protected]/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2> at
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
2> at
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$342/0x00000008404de040.run(Unknown
Source)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> Locked synchronizers:
2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@55aa83b9
2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@331859ed
2> - java.util.concurrent.ThreadPoolExecutor$Worker@37e64d23
2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@3594b378
2>
2> "jetty-launcher-28-thread-6" ID=62 WAITING on
java.util.concurrent.CountDownLatch$Sync@4bdcabfd
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - waiting on java.util.concurrent.CountDownLatch$Sync@4bdcabfd
2> at
[email protected]/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
2> at
[email protected]/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
2> at
app//org.apache.solr.servlet.CoreContainerProvider$ContextInitializationKey.waitForReadyService(CoreContainerProvider.java:525)
2> at
app//org.apache.solr.servlet.CoreContainerProvider$ServiceHolder.getService(CoreContainerProvider.java:564)
2> at
app//org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:147)
2> at
app//org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:133)
2> at
app//org.eclipse.jetty.servlet.ServletHandler.initializeHolders(ServletHandler.java:774)
2> at
app//org.eclipse.jetty.servlet.ServletHandler.setFilters(ServletHandler.java:1472)
2> at
app//org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:992)
2> at
app//org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:480)
2> at
app//org.apache.solr.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:427)
2> - locked org.apache.solr.embedded.JettySolrRunner$1@6cb513c
2> at
app//org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:253)
2> at
app//org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:94)
2> at
app//org.apache.solr.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:616)
2> at
app//org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:554)
2> - locked org.apache.solr.embedded.JettySolrRunner@77edb739
2> at
app//org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:525)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:569)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:375)
2> at
app//org.apache.solr.cloud.MiniSolrCloudCluster$$Lambda$877/0x000000084089dc40.call(Unknown
Source)
2> at
[email protected]/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2> at
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
2> at
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$342/0x00000008404de040.run(Unknown
Source)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> Locked synchronizers:
2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@67f2d5cf
2> - java.util.concurrent.ThreadPoolExecutor$Worker@20d23a3e
2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@d0c78b5
2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@51128a99
2>
2> "qtp1221460462-67" ID=67 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@3af143e4
2> - locked sun.nio.ch.EPollSelectorImpl@54564ddf
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
2> at
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
2> at
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$341/0x00000008404de840.run(Unknown
Source)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2> "qtp1505412282-64" ID=64 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@11d5538e
2> - locked sun.nio.ch.EPollSelectorImpl@3f78910a
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
2> at
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
2> at
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$341/0x00000008404de840.run(Unknown
Source)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2> "qtp1313120450-69" ID=69 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> - locked sun.nio.ch.Util$2@fa61b62
2> - locked sun.nio.ch.EPollSelectorImpl@69f897fc
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
2> at
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
2> at
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$341/0x00000008404de840.run(Unknown
Source)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2>
2> "qtp1221460462-70-acceptor-٠@4002c940-ServerConnector@19047ebf{HTTP/1.1,
(http/1.1, h2c)}{127.0.0.1:٣٤١٦٧}" ID=70 RUNNABLE (in native code)
2> at [email protected]/sun.nio.ch.ServerSocketChannelImpl.accept0(Native
Method)
2> at
[email protected]/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
2> at
[email protected]/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
2> at
app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:409)
2> at
app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:748)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> Locked synchronizers:
2> - java.util.concurrent.locks.ReentrantLock$NonfairSync@520af06e
2>
2> "qtp1221460462-73" ID=73 TIMED_WAITING on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2901dbe4
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> - timed waiting on
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2901dbe4
2> at
[email protected]/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2> at
[email protected]/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2> at
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(
[...truncated too long message...]
at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
2> at
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$341/0x00000008404de840.run(Unknown
Source)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> 106) Thread[id=64, name=qtp1505412282-64, state=RUNNABLE,
group=TGRP-LeaderElectionIntegrationTest]
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
2> at
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
2> at
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$341/0x00000008404de840.run(Unknown
Source)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
2> at
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> 107) Thread[id=59, name=jetty-launcher-28-thread-3, state=TIMED_WAITING,
group=TGRP-LeaderElectionIntegrationTest]
2> at [email protected]/jdk.internal.misc.Unsafe.park(Native Method)
2> at
[email protected]/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2> at
[email protected]/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2> at
[email protected]/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2> at
[email protected]/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
2> 108) Thread[id=165, name=h2sc-79-thread-2, state=RUNNABLE,
group=TGRP-LeaderElectionIntegrationTest]
2> at [email protected]/sun.nio.ch.EPoll.wait(Native Method)
2> at
[email protected]/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
2> at
[email protected]/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
2> at
[email protected]/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
2> at
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
2> at
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
2> at
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
2> at
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
2> at
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$341/0x00000008404de840.run(Unknown
Source)
2> at
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
2> at
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$342/0x00000008404de040.run(Unknown
Source)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2> at
[email protected]/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2> at [email protected]/java.lang.Thread.run(Thread.java:829)
> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
> at __randomizedtesting.SeedInfo.seed([541459EE55893D9C]:0)
2> NOTE: test params are: codec=Asserting(Lucene95): {}, docValues:{},
maxPointsInLeafNode=375, maxMBSortInHeap=7.553947662993847,
sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=ar-YE,
timezone=Australia/Canberra
2> NOTE: Linux 5.4.0-100-generic amd64/Oracle Corporation 11.0.16
(64-bit)/cpus=1,threads=124,free=126610752,total=314048512
2> NOTE: All tests run in this JVM: [BasicFunctionalityTest,
LeaderElectionIntegrationTest]
2> NOTE: reproduce with: gradlew test --tests LeaderElectionIntegrationTest
-Dtests.seed=541459EE55893D9C -Dtests.locale=ar-YE
-Dtests.timezone=Australia/Canberra -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
:solr:core:test (FAILURE): 4870 test(s), 2 failure(s), 242 skipped
4870 tests completed, 2 failed, 242 skipped
> Task :solr:core:test FAILED
> Task :solr:core:wipeTaskTemp
ERROR: The following test(s) have failed:
-
org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
(:solr:core)
Test output:
/tmp/src/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.LeaderElectionIntegrationTest.txt
Reproduce with: gradlew :solr:core:test --tests
"org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection"
-Ptests.jvms=96 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC
-XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m"
-Ptests.seed=541459EE55893D9C -Ptests.file.encoding=US-ASCII
- org.apache.solr.cloud.LeaderElectionIntegrationTest.classMethod (:solr:core)
Test output:
/tmp/src/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.LeaderElectionIntegrationTest.txt
Reproduce with: gradlew :solr:core:test --tests
"org.apache.solr.cloud.LeaderElectionIntegrationTest.classMethod"
-Ptests.jvms=96 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC
-XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m"
-Ptests.seed=541459EE55893D9C -Ptests.file.encoding=US-ASCII
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Build file '/tmp/src/solr/solr/packaging/build.gradle' line: 285
* What went wrong:
Execution failed for task ':solr:packaging:integrationTests'.
> Process 'command
> '/tmp/src/solr/.gradle/node/packaging/node_modules/bats/bin/bats'' finished
> with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:core:test'.
> There were failing tests. See the results at:
> file:///tmp/src/solr/solr/core/build/test-results/test/
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
BUILD FAILED in 2h 4m 49s
654 actionable tasks: 637 executed, 17 up-to-date
[0m[?12l[?25h
------------------------------------------------------------------------
Build Failed: returned 1
Total time: 2h5m11s
------------------------------------------------------------------------
+ status=1
+ ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**'
'**/hs_err_pid*'
Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such
file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code
23) at main.c(1675) [Receiver=3.1.2]
rsync: [Receiver] write error: Broken pipe (32)
+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
[Checks API] No suitable checks publisher found.
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
