[JENKINS] Solr » Solr-Check-9.x - Build # 5409 - Still Failing!

[Apache Jenkins Server]

Build: https://ci-builds.apache.org/job/Solr/job/Solr-Check-9.x/5409/

1 tests failed.
FAILED:  
org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest.classMethod

Error Message:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([2B280FFDA3D1F888]:0)




Build Log:
[...truncated 1315 lines...]
# ERROR: Solr is still running at http://localhost:7574/solr after 5 seconds
#
# Please find the SOLR_HOME snapshot for failed test #2 at: 
/tmp/src/solr/solr/packaging/build/test-output/failure-snapshots/62-2
# Last output:
#
# Found 2 Solr nodes running! Must either specify a port using -p or -all to 
stop all Solr nodes on this host.
ok 63 status detects locally running solr in 14722ms
ok 64 status does not expose cli parameters to end user in 214ms
ok 65 listing out files in 2174ms
ok 66 copying files around in 6725ms
ok 67 upconfig in 2630ms
ok 68 zkcli.sh gets 'solrhome' from 'solr.home' system property in 1232ms
ok 69 zkcli.sh gets 'solrhome' from 'solrhome' command line option in 1234ms

> Task :solr:packaging:integrationTests FAILED

> Task :solr:solrj:test

org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest > 
classMethod FAILED
    java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([2B280FFDA3D1F888]:0)

org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest > 
test suite's output saved to 
/tmp/src/solr/solr/solrj/build/test-results/test/outputs/OUTPUT-org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest.txt,
 copied below:
  2> 3790 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to 
test-framework derived value of 
'/tmp/src/solr/solr/server/solr/configsets/_default/conf'
  2> 3808 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: 
test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
  2> 3856 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-1 for ERROR logs matching 
regex: ignore_exception
  2> 3889 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.SolrTestCaseJ4 Created dataDir: 
/tmp/src/solr/solr/solrj/build/tmp/tests-tmp/solr.client.solrj.request.json.JsonQueryRequestIntegrationTest_2B280FFDA3D1F888-001/data-dir-1-001
  2> 4075 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) 
w/NUMERIC_DOCVALUES_SYSPROP=true
  2> 4161 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, 
clientAuth=0.0/0.0)
  2> 4223 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.u.t.SimplePropagator Always-on trace id generation enabled.
  2> 4227 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in 
/tmp/src/solr/solr/solrj/build/tmp/tests-tmp/solr.client.solrj.request.json.JsonQueryRequestIntegrationTest_2B280FFDA3D1F888-001/tempDir-001
  2> 4232 WARN  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.ZkTestServer TEST_PATH() does not exist - solrj test?
  2> 4240 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
  2> 4255 INFO  (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer client port: 
0.0.0.0/0.0.0.0:0
  2> 4259 INFO  (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer Starting 
server
  2> 4583 WARN  (ZkTestServer Run Thread) [] o.a.z.s.ServerCnxnFactory maxCnxns 
is not configured, using default value 0.
  2> 4675 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.ZkTestServer start zk server on port: 35923
  2> 5103 WARN  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. 
ZkCredentialsInjector is not secure, it creates an empty list of credentials 
which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
  2> 5194 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to 
ZooKeeper
  2> 5263 INFO  (zkConnectionManagerCallback-3-thread-1) [] 
o.a.s.c.c.ConnectionManager zkClient has connected
  2> 5263 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
  2> 5264 WARN  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not 
secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
  2> 5311 WARN  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. 
ZkCredentialsInjector is not secure, it creates an empty list of credentials 
which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
  2> 5339 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to 
ZooKeeper
  2> 5363 INFO  (zkConnectionManagerCallback-5-thread-1) [] 
o.a.s.c.c.ConnectionManager zkClient has connected
  2> 5365 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
  2> 5365 WARN  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not 
secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
  2> 5366 WARN  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsInjector. 
ZkCredentialsInjector is not secure, it creates an empty list of credentials 
which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
  2> 5394 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to 
ZooKeeper
  2> 5418 INFO  (zkConnectionManagerCallback-7-thread-1) [] 
o.a.s.c.c.ConnectionManager zkClient has connected
  2> 5419 INFO  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
  2> 5420 WARN  
(SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker) [] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider. DefaultZkACLProvider is not 
secure, it creates 'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
  2> 5914 INFO  (jetty-launcher-8-thread-1) [] o.a.s.e.JettySolrRunner Start 
Jetty (configured port=0, binding port=0)
  2> 5918 INFO  (jetty-launcher-8-thread-1) [] o.a.s.e.JettySolrRunner Trying 
to start Jetty on port 0 try number 2 ...
  2> 5927 INFO  (jetty-launcher-8-thread-1) [] o.e.j.s.Server jetty-10.0.16; 
built: 2023-08-25T19:11:25.422Z; git: a2735a9ae9d1afc124974253f1e223e5678be1f4; 
jvm 11.0.16+8
  2> 6047 INFO  (jetty-launcher-8-thread-1) [] 
o.e.j.s.s.DefaultSessionIdManager Session workerName=node0
  2> 6088 INFO  (jetty-launcher-8-thread-1) [] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@489a1d71{/solr,file:///tmp/src/solr/solr/solrj/build/tmp/tests-cwd/,AVAILABLE}
  2> 6107 INFO  (jetty-launcher-8-thread-1) [] o.e.j.s.AbstractConnector 
Started ServerConnector@5a7d7547{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:٤١٢٧١}
  2> 6111 INFO  (jetty-launcher-8-thread-1) [] o.e.j.s.Server Started 
Server@cad2f1d{STARTING}[10.0.16,sto=٠] @٦١٦٨ms
  2> 6126 ERROR (jetty-launcher-8-thread-1) [] o.a.s.u.StartupLoggingUtils 
Missing Java Option solr.log.dir. Logging may be missing or incomplete.
  2> 6128 INFO  (jetty-launcher-8-thread-1) [] o.a.s.s.CoreContainerProvider 
Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory
  2> 6142 INFO  (jetty-launcher-8-thread-1) [] o.a.s.s.CoreContainerProvider  
___      _       Welcome to Apache Solr™ version 9.4.0-SNAPSHOT 
5cc252fb39f138f21e5894d08ba987479c90193a [snapshot build, details omitted]
  2> 6143 INFO  (jetty-launcher-8-thread-1) [] o.a.s.s.CoreContainerProvider / 
__| ___| |_ _   Starting in cloud mode on port null
  2> 6143 INFO  (jetty-launcher-8-thread-1) [] o.a.s.s.CoreContainerProvider 
\__ \/ _ \ | '_|  Install dir: /tmp/src/solr/solr
  2> 6144 INFO  (jetty-launcher-8-thread-1) [] o.a.s.s.CoreContainerProvider 
|___/\___/_|_|    Start time: 2023-09-10T11:03:47.837079Z
  2> 6170 INFO  (jetty-launcher-8-thread-1) [] o.a.s.s.CoreContainerProvider 
Solr Home: 
/tmp/src/solr/solr/solrj/build/tmp/tests-tmp/solr.client.solrj.request.json.JsonQueryRequestIntegrationTest_2B280FFDA3D1F888-001/tempDir-001/node1
 (source: servlet config: solr.solr.home)
  2> 6193 WARN  (jetty-launcher-8-thread-1) [] o.a.s.c.c.SolrZkClient Using 
default ZkCredentialsInjector. ZkCredentialsInjector is not secure, it creates 
an empty list of credentials which leads to 'OPEN_ACL_UNSAFE' ACLs to Zookeeper 
nodes
  2> 6218 INFO  (jetty-launcher-8-thread-1) [] o.a.s.c.c.ConnectionManager 
Waiting up to 30000ms for client to connect to ZooKeeper
  2> 6246 INFO  (zkConnectionManagerCallback-10-thread-1) [] 
o.a.s.c.c.ConnectionManager zkClient has connected
  2> 6247 INFO  (jetty-launcher-8-thread-1) [] o.a.s.c.c.ConnectionManager 
Client is connected to ZooKeeper
  2> 6247 WARN  (jetty-launcher-8-thread-1) [] o.a.s.c.c.SolrZkClient Using 
default ZkACLProvider. DefaultZkACLProvider is not secure, it creates 
'OPEN_ACL_UNSAFE' ACLs to Zookeeper nodes
  2> 6252 INFO  (jetty-launcher-8-thread-1) [] o.a.s.c.NodeConfig solr.xml 
found in ZooKeeper. Loading...
  2> 6254 WARN  (jetty-launcher-8-thread-1) [] o.a.s.D.solrxml-zookeeper 
Loading solr.xml from zookeeper is deprecated. See reference guide for details.
  2> 6317 INFO  (jetty-launcher-8-thread-1) [] o.a.s.c.SolrXmlConfig Metrics 
collection is disabled.
  2> 7790 INFO  (jetty-launcher-8-thread-1) [] o.a.s.c.ZkContainer Zookeeper 
client=127.0.0.1:35923/solr
  2> 7821 INFO  (jetty-launcher-8-thread-1) [] 
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater 
with useDistributedStateUpdate=false. Solr will be using Overseer based cluster 
state updates.
  2> 7874 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to 
ZooKeeper
  2> 7884 INFO  (zkConnectionManagerCallback-20-thread-1) [] 
o.a.s.c.c.ConnectionManager zkClient has connected
  2> 7885 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
  2> 8132 WARN  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; 
consider setting up ACLs as described in 
https://solr.apache.org/guide/solr/latest/deployment-guide/zookeeper-access-control.html
  2> 8183 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater 
with useDistributedStateUpdate=false. Solr will be using Overseer based cluster 
state updates.
  2> 8234 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41271_solr
  2> 8243 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.Overseer Overseer 
(id=72057609367453700-127.0.0.1:41271_solr-n_0000000000) starting
  2> 8406 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:41271_solr
  2> 8408 INFO  
(OverseerStateUpdate-72057609367453700-127.0.0.1:41271_solr-n_0000000000) 
[n:127.0.0.1:41271_solr] o.a.s.c.Overseer Starting to work on the main queue : 
127.0.0.1:41271_solr
  2> 8438 INFO  (zkCallback-19-thread-1) [] o.a.s.c.c.ZkStateReader Updated 
live nodes from ZooKeeper... (0) -> (1)
  2> 8516 WARN  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.CoreContainer Not all security plugins configured!  
authentication=disabled authorization=disabled.  Solr is only as secure as you 
make it. Consider configuring authentication/authorization before exposing Solr 
to users internal or external.  See https://s.apache.org/solrsecurity for more 
info
  2> 9049 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath 
/tmp/src/solr/solr/solrj/build/tmp/tests-tmp/solr.client.solrj.request.json.JsonQueryRequestIntegrationTest_2B280FFDA3D1F888-001/tempDir-001/node1
  2> 10030 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.j.SolrRequestAuthorizer Creating a new SolrRequestAuthorizer
  2> 10203 INFO  (jetty-launcher-8-thread-1) [n:127.0.0.1:41271_solr] 
o.a.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41271, 
zkHost=127.0.0.1:35923/solr}
  2> شتمبر ١٠, ٢٠٢٣ ١٠:٠٣:٤٥ ص 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
  2> WARNING: Suite execution timed out: 
org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest
  2> ==== jstack at approximately timeout time ====
  2> "Test worker" ID=1 WAITING on 
com.carrotsearch.randomizedtesting.RandomizedRunner$2@160bd79a
  2>    at java.base@11.0.16/java.lang.Object.wait(Native Method)
  2>    - waiting on 
com.carrotsearch.randomizedtesting.RandomizedRunner$2@160bd79a
  2>    at java.base@11.0.16/java.lang.Thread.join(Thread.java:1300)
  2>    at java.base@11.0.16/java.lang.Thread.join(Thread.java:1375)
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:647)
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:504)
  2>    at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.runTestClass(JUnitTestClassExecutor.java:108)
  2>    at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:57)
  2>    at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecutor.execute(JUnitTestClassExecutor.java:39)
  2>    at 
org.gradle.api.internal.tasks.testing.junit.AbstractJUnitTestClassProcessor.processTestClass(AbstractJUnitTestClassProcessor.java:62)
  2>    at 
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:52)
  2>    at 
java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
  2>    at 
java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  2>    at 
java.base@11.0.16/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2>    at java.base@11.0.16/java.lang.reflect.Method.invoke(Method.java:566)
  2>    at 
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:36)
  2>    at 
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
  2>    at 
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:33)
  2>    at 
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:94)
  2>    at com.sun.proxy.$Proxy2.processTestClass(Unknown Source)
  2>    at 
org.gradle.api.internal.tasks.testing.worker.TestWorker$2.run(TestWorker.java:176)
  2>    at 
org.gradle.api.internal.tasks.testing.worker.TestWorker.executeAndMaintainThreadName(TestWorker.java:129)
  2>    at 
org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:100)
  2>    at 
org.gradle.api.internal.tasks.testing.worker.TestWorker.execute(TestWorker.java:60)
  2>    at 
org.gradle.process.internal.worker.child.ActionExecutionWorker.execute(ActionExecutionWorker.java:56)
  2>    at 
org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:113)
  2>    at 
org.gradle.process.internal.worker.child.SystemApplicationClassLoaderWorker.call(SystemApplicationClassLoaderWorker.java:65)
  2>    at 
app//worker.org.gradle.process.internal.worker.GradleWorkerMain.run(GradleWorkerMain.java:69)
  2>    at 
app//worker.org.gradle.process.internal.worker.GradleWorkerMain.main(GradleWorkerMain.java:74)
  2> 
  2> "Reference Handler" ID=2 RUNNABLE
  2>    at 
java.base@11.0.16/java.lang.ref.Reference.waitForReferencePendingList(Native 
Method)
  2>    at 
java.base@11.0.16/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
  2>    at 
java.base@11.0.16/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
  2> 
  2> "Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@12928f35
  2>    at java.base@11.0.16/java.lang.Object.wait(Native Method)
  2>    - waiting on java.lang.ref.ReferenceQueue$Lock@12928f35
  2>    at 
java.base@11.0.16/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
  2>    at 
java.base@11.0.16/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
  2>    at 
java.base@11.0.16/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
  2> 
  2> "Signal Dispatcher" ID=4 RUNNABLE
  2> 
  2> "Common-Cleaner" ID=9 TIMED_WAITING on 
java.lang.ref.ReferenceQueue$Lock@284d5c2
  2>    at java.base@11.0.16/java.lang.Object.wait(Native Method)
  2>    - timed waiting on java.lang.ref.ReferenceQueue$Lock@284d5c2
  2>    at 
java.base@11.0.16/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
  2>    at 
java.base@11.0.16/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    at 
java.base@11.0.16/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:161)
  2> 
  2> "/127.0.0.1:56538 to /127.0.0.1:34529 workers" ID=11 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2b610fec
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2b610fec
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
org.gradle.internal.remote.internal.hub.queue.EndPointQueue.take(EndPointQueue.java:49)
  2>    at 
org.gradle.internal.remote.internal.hub.MessageHub$Handler.run(MessageHub.java:403)
  2>    at 
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
  2>    at 
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:49)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@71809907
  2> 
  2> "/127.0.0.1:56538 to /127.0.0.1:34529 workers Thread 2" ID=12 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1e97fbb7
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1e97fbb7
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
org.gradle.internal.remote.internal.hub.queue.EndPointQueue.take(EndPointQueue.java:49)
  2>    at 
org.gradle.internal.remote.internal.hub.MessageHub$ConnectionDispatch.run(MessageHub.java:322)
  2>    at 
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
  2>    at 
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:49)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@35d019a3
  2> 
  2> "/127.0.0.1:56538 to /127.0.0.1:34529 workers Thread 3" ID=13 RUNNABLE (in 
native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@18fa2477
  2>    - locked sun.nio.ch.EPollSelectorImpl@3cf4c86f
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
org.gradle.internal.remote.internal.inet.SocketConnection$SocketInputStream.read(SocketConnection.java:185)
  2>    at com.esotericsoftware.kryo.io.Input.fill(Input.java:146)
  2>    at com.esotericsoftware.kryo.io.Input.require(Input.java:178)
  2>    at com.esotericsoftware.kryo.io.Input.readByte(Input.java:295)
  2>    at 
org.gradle.internal.serialize.kryo.KryoBackedDecoder.readByte(KryoBackedDecoder.java:88)
  2>    at 
org.gradle.internal.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:64)
  2>    at 
org.gradle.internal.remote.internal.hub.InterHubMessageSerializer$MessageReader.read(InterHubMessageSerializer.java:52)
  2>    at 
org.gradle.internal.remote.internal.inet.SocketConnection.receive(SocketConnection.java:81)
  2>    at 
org.gradle.internal.remote.internal.hub.MessageHub$ConnectionReceive.run(MessageHub.java:270)
  2>    at 
org.gradle.internal.concurrent.ExecutorPolicy$CatchAndRecordFailures.onExecute(ExecutorPolicy.java:64)
  2>    at 
org.gradle.internal.concurrent.ManagedExecutorImpl$1.run(ManagedExecutorImpl.java:49)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@4c371370
  2> 
  2> "SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]" ID=14 
RUNNABLE
  2>    at 
java.management@11.0.16/sun.management.ThreadImpl.dumpThreads0(Native Method)
  2>    at 
java.management@11.0.16/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:521)
  2>    at 
java.management@11.0.16/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:509)
  2>    at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:708)
  2>    at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:59)
  2>    at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:437)
  2>    - locked java.lang.Object@1f49be72
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:716)
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138)
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:637)
  2> 
  2> "SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker" 
ID=15 WAITING on java.util.concurrent.FutureTask@3e22a46f
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on java.util.concurrent.FutureTask@3e22a46f
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.FutureTask.awaitDone(FutureTask.java:447)
  2>    at 
java.base@11.0.16/java.util.concurrent.FutureTask.get(FutureTask.java:190)
  2>    at 
java.base@11.0.16/java.util.concurrent.AbstractExecutorService.invokeAll(AbstractExecutorService.java:247)
  2>    at 
app//org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:380)
  2>    at 
app//org.apache.solr.cloud.MiniSolrCloudCluster$Builder.build(MiniSolrCloudCluster.java:1311)
  2>    at 
app//org.apache.solr.cloud.MiniSolrCloudCluster$Builder.configure(MiniSolrCloudCluster.java:1278)
  2>    at 
app//org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest.setupCluster(JsonQueryRequestIntegrationTest.java:54)
  2>    at 
java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
  2>    at 
java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  2>    at 
java.base@11.0.16/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2>    at java.base@11.0.16/java.lang.reflect.Method.invoke(Method.java:566)
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:886)
  2>    at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>    at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>    at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
  2>    at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
  2>    at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>    at 
app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>    at 
app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  2>    at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>    at 
app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  2>    at 
app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  2>    at 
app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
  2>    at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
  2>    at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>    at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  2>    at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
  2>    at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$$Lambda$186/0x0000000840222040.run(Unknown
 Source)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "ZkTestServer Run Thread" ID=16 WAITING on 
org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread@7732f640
  2>    at java.base@11.0.16/java.lang.Object.wait(Native Method)
  2>    - waiting on 
org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread@7732f640
  2>    at java.base@11.0.16/java.lang.Thread.join(Thread.java:1300)
  2>    at java.base@11.0.16/java.lang.Thread.join(Thread.java:1375)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:919)
  2>    at 
app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:337)
  2>    at app//org.apache.solr.cloud.ZkTestServer$1.run(ZkTestServer.java:581)
  2> 
  2> "NIOServerCxnFactory.SelectorThread-0" ID=18 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@6d1fff79
  2>    - locked sun.nio.ch.EPollSelectorImpl@3f777686
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:403)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:368)
  2> 
  2> "NIOServerCxnFactory.SelectorThread-1" ID=19 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@14ddacdb
  2>    - locked sun.nio.ch.EPollSelectorImpl@74bdc8f6
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:403)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:368)
  2> 
  2> "NIOServerCxnFactory.AcceptThread:0.0.0.0/0.0.0.0:0" ID=20 RUNNABLE (in 
native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@664b152f
  2>    - locked sun.nio.ch.EPollSelectorImpl@620c9c26
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.select(NIOServerCnxnFactory.java:205)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$AcceptThread.run(NIOServerCnxnFactory.java:181)
  2> 
  2> "ConnnectionExpirer" ID=17 TIMED_WAITING
  2>    at java.base@11.0.16/java.lang.Thread.sleep(Native Method)
  2>    at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$ConnectionExpirerThread.run(NIOServerCnxnFactory.java:554)
  2> 
  2> "NIOWorkerThread-1" ID=21 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1bce4fc8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1bce4fc8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "SessionTracker" ID=22 TIMED_WAITING
  2>    at java.base@11.0.16/java.lang.Thread.sleep(Native Method)
  2>    at 
app//org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:163)
  2> 
  2> "SyncThread:0" ID=23 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1aede3f
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1aede3f
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
app//org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:170)
  2> 
  2> "ProcessThread(sid:0 cport:35923):" ID=24 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f725148
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f725148
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
app//org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:142)
  2> 
  2> "RequestThrottler" ID=25 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3919172c
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3919172c
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
app//org.apache.zookeeper.server.RequestThrottler.run(RequestThrottler.java:147)
  2> 
  2> "NIOWorkerThread-2" ID=26 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1bce4fc8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1bce4fc8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> 
"SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker-SendThread(127.0.0.1:35923)"
 ID=27 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@5040bfc8
  2>    - locked sun.nio.ch.EPollSelectorImpl@2768ccd9
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
  2>    at 
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332)
  2>    at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)
  2> 
  2> 
"SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker-EventThread"
 ID=28 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@a3d216d
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@a3d216d
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:534)
  2> 
  2> "NIOWorkerThread-3" ID=29 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1bce4fc8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1bce4fc8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "zkConnectionManagerCallback-3-thread-1" ID=30 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7bece771
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7bece771
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> 
"SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker-SendThread(127.0.0.1:35923)"
 ID=31 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@2e07b93b
  2>    - locked sun.nio.ch.EPollSelectorImpl@4f68a626
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
  2>    at 
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332)
  2>    at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)
  2> 
  2> 
"SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker-EventThread"
 ID=32 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2c3dc0ef
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@2c3dc0ef
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:534)
  2> 
  2> "zkConnectionManagerCallback-5-thread-1" ID=33 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@30766d76
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@30766d76
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "jetty-launcher-8-thread-1" ID=37 WAITING on 
java.util.concurrent.CountDownLatch$Sync@7c07345c
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on java.util.concurrent.CountDownLatch$Sync@7c07345c
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:885)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1039)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1345)
  2>    at 
java.base@11.0.16/java.util.concurrent.CountDownLatch.await(CountDownLatch.java:232)
  2>    at 
app//org.apache.solr.servlet.CoreContainerProvider$ContextInitializationKey.waitForReadyService(CoreContainerProvider.java:525)
  2>    at 
app//org.apache.solr.servlet.CoreContainerProvider$ServiceHolder.getService(CoreContainerProvider.java:564)
  2>    at 
app//org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:147)
  2>    at 
app//org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:133)
  2>    at 
app//org.eclipse.jetty.servlet.ServletHandler.initializeHolders(ServletHandler.java:774)
  2>    at 
app//org.eclipse.jetty.servlet.ServletHandler.setFilters(ServletHandler.java:1472)
  2>    at 
app//org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:992)
  2>    at 
app//org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:480)
  2>    at 
app//org.apache.solr.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:427)
  2>    - locked org.apache.solr.embedded.JettySolrRunner$1@232bc422
  2>    at 
app//org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:253)
  2>    at 
app//org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:94)
  2>    at 
app//org.apache.solr.embedded.JettySolrRunner.retryOnPortBindFailure(JettySolrRunner.java:616)
  2>    at 
app//org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:554)
  2>    - locked org.apache.solr.embedded.JettySolrRunner@29f81ff7
  2>    at 
app//org.apache.solr.embedded.JettySolrRunner.start(JettySolrRunner.java:525)
  2>    at 
app//org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:569)
  2>    at 
app//org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:375)
  2>    at 
app//org.apache.solr.cloud.MiniSolrCloudCluster$$Lambda$273/0x0000000840335c40.call(Unknown
 Source)
  2>    at 
java.base@11.0.16/java.util.concurrent.FutureTask.run(FutureTask.java:264)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$264/0x0000000840330440.run(Unknown
 Source)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.locks.ReentrantLock$NonfairSync@6b80989f
  2>    - java.util.concurrent.locks.ReentrantLock$NonfairSync@681e5544
  2>    - java.util.concurrent.locks.ReentrantLock$NonfairSync@15e996b1
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@24cf893
  2> 
  2> "qtp9527710-39" ID=39 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@132c0f23
  2>    - locked sun.nio.ch.EPollSelectorImpl@982dc77
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$317/0x000000084038d840.run(Unknown
 Source)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "qtp9527710-40" ID=40 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "qtp9527710-41-acceptor-٠@380a3285-ServerConnector@5a7d7547{HTTP/1.1, 
(http/1.1, h2c)}{127.0.0.1:٤١٢٧١}" ID=41 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.ServerSocketChannelImpl.accept0(Native 
Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
  2>    at 
java.base@11.0.16/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
  2>    at 
app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:409)
  2>    at 
app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:748)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.locks.ReentrantLock$NonfairSync@15e7e470
  2> 
  2> "qtp9527710-42" ID=42 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "qtp9527710-43" ID=43 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "qtp9527710-44" ID=44 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "qtp9527710-45" ID=45 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "qtp9527710-46" ID=46 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@50878fe8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>    at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "Session-HouseKeeper-65e81bf7-1" ID=47 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6641a4f8
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6641a4f8
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
java.base@11.0.16/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
  2>    at 
java.base@11.0.16/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "httpShardExecutor-15-thread-1" ID=51 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@79bfbd23
  2>    - locked sun.nio.ch.EPollSelectorImpl@15ab8533
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$317/0x000000084038d840.run(Unknown
 Source)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$264/0x0000000840330440.run(Unknown
 Source)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@6c00ac54
  2> 
  2> "httpShardExecutor-15-thread-2" ID=52 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@3f453792
  2>    - locked sun.nio.ch.EPollSelectorImpl@54c822e6
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$317/0x000000084038d840.run(Unknown
 Source)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$264/0x0000000840330440.run(Unknown
 Source)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@23d304a2
  2> 
  2> "Connection evictor" ID=53 TIMED_WAITING
  2>    at java.base@11.0.16/java.lang.Thread.sleep(Native Method)
  2>    at 
app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "Connection evictor" ID=54 TIMED_WAITING
  2>    at java.base@11.0.16/java.lang.Thread.sleep(Native Method)
  2>    at 
app//org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "h2sc-17-thread-1" ID=55 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@501adbf9
  2>    - locked sun.nio.ch.EPollSelectorImpl@19515ed4
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$317/0x000000084038d840.run(Unknown
 Source)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$264/0x0000000840330440.run(Unknown
 Source)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@3457019d
  2> 
  2> "h2sc-17-thread-2" ID=56 RUNNABLE (in native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@f3e03cb
  2>    - locked sun.nio.ch.EPollSelectorImpl@1af4dfd8
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
  2>    at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
  2>    at 
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$317/0x000000084038d840.run(Unknown
 Source)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
  2>    at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$264/0x0000000840330440.run(Unknown
 Source)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    Locked synchronizers:
  2>    - java.util.concurrent.ThreadPoolExecutor$Worker@7c64da9b
  2> 
  2> "jetty-launcher-8-thread-1-SendThread(127.0.0.1:35923)" ID=57 RUNNABLE (in 
native code)
  2>    at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>    at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>    - locked sun.nio.ch.Util$2@1c371a6c
  2>    - locked sun.nio.ch.EPollSelectorImpl@f0350c0
  2>    at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:136)
  2>    at 
app//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332)
  2>    at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)
  2> 
  2> "jetty-launcher-8-thread-1-EventThread" ID=58 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705c2ab0
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@705c2ab0
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:534)
  2> 
  2> "zkConnectionManagerCallback-20-thread-1" ID=59 WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4c6a317c
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4c6a317c
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>    at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>    at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "OverseerStateUpdate-72057609367453700-127.0.0.1:41271_solr-n_0000000000" 
ID=60 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@68aaa6e7
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@68aaa6e7
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:488)
  2>    at 
app//org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:338)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> 
"OverseerCollectionConfigSetProcessor-72057609367453700-127.0.0.1:41271_solr-n_0000000000"
 ID=61 TIMED_WAITING on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7d3a7e62
  2>    at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>    - timed waiting on 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7d3a7e62
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>    at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>    at 
app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:488)
  2>    at 
app//org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:267)
  2>    at 
app//org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:272)
  2>    at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2> 
  2> "CloserThread" ID=63 WAITING on java.lang.Object@6ca2d2df
  2>    at java.base@11.0.16/java.lang.Object.wait(Native Method)
  2>    - waiting on java.lang.Object@6ca2d2df
  2>    at java.base@11.0.16/java.lang.Object.wait(Object.java:328)
  2>    at app//org.apache.solr.core.CloserThread.run(CoreContainer.java:2599)
  2> 
  2> ^^==============================================
  2> 
  2> شتمبر ١٠, ٢٠٢٣ ١٠:٠٣:٤٥ ص 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
  2> WARNING: Will linger awaiting termination of 37 leaked thread(s).
  2> شتمبر ١٠, ٢٠٢٣ ١٠:٠٣:٤٦ ص 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
  2> SEVERE: 37 threads leaked from SUITE scope at 
org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest: 
  2>    1) Thread[id=16, name=ZkTestServer Run Thread, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/java.lang.Object.wait(Native Method)
  2>         at java.base@11.0.16/java.lang.Thread.join(Thread.java:1300)
  2>         at java.base@11.0.16/java.lang.Thread.join(Thread.java:1375)
  2>         at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:919)
  2>         at 
app//org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:337)
  2>         at 
app//org.apache.solr.cloud.ZkTestServer$1.run(ZkTestServer.java:581)
  2>    2) Thread[id=25, name=RequestThrottler, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
app//org.apache.zookeeper.server.RequestThrottler.run(RequestThrottler.java:147)
  2>    3) Thread[id=43, name=qtp9527710-43, state=TIMED_WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    4) Thread[id=30, name=zkConnectionManagerCallback-3-thread-1, 
state=WAITING, group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    5) Thread[id=41, 
name=qtp9527710-41-acceptor-٠@380a3285-ServerConnector@5a7d7547{HTTP/1.1, 
(http/1.1, h2c)}{127.0.0.1:٤١٢٧١}, state=RUNNABLE, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at 
java.base@11.0.16/sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
  2>         at 
java.base@11.0.16/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:533)
  2>         at 
java.base@11.0.16/sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:285)
  2>         at 
app//org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:409)
  2>         at 
app//org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:748)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    6) Thread[id=23, name=SyncThread:0, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
app//org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:170)
  2>    7) Thread[id=42, name=qtp9527710-42, state=TIMED_WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    8) Thread[id=15, 
name=SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker, 
state=WAITING, group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.FutureTask.awaitDone(FutureTask.java:447)
  2>         at 
java.base@11.0.16/java.util.concurrent.FutureTask.get(FutureTask.java:190)
  2>         at 
java.base@11.0.16/java.util.concurrent.AbstractExecutorService.invokeAll(AbstractExecutorService.java:247)
  2>         at 
app//org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:380)
  2>         at 
app//org.apache.solr.cloud.MiniSolrCloudCluster$Builder.build(MiniSolrCloudCluster.java:1311)
  2>         at 
app//org.apache.solr.cloud.MiniSolrCloudCluster$Builder.configure(MiniSolrCloudCluster.java:1278)
  2>         at 
app//org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest.setupCluster(JsonQueryRequestIntegrationTest.java:54)
  2>         at 
java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
  2>         at 
java.base@11.0.16/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  2>         at 
java.base@11.0.16/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  2>         at 
java.base@11.0.16/java.lang.reflect.Method.invoke(Method.java:566)
  2>         at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
  2>         at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:886)
  2>         at 
app//com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>         at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>         at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
  2>         at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
  2>         at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>         at 
app//org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>         at 
app//org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
  2>         at 
app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
  2>         at 
app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
  2>         at 
app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
  2>         at 
app//org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
  2>         at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
  2>         at 
app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
  2>         at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
  2>         at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850)
  2>         at 
app//com.carrotsearch.randomizedtesting.ThreadLeakControl$$Lambda$186/0x0000000840222040.run(Unknown
 Source)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>    9) Thread[id=24, name=ProcessThread(sid:0 cport:35923):, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
app//org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:142)
  2>   10) Thread[id=47, name=Session-HouseKeeper-65e81bf7-1, 
state=TIMED_WAITING, group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
java.base@11.0.16/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
  2>         at 
java.base@11.0.16/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   11) Thread[id=56, name=h2sc-17-thread-2, state=RUNNABLE, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>         at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>         at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>         at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
  2>         at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
  2>         at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
  2>         at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$317/0x000000084038d840.run(Unknown
 Source)
  2>         at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
  2>         at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$264/0x0000000840330440.run(Unknown
 Source)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   12) Thread[id=60, 
name=OverseerStateUpdate-72057609367453700-127.0.0.1:41271_solr-n_0000000000, 
state=TIMED_WAITING, group=Overseer state updater.]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:488)
  2>         at 
app//org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:338)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   13) Thread[id=32, 
name=SUITE-JsonQueryRequestIntegrationTest-seed#[2B280FFDA3D1F888]-worker-EventThread,
 state=WAITING, group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:534)
  2>   14) Thread[id=63, name=CloserThread, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/java.lang.Object.wait(Native Method)
  2>         at java.base@11.0.16/java.lang.Object.wait(Object.java:328)
  2>         at 
app//org.apache.solr.core.CloserThread.run(CoreContainer.java:2599)
  2>   15) Thread[id=40, name=qtp9527710-40, state=TIMED_WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   16) Thread[id=19, name=NIOServerCxnFactory.SelectorThread-1, 
state=RUNNABLE, group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>         at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>         at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>         at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>         at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.select(NIOServerCnxnFactory.java:403)
  2>         at 
app//org.apache.zookeeper.server.NIOServerCnxnFactory$SelectorThread.run(NIOServerCnxnFactory.java:368)
  2>   17) Thread[id=44, name=qtp9527710-44, state=TIMED_WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   18) Thread[id=61, 
name=OverseerCollectionConfigSetProcessor-72057609367453700-127.0.0.1:41271_solr-n_0000000000,
 state=TIMED_WAITING, group=Overseer collection creation process.]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
app//org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:488)
  2>         at 
app//org.apache.solr.cloud.OverseerTaskQueue.peekTopN(OverseerTaskQueue.java:267)
  2>         at 
app//org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:272)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   19) Thread[id=29, name=NIOWorkerThread-3, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   20) Thread[id=37, name=jetty-launcher-8-thread-1, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at java.base@11.0.16/java.util.concurrent.locks.Loc

[...truncated too long message...]

p//org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332)
  2>         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1274)
  2>   22) Thread[id=33, name=zkConnectionManagerCallback-5-thread-1, 
state=WAITING, group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   23) Thread[id=21, name=NIOWorkerThread-1, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   24) Thread[id=26, name=NIOWorkerThread-2, state=WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
  2>         at 
java.base@11.0.16/java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:433)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   25) Thread[id=46, name=qtp9527710-46, state=TIMED_WAITING, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/jdk.internal.misc.Unsafe.park(Native Method)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
  2>         at 
java.base@11.0.16/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
  2>         at 
app//org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:219)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.idleJobPoll(QueuedThreadPool.java:1124)
  2>         at 
app//org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1141)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   26) Thread[id=52, name=httpShardExecutor-15-thread-2, state=RUNNABLE, 
group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/sun.nio.ch.EPoll.wait(Native Method)
  2>         at 
java.base@11.0.16/sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:120)
  2>         at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:124)
  2>         at 
java.base@11.0.16/sun.nio.ch.SelectorImpl.select(SelectorImpl.java:141)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector.nioSelect(ManagedSelector.java:180)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector.select(ManagedSelector.java:187)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:604)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:541)
  2>         at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produceTask(AdaptiveExecutionStrategy.java:455)
  2>         at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:248)
  2>         at 
app//org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.produce(AdaptiveExecutionStrategy.java:193)
  2>         at 
app//org.eclipse.jetty.io.ManagedSelector$$Lambda$317/0x000000084038d840.run(Unknown
 Source)
  2>         at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:289)
  2>         at 
app//org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$264/0x0000000840330440.run(Unknown
 Source)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
  2>         at 
java.base@11.0.16/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
  2>         at java.base@11.0.16/java.lang.Thread.run(Thread.java:829)
  2>   27) Thread[id=57, 
name=jetty-launcher-8-thread-1-SendThread(127.0.0.1:35923), 
state=TIMED_WAITING, group=TGRP-JsonQueryRequestIntegrationTest]
  2>         at java.base@11.0.16/java.lang.Thread.sleep(Native Method)
  2>         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1127)
  2>         at 
app//org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1192)
   >     java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   >         at __randomizedtesting.SeedInfo.seed([2B280FFDA3D1F888]:0)
  2> NOTE: test params are: codec=Asserting(Lucene95): {}, docValues:{}, 
maxPointsInLeafNode=1083, maxMBSortInHeap=7.9611264969553694, 
sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=ar-MR, 
timezone=America/Argentina/La_Rioja
  2> NOTE: Linux 5.4.0-100-generic amd64/Oracle Corporation 11.0.16 
(64-bit)/cpus=1,threads=33,free=271076784,total=343932928
  2> NOTE: All tests run in this JVM: [JsonQueryRequestIntegrationTest]
  2> NOTE: reproduce with: gradlew test --tests JsonQueryRequestIntegrationTest 
-Dtests.seed=2B280FFDA3D1F888 -Dtests.locale=ar-MR 
-Dtests.timezone=America/Argentina/La_Rioja -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8

:solr:solrj:test (FAILURE): 1119 test(s), 1 failure(s), 40 skipped

1119 tests completed, 1 failed, 40 skipped

> Task :solr:solrj:test FAILED
> Task :solr:solrj:wipeTaskTemp

ERROR: The following test(s) have failed:
  - 
org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest.classMethod
 (:solr:solrj)
    Test output: 
/tmp/src/solr/solr/solrj/build/test-results/test/outputs/OUTPUT-org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest.txt
    Reproduce with: gradlew :solr:solrj:test --tests 
"org.apache.solr.client.solrj.request.json.JsonQueryRequestIntegrationTest.classMethod"
 -Ptests.jvms=96 "-Ptests.jvmargs=-XX:TieredStopAtLevel=1 -XX:+UseParallelGC 
-XX:ActiveProcessorCount=1 -XX:ReservedCodeCacheSize=120m" 
-Ptests.seed=2B280FFDA3D1F888 -Ptests.file.encoding=UTF-8


FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* Where:
Build file '/tmp/src/solr/solr/packaging/build.gradle' line: 285

* What went wrong:
Execution failed for task ':solr:packaging:integrationTests'.
> Process 'command 
> '/tmp/src/solr/.gradle/node/packaging/node_modules/bats/bin/bats'' finished 
> with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':solr:solrj:test'.
> There were failing tests. See the results at: 
> file:///tmp/src/solr/solr/solrj/build/test-results/test/

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

BUILD FAILED in 2h 2m 34s
673 actionable tasks: 656 executed, 17 up-to-date
[?12l[?25h
------------------------------------------------------------------------
Build Failed: returned 1

Total time: 2h2m58s
------------------------------------------------------------------------
+ status=1
+ ./crave pull '**/build/**/test/TEST-*.xml' '**/*.events' 'heapdumps/**' 
'**/hs_err_pid*'
Error: rsync: [sender] change_dir "/tmp/src/solr/heapdumps" failed: No such 
file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 
23) at main.c(1684) [Receiver=3.1.3]
rsync: [Receiver] write error: Broken pipe (32)

+ exit 1
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
[Checks API] No suitable checks publisher found.
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@solr.apache.org
For additional commands, e-mail: builds-h...@solr.apache.org