gthvidsten opened a new issue #385: URL: https://github.com/apache/solr-operator/issues/385
I've installed the SolrCloud with just about all default values except for storage, where I've added a `storageClassName` to both Zookeeper and Solr. When I'm accessing `Cloud > ZK Status` in the Solr web interface (after portforwarding to the "common" service) I get a mostly empty screen containing only this: ``` Status: ZK connection string: Ensemble size: Ensemble mode: ``` With the following error message at the top: `For input string: "null"` If I go to the `Logging` in the Solr web interface the log is very quickly filled with these two errors: ``` RequestHandlerBase | java.lang.NumberFormatException: For input string: "null" HttpSolrCall | null:java.lang.NumberFormatException: For input string: "null" ``` I guess these other errors appear on startup and they seem to be be very related to ZK: ``` ERROR | StaticHostProvider | Unable to resolve address: example-solrcloud-zookeeper-1.example-solrcloud-zookeeper-headless.default.svc.cluster.local:2181 WARN | ClientCnxn | Session 0x0 for server example-solrcloud-zookeeper-1.example-solrcloud-zookeeper-headless.default.svc.cluster.local:2181,​ unexpected error,​ closing socket connection and attempting reconnect ERROR | StaticHostProvider | Unable to resolve address: example-solrcloud-zookeeper-2.example-solrcloud-zookeeper-headless.default.svc.cluster.local:2181 WARN | ClientCnxn | Session 0x0 for server example-solrcloud-zookeeper-2.example-solrcloud-zookeeper-headless.default.svc.cluster.local:2181,​ unexpected error,​ closing socket connection and attempting reconnect ERROR | StaticHostProvider | Unable to resolve address: example-solrcloud-zookeeper-2.example-solrcloud-zookeeper-headless.default.svc.cluster.local:2181 WARN | ClientCnxn | Session 0x0 for server example-solrcloud-zookeeper-2.example-solrcloud-zookeeper-headless.default.svc.cluster.local:2181,​ unexpected error,​ closing socket connection and attempting reconnect WARN | ScheduledTrigger | ScheduledTrigger was not able to run event at scheduled time: 2021-12-11T09:09:16.986Z. Now: 2021-12-11T17:14:46.438Z ``` Looking at the pod logs from i.e. `example-solrcloud-zookeeper-0` I can see the following warnings and errors (some of them repeating multiple times): ``` WARN [QuorumConnectionThread-[myid=1]-1:QuorumCnxManager@400] - Cannot open channel to 2 at election address example-solrcloud-zookeeper-1.example-solrcloud-zookeeper-headless.default.svc.cluster.local:3888 java.net.UnknownHostException: example-solrcloud-zookeeper-1.example-solrcloud-zookeeper-headless.default.svc.cluster.local at java.base/java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.base/java.net.SocksSocketImpl.connect(Unknown Source) at java.base/java.net.Socket.connect(Unknown Source) at org.apache.zookeeper.server.quorum.QuorumCnxManager.initiateConnection(QuorumCnxManager.java:383) at org.apache.zookeeper.server.quorum.QuorumCnxManager$QuorumConnectionReqThread.run(QuorumCnxManager.java:457) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) WARN [SyncThread:1:QuorumPeer@1775] - Restarting Leader Election WARN [NIOWorkerThread-2:NIOServerCnxn@364] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.240.0.54:54618, session = 0x100000911bc0000 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:326) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) ERROR [LearnerHandler-/10.240.0.54:54148:LearnerHandler@707] - Unexpected exception causing shutdown while sock still open java.net.SocketException: Connection reset at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.net.SocketInputStream.read(Unknown Source) at java.base/java.io.BufferedInputStream.fill(Unknown Source) at java.base/java.io.BufferedInputStream.read(Unknown Source) at java.base/java.io.DataInputStream.readInt(Unknown Source) at org.apache.jute.BinaryInputArchive.readInt(BinaryInputArchive.java:96) at org.apache.zookeeper.server.quorum.QuorumPacket.deserialize(QuorumPacket.java:86) at org.apache.jute.BinaryInputArchive.readRecord(BinaryInputArchive.java:134) at org.apache.zookeeper.server.quorum.LearnerHandler.run(LearnerHandler.java:643) WARN [LearnerHandler-/10.240.0.54:54148:LearnerHandler@730] - ******* GOODBYE /10.240.0.54:54148 ******** WARN [NIOWorkerThread-2:NIOServerCnxn@364] - Unexpected exception EndOfStreamException: Unable to read additional data from client, it probably closed the socket: address = /10.240.0.54:54832, session = 0x100000911bc0002 at org.apache.zookeeper.server.NIOServerCnxn.handleFailedRead(NIOServerCnxn.java:163) at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:326) at org.apache.zookeeper.server.NIOServerCnxnFactory$IOWorkRequest.doWork(NIOServerCnxnFactory.java:522) at org.apache.zookeeper.server.WorkerService$ScheduledWorkRequest.run(WorkerService.java:154) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) ``` What is going on here? How can it be fixed? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For additional commands, e-mail: issues-h...@solr.apache.org