Hi Shawn, et al, I haven't thought about ip6. Interesting idea.
- I've tried to use the address 127.0.0.1. It did not help (I've un-commented the suppress-output-line in the script, so it is possible to see what it is being done) [1]. I also tried all possible combinations of the IP addresses that got assigned through the net cards without no success [2]. There is some 10sec delay between the start of the command and the error. - I also reset ip6v as you suggested without any success [3]. - ping returns in my case as in yours [4]. - ipconfig /all returns [5]. - Then I disables ipv6 on the network card. No change. - Then I found https://superuser.com/questions/586144/disable-ipv6-loopback-on-windows-7-64-bit and did [6]. No change. I restarted the cluster with -z 127.0.0.1:10999 [6]. No change. Any comments are very helpful. Cheers, Arturas References: [1] F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\zkcli.bat -zkhost 127.0.0.1:10999 -cmd downconfig -confdir d:\de_wiki_man_config2 -confname de_wiki_man F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>rem @echo off F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM You can override pass the following parameters to this script: F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set JVM=java F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Find location of this script F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if "\" == "\" set SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if defined LOG4J_PROPS (set "LOG4J_CONFIG=file:" ) else (set "LOG4J_CONFIG=file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties" ) F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Settings for ZK ACL F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM set SOLR_ZK_CREDS_AND_ACLS=-DzkACLProvider=org.apache.solr.common.cloud.VMParamsAllAndReadonlyDigestZkACLProvider ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -DzkCredentialsProvider=org.apache.solr.common.cloud.VMParamsSingleSetCredentialsDigestZkCredentialsProvider ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -DzkDigestUsername=admin-user -DzkDigestPassword=CHANGEME-ADMIN-PASSWORD ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -DzkDigestReadonlyUsername=readonly-user -DzkDigestReadonlyPassword=CHANGEME-READONLY-PASSWORD F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM "java" -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties" ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -classpath "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*" org.apache.solr.cloud.ZkCLI -zkhost 127.0.0.1:10999 -cmd downconfig -confdir d:\de_wiki_man_config2 -confname de_wiki_man F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>"java" -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties" -Djava.net.preferIPv4Stack=true -classpath "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*" org.apache.solr.cloud.ZkCLI -zkhost 127.0.0.1:10999 -cmd downconfig -confdir d:\de_wiki_man_config2 -confname de_wiki_man Exception in thread "main" org.apache.solr.common.SolrException: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:170) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:119) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:109) at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:197) Caused by: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1842) at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447) at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380) at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43) at org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105) at org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:148) ... 3 more Caused by: java.io.IOException: Unable to establish loopback connection at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source) at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at sun.nio.ch.PipeImpl.<init>(Unknown Source) at sun.nio.ch.SelectorProviderImpl.openPipe(Unknown Source) at java.nio.channels.Pipe.open(Unknown Source) at sun.nio.ch.WindowsSelectorImpl.<init>(Unknown Source) at sun.nio.ch.WindowsSelectorProvider.openSelector(Unknown Source) at java.nio.channels.Selector.open(Unknown Source) at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1839) ... 9 more Caused by: java.net.ConnectException: Connection timed out: connect at sun.nio.ch.Net.connect0(Native Method) at sun.nio.ch.Net.connect(Unknown Source) at sun.nio.ch.Net.connect(Unknown Source) at sun.nio.ch.SocketChannelImpl.connect(Unknown Source) at java.nio.channels.SocketChannel.open(Unknown Source) at sun.nio.ch.PipeImpl$Initializer$LoopbackConnector.run(Unknown Source) ... 25 more F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\zkcli.bat -zkhost 172.16.203.123:10999 -cmd downconfig -confdir d:\de_wiki_man_config2 -confname de_wiki_man F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>rem @echo off F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM You can override pass the following parameters to this script: F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set JVM=java F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Find location of this script F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>set SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if "\" == "\" set SDIR=f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>if defined LOG4J_PROPS (set "LOG4J_CONFIG=file:" ) else (set "LOG4J_CONFIG=file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties" ) F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM Settings for ZK ACL F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM set SOLR_ZK_CREDS_AND_ACLS=-DzkACLProvider=org.apache.solr.common.cloud.VMParamsAllAndReadonlyDigestZkACLProvider ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -DzkCredentialsProvider=org.apache.solr.common.cloud.VMParamsSingleSetCredentialsDigestZkCredentialsProvider ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -DzkDigestUsername=admin-user -DzkDigestPassword=CHANGEME-ADMIN-PASSWORD ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -DzkDigestReadonlyUsername=readonly-user -DzkDigestReadonlyPassword=CHANGEME-READONLY-PASSWORD F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM "java" -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties" ^ F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>REM -classpath "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*" org.apache.solr.cloud.ZkCLI -zkhost 172.16.203.123:10999 -cmd downconfig -confdir d:\de_wiki_man_config2 -confname de_wiki_man F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>"java" -Dlog4j.configuration="file:f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\log4j.properties" -Djava.net.preferIPv4Stack=true -classpath "f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\solr-webapp\webapp\WEB-INF\lib\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\ext\*;f:\solr_server\solr-7.2.1\server\scripts\cloud-scripts\..\..\lib\*" org.apache.solr.cloud.ZkCLI -zkhost 172.16.203.123:10999 -cmd downconfig -confdir d:\de_wiki_man_config2 -confname de_wiki_man Exception in thread "main" org.apache.solr.common.SolrException: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:170) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:119) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:109) at org.apache.solr.cloud.ZkCLI.main(ZkCLI.java:197) Caused by: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1842) at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447) at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380) at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43) at org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105) at org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:148) ... 3 more Caused by: java.io.IOException: Unable to establish loopback connection at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source) at sun.nio.ch.PipeImpl$Initializer.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at sun.nio.ch.PipeImpl.<init>(Unknown Source) at sun.nio.ch.SelectorProviderImpl.openPipe(Unknown Source) at java.nio.channels.Pipe.open(Unknown Source) at sun.nio.ch.WindowsSelectorImpl.<init>(Unknown Source) at sun.nio.ch.WindowsSelectorProvider.openSelector(Unknown Source) at java.nio.channels.Selector.open(Unknown Source) at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.lang.reflect.Constructor.newInstance(Unknown Source) at java.lang.Class.newInstance(Unknown Source) at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1839) ... 9 more Caused by: java.net.ConnectException: Connection timed out: connect at sun.nio.ch.Net.connect0(Native Method) at sun.nio.ch.Net.connect(Unknown Source) at sun.nio.ch.Net.connect(Unknown Source) at sun.nio.ch.SocketChannelImpl.connect(Unknown Source) at java.nio.channels.SocketChannel.open(Unknown Source) at sun.nio.ch.PipeImpl$Initializer$LoopbackConnector.run(Unknown Source) ... 25 more [3] C:\temp>netsh int ipv6 reset ipv6reset.log Resetting Compartment Forwarding, OK! Resetting Compartment, OK! Resetting Control Protocol, OK! Resetting Echo Sequence Request, OK! Resetting Global, OK! Resetting Interface, OK! Resetting Anycast Address, OK! Resetting Multicast Address, OK! Resetting Unicast Address, OK! Resetting Neighbor, OK! Resetting Path, OK! Resetting Potential, OK! Resetting Prefix Policy, OK! Resetting Proxy Neighbor, OK! Resetting Route, OK! Resetting Site Prefix, OK! Resetting Subinterface, OK! Resetting Wakeup Pattern, OK! Resetting Resolve Neighbor, OK! Resetting , OK! Resetting , OK! Resetting , OK! Resetting , OK! Resetting , failed. Access is denied. Resetting , OK! Resetting , OK! Resetting , OK! Resetting , OK! Resetting , OK! Resetting , OK! Resetting , OK! Restart the computer to complete this action. [4] F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>ping localhost Pinging Arteika.xxx [::1] with 32 bytes of data: Reply from ::1: time<1ms Reply from ::1: time<1ms Reply from ::1: time<1ms Reply from ::1: time<1ms Ping statistics for ::1: Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), Approximate round trip times in milli-seconds: Minimum = 0ms, Maximum = 0ms, Average = 0ms [5] F:\solr_server\solr-7.2.1\server\scripts\cloud-scripts>ipconfig /all Windows IP Configuration Host Name . . . . . . . . . . . . : Arteika Primary Dns Suffix . . . . . . . : xxx Node Type . . . . . . . . . . . . : Hybrid IP Routing Enabled. . . . . . . . : No WINS Proxy Enabled. . . . . . . . : No DNS Suffix Search List. . . . . . : xxx Ethernet adapter Ethernet: Connection-specific DNS Suffix . : xxx Description . . . . . . . . . . . : Intel(R) Ethernet Connection (2) I219-LM Physical Address. . . . . . . . . : 18-66-DA-22-85-02 DHCP Enabled. . . . . . . . . . . : Yes Autoconfiguration Enabled . . . . : Yes Link-local IPv6 Address . . . . . : fe80::39e5:577e:5cf8:5fcc%6(Preferred) IPv4 Address. . . . . . . . . . . : 172.16.203.123(Preferred) Subnet Mask . . . . . . . . . . . : 255.255.248.0 Lease Obtained. . . . . . . . . . : Thursday, June 28, 2018 5:13:28 PM Lease Expires . . . . . . . . . . : Thursday, June 28, 2018 7:13:27 PM Default Gateway . . . . . . . . . : 172.16.200.10 DHCP Server . . . . . . . . . . . : 172.16.200.10 DHCPv6 IAID . . . . . . . . . . . : 55614028 DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-22-3D-C3-09-18-66-DA-22-85-02 DNS Servers . . . . . . . . . . . : 172.16.200.50 NetBIOS over Tcpip. . . . . . . . : Enabled Ethernet adapter VirtualBox Host-Only Network #2: Connection-specific DNS Suffix . : Description . . . . . . . . . . . : VirtualBox Host-Only Ethernet Adapter #2 Physical Address. . . . . . . . . : 0A-00-27-00-00-03 DHCP Enabled. . . . . . . . . . . : No Autoconfiguration Enabled . . . . : Yes Link-local IPv6 Address . . . . . : fe80::b40b:85fe:cf77:ac82%3(Preferred) IPv4 Address. . . . . . . . . . . : 192.168.56.1(Preferred) Subnet Mask . . . . . . . . . . . : 255.255.255.0 Default Gateway . . . . . . . . . : DHCPv6 IAID . . . . . . . . . . . : 285868071 DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-22-3D-C3-09-18-66-DA-22-85-02 DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1 fec0:0:0:ffff::2%1 fec0:0:0:ffff::3%1 NetBIOS over Tcpip. . . . . . . . : Enabled [6]C:\WINDOWS\system32>netsh interface ipv6 set prefix ::/96 60 3 Ok. C:\WINDOWS\system32>netsh interface ipv6 show prefixpolicies Querying active state... Precedence Label Prefix ---------- ----- -------------------------------- 60 3 ::/96 50 0 ::1/128 40 1 ::/0 35 4 ::ffff:0:0/96 30 2 2002::/16 5 5 2001::/32 3 13 fc00::/7 1 12 3ffe::/16 1 11 fec0::/10 C:\WINDOWS\system32>ping localhost Pinging Arteika.xxx [::1] with 32 bytes of data: Reply from ::1: time<1ms Reply from ::1: time<1ms Ping statistics for ::1: Packets: Sent = 2, Received = 2, Lost = 0 (0% loss), Approximate round trip times in milli-seconds: Minimum = 0ms, Maximum = 0ms, Average = 0ms Control-C ^C C:\WINDOWS\system32>netsh interface ipv6 set prefix ::ffff:0:0/96 55 4 Ok. C:\WINDOWS\system32>netsh interface ipv6 show prefixpolicies Querying active state... Precedence Label Prefix ---------- ----- -------------------------------- 60 3 ::/96 55 4 ::ffff:0:0/96 50 0 ::1/128 40 1 ::/0 30 2 2002::/16 5 5 2001::/32 3 13 fc00::/7 1 12 3ffe::/16 1 11 fec0::/10 C:\WINDOWS\system32>ping localhost Pinging Arteika.xxx [127.0.0.1] with 32 bytes of data: Reply from 127.0.0.1: bytes=32 time<1ms TTL=128 Reply from 127.0.0.1: bytes=32 time<1ms TTL=128 Ping statistics for 127.0.0.1: Packets: Sent = 2, Received = 2, Lost = 0 (0% loss), Approximate round trip times in milli-seconds: Minimum = 0ms, Maximum = 0ms, Average = 0ms [7] "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9999 -s "F:\solr_server\solr-7.2.1\example\cloud\node1\solr" "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9998 -s "F:\solr_server\solr-7.2.1\example\cloud\node2\solr" -z 127.0.0.1:10999 "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9997 -s "F:\solr_server\solr-7.2.1\example\cloud\node3\solr" -z 127.0.0.1:10999 "F:\solr_server\solr-7.2.1\bin\solr.cmd" start -m 1g -cloud -p 9996 -s "F:\solr_server\solr-7.2.1\example\cloud\node4\solr" -z 127.0.0.1:10999 On Thu, Jun 28, 2018 at 4:13 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 6/28/2018 4:03 AM, Arturas Mazeika wrote: > > f:\solr_server\solr-7.3.1\server\scripts\cloud-scripts\zkcli.bat -zkhost > > localhost:10999 -cmd downconfig -confdir d:\de_wiki_man_config -confname > > de_wiki_man > > > > Caused by: java.io.IOException: Unable to establish loopback connection > > Take a look at this SO answer (for android software, not Solr): > > https://stackoverflow.com/a/42548312/2665648 > > You can't use that exact solution, because the _JAVA_OPTIONS environment > variable is not used by Solr or its startup script. But I think the > underlying problem might be what you're running into: There may be a > problem with the ipv6 setup on your system. > > If you change the address in the command from localhost to 127.0.0.1, > that might fix the problem. > > Setting the system property to prefer IPv4 addresses would need to > happen in the zkcli script to fix this command. > > Or you can fix the network stack in Windows. Either set up IPv6 > properly, or remove IPv6 entirely. If you do not actually have ipv6 in > your network, you might try this command on a command prompt that has > privilege elevation: > > netsh int ipv6 reset ipv6reset.log > > A reboot might be required after that command. > > What happens if you type 'ping localhost' from a command prompt? This > is what I get, indicating that the local ipv6 address is working: > > C:\Users\sheisey>ping localhost > > Pinging purgatory.REDACTED.com [::1] with 32 bytes of data: > Reply from ::1: time<1ms > Reply from ::1: time<1ms > Reply from ::1: time<1ms > Reply from ::1: time<1ms > > Thanks, > Shawn > >